The challenge of dealing with fake accounts that spread disinformation is probably one of the greatest challenges facing the large social media companies.
Most methods used to detect fake Twitter accounts (like the excellent Botometer ) assume that they are working at scale and are automated, and for large bot operations this is almost always the case. But what about fake accounts that that have a real person behind them? Not every fake account is a bot, but there are still plenty of accounts that purport to be real people in order to add credibility to their message.
Earlier this week The Third Man asked about a Twitter account that he was slightly suspicious of . The account purports to be that of Max Steinberg, a Mancunian (i.e. from Manchester, UK) lawyer who now lives in Brooklyn, New York. He’s passionate about left-wing political causes and spends an awful lot of time amplifying content from his favorite political accounts – but is he even a real person? In the rest of the post I’ll look at a few indicators that suggest he probably isn’t.
Profile Picture – This Person Does Not Exist
This Person Does Not Exist is a website that uses AI to generate random but realistic looking faces. It’s a great tool and has become a popular way of generating fake profiles for sock puppet accounts, but it is not without its limitations. There are a number common flaws and features in TPDNE-generated images that means it’s possible to spot them. I’m fairly confident that “Max Steinberg” has a few of these flaws too, so let’s see if we can prove this is the case.
Eye and Mouth Alignment
A common feature of TPDNE images is that the eyes and mouth of the person are always in exactly the same place in the picture. The eyes are always the same distance apart and centred in the same place. The mouth is always about one quarter of the way up from the bottom of the image and is also always centred. This occurs regardless of the angle of their head and can sometimes make for quite unusual looking faces. Let’s see if Max’s face follows the same pattern:
Interesting! By itself this may not be conclusive, but there are some other features that might indicate that Max’s origins are in an AI program, not Manchester.
Ear Asymmetry
We’re all unique and special snowflakes, and none of us have perfectly aligned facial features – but there’s still something odd about Max’s ears. In the photo he is staring at us directly but his ears are not even remotely symmetrical:
From this angle Max’s ears should look roughly the same size and shape but his right ear is a very different shape and size to his left one. Perhaps I’m being too harsh, and this is just a genetic trait – but if it is, then ear asymmetry is a genetic trait that a lot of the TPDNE family all have in common:
Hmmm. On the balance of probabilities I’m going to say that Max’s ears look like that because he’s AI generated. (I’m sure he will correct me if I’m wrong.)
Unusual Eyes And Teeth
There’s also something odd about his eyes. Look at his right pupil:
His left pupil looks normal, but the pupil in his right eye is nearly twice as wide as his left one. Another example of genetic bad luck? It seems unlikely. TPDNE has improved over times and it now renders eyes and mouths in a much more realistic way, but sometimes there are still tiny flaws that betray the origins of the image.
You can also see a similar problem with his teeth:
His two front teeth (red box) are different shapes and sizes. The teeth on the right side of his mouth have not been rendered properly at all. An analysis of Max’s facial features suggests he has more in common with an AI-generated fake than with a real person.
There are other giveaways too. TPDNE only creates a single image of a person, so if the person truly does not exist, we should never be able to find any image of them other than the fake one where they are staring directly at the camera. Sure enough, there are no other photos of Max in his Twitter account, no reverse image hits for his face, and no matches when searching for images of lawyers called Max Steinberg.
Twitter Habits
Max’s profile picture is likely fake, and it isn’t the only thing that suggests his account isn’t quite what it claims to be. There’s a lot of detail in his bio that we can try and verify. Let’s start with the location:
Although originally from Manchester, he claims to be based in Brooklyn, New York. If this is right then we should be able to see this reflected in Max’s Twitter activity. Foller.me offers some insights into a user’s tweeting habits that might tell us a little more about Max’s origins.
The first sign is the age of the account and the volume of activity. This is the account data as it appeared on the evening of th March:
The account less than a week old but has already posted 766 tweets – that’s a huge volume in such a short period of time. It’s also evident from the content that this nearly-new Twitter account is dedicated entirely to amplifying political messages:
A new account with a fake profile picture that shares huge amounts of political content in a short period? Hmmm.
There’s also something odd about the times that Max tweets at. This is the overview of his activity times as of th March :
These times are UTC, so this shows that Max usually tweets at either end of the working day (with a little activity at lunchtime) – but these times only make sense if Max is based in Europe (which varies between UTC and UTC 2). If Max really was based in New York (which is at UTC -4) then his Twitter activity would peak between 4am and 6am, and again between 1pm and 3pm, which would be unusual for someone who lived there. This is not conclusive, but it does indicate that Max is still probably a lot closer to Manchester than he is to New York.
As I was writing this up I noticed that in the hours since I started there had been a big spike in Max’s activity late at night:
This seemed a little odd but a quick overview of his timeline provided some explanation. The spike coincided with the close of polls for the th March Democratic primaries, which prompted a flurry of activity from Max.
No Backstory
I’m still not convinced on Max’s bio details. Fortunately he’s a lawyer, so he’ll be listed in one of the public registries for qualified lawyers in either the UK or in New York, right? In the UK, the 
Solictor’s Regulation Authority maintains a list of registered lawyers
. Here’s the data they held on Max:
So maybe he’s registered in New York? We can verify whether he is or not because fortunately New York maintains a 
public database of registered attorneys too
. They have not one but two Max Steinbergs registered – perhaps I’ve judged Max a little too harshly?
Nope. The register also tells us that both Max Steinbergs suffer from a serious medical condition that means they can no longer practice law, let alone run a Twitter account.
We’ve seen that Max is almost certainly not a real person. He has a fake profile picture, a fake back story, probably doesn’t live where he says he does, and seems to have been created solely for the purpose of creating and amplifying political Twitter content.
(Read More )
GIPHY App Key not set. Please check settings