Google’s best Gemini demo was faked

Now, if the video had said at the start, “This is a stylized representation of interactions our researchers tested,” no one would have batted an eye — we kind of expect videos like this to be half factual, half aspirational.

But the video is called “Hands-on with Gemini” and when they say it shows “our favorite interactions,” it implies that the interactions we see are those interactions. They were not. Sometimes they were more involved; sometimes they were totally different; sometimes they don’t really appear to have happened at all. We’re not even told what model it is — the Gemini Pro one people can use now, or (more likely) the Ultra version slated for release next year?

Should we have assumed that Google was only giving us a flavor video when they described it the way they did? Perhaps then we should assume all capabilities in Google AI demos are being exaggerated for effect. I write in the headline that this video was “faked.” At first I wasn’t sure if this harsh language was justified (certainly Google doesn’t; a spokesperson asked me to change it). But despite including some real parts, the video simply does not reflect reality. It’s fake.

This video melted my face off yesterday because I took it at face value. Despite the disclaimer at the beginning of the video, I assumed the edits were merely to speed things up and gave it the benefit of the doubt.

If they would’ve presented an unedited interaction showing exactly where they’re at… sure, it might not have been as impressive, but it would’ve been authentic. It would still be valuable to show that they’re still in the game despite how far ahead OpenAI currently is.

This, though? It’s 2023. What even was the point of this? This was clearly not presented as an aspirational video; it was titled “hands on with Gemini”.

It’s hard not to take this video as a desparate attempt to make Google look way, way better than they may actually be.