Google Is Now Suing Over Its Own AI
The legal novelty here is not that Google sued a phishing ring — it did exactly that seven months ago. It is that, for the first time, Google has legally pursued bad actors specifically for misusing Gemini, its own flagship AI product [1]. That reframes the defendant from "criminals who happen to use the internet" to "criminals who weaponized a tool we built," and it puts Google in the unusual position of arguing that its own model became an instrument of mass fraud.
The mechanism Google describes is mundane in a way that makes it more alarming. According to the complaint, members of the Outsider Enterprise prompted Gemini to write the code for fake 'gift redemption' and brand-impersonation pages — counterfeit sites mimicking Google, YouTube, the U.S. Postal Service, and New York's E-ZPass toll system — and then loaded that generated code into a phishing platform [1]. No zero-day, no novel exploit: just a general-purpose model asked to produce a convincing login page, repeated at industrial scale. The AI did not break Google's safety guardrails so much as it collapsed the labor cost of building believable fakes, which is precisely the part of a phishing operation that used to require skill.



