Google has initiated a lawsuit against a suspected criminal organization based in China, which it claims utilized AI tools, including its Gemini platform, to operate a phishing enterprise that has resulted in millions of dollars in fraud and the creation of over a million scam websites. The lawsuit, filed in the U.S. District Court for the Southern District of New York, targets a network referred to as the "Outsider Enterprise," which allegedly provided a "phishing-as-a-service" platform that enabled individuals with minimal technical skills to create fraudulent websites impersonating legitimate companies and government entities.
This legal action represents the first instance where Google has pursued legal measures against entities misusing its Gemini platform for scams targeting U.S. consumers. The company is collaborating with the FBI and major telecom providers, including Verizon, AT&T, and T-Mobile, in an effort to combat AI-driven fraud.
According to the lawsuit, the Outsider software suite allowed scammers to generate fraudulent websites using over 290 prebuilt templates that mimicked legitimate businesses. The operation reportedly charged subscription fees as low as $88 per week for access to tools that facilitated phishing campaigns, including real-time dashboards and automated credential harvesting.
Google claims that the scale of the operation was significant, with over 1.59 million URLs linked to the network detected within a five-month period. The lawsuit also details how the network operated through encrypted Telegram channels, collaborating on phishing attacks and distributing updates to their software.
In addition to the lawsuit, Google has expressed support for several bipartisan anti-scam bills aimed at addressing AI-enabled fraud. The FBI noted that this case underscores the increasing sophistication of cyber fraud schemes facilitated by artificial intelligence. Telecommunications companies involved in the lawsuit emphasized the need for a unified response to combat these advanced scams.