Google's Gemini becomes latest AI model to break out and hack computer systems

Google said on Friday that its Gemini model had hacked three other companies, the first time the search giant has disclosed that one of its models autonomously gained access to third-party computer systems without permission.

In May, the Gemini model accessed three separate private computer systems by guessing passwords and by twice using a repository of publicly listed passwords, Google said.

The incident happened as part of a "capture-the-flag" security test run by Israeli startup Irregular, and Google's agents were never supposed to access the broader internet, but a bug in the testing environment made internet access available.

The agents stopped their intrusion when they determined they had accessed real company systems, not just part of the testing environment, Google said.

"In a standard evaluation, the model found public information online and guessed credentials to access websites it thought were part of the test," Heather Adkins, Google Vice President of Security Engineering, said in a statement. "In all three of these instances, the model stopped."

The disclosure comes as scrutiny over misbehaving artificial intelligence intensifies in Washington and Silicon Valley.

OpenAI, Anthropic and Meta have in recent weeks disclosed incidents where its artificial intelligence models had broken out of their testing environments and attempted to hack other companies to gain unauthorized access to computer systems.