Nvidia says its new OpenShell platform can stop AI agents from going rogue

NVIDIA has created a new security platform that the chipmaker said can prevent artificial intelligence agents from going rogue. 

The company said on Monday that it is releasing the new system, called OpenShell, due to the need for "independent security controls" after multiple AI agents disobeyed commands and broke into other systems. 

Most recently, OpenAI said on Friday that its AI agents had interacted with several U.S. government websites in unexpected ways, a disclosure that came after several earlier rogue hacking incidents by other AI agents.

Nvidia executives said in a media briefing that its new system could have prevented a recent incident involving a swarm of OpenAI agents that autonomously hacked into AI company Hugging Face. Mounting reports about AI agents independently hacking companies and government agencies have sparked calls from leading industry executives, including Anthropic CEO Dario Amodei, to slow development of the technology.

"From what we know, this new security platform could have stopped the breach if it was being used in frontier labs for model evaluation early on," Justin Boitano, Nvidia's vice president of enterprise AI, said in a press conference on Monday, referring to companies at the forefront of AI.