Nvidia launches AI safety platform after Jensen Huang calls Anthropic, OpenAI warnings 'odd'

Nvidia (NVDA) released the Open Agent Safety Platform, which is aimed at helping AI developers to enforce safeguards on agents, a few days after the AI hardware giant's CEO questioned the security approaches of Anthropic and OpenAI.

"AI's extraordinary potential for society will only be realized if we solve AI safety," Nvidia CEO Jensen Huang stated in a press release. "As we continue to discover the frontier of AI capabilities, we must accelerate discovery at the frontier of AI safety. Safety and security require full-stack engineering."

Last week, Huang sat down with Ezra Klein of The New York Times to discuss recent warnings from Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman suggesting that the pace of AI development could threaten humanity.

"If your product is not ready to ship, don't ship the product," Huang told The Ezra Klein Show podcast. "This is the first time that I've heard a company or C.E.O. say that I need… the liability laws of products to be relieved so that I can pace myself."

Huang repeatedly described the stance of the leading AI labs as "odd" given that those companies are leading AI innovation while the safety risks, in his view, can be mitigated with technology.