Nvidia launches AI security platform after Jensen Huang calls Anthropic and OpenAI ‘strange’

Nvidia (NVDA) released the Open Agent Safety Platform, which aims to help AI developers enforce agent protections, days after the AI ​​hardware giant’s CEO questioned the safety approaches of Anthropic (ANTH.PVT) and OpenAI (OPAI.PVT).

“The extraordinary potential of AI for society will only be realized if we solve AI security,” Nvidia CEO Jensen Huang said in a press release. “As we continue to discover the frontier of AI capabilities, we must accelerate discovery at the frontier of AI security. Safety and security require comprehensive engineering.”

Last week, Huang sat down with Ezra Klein of the New York Times to discuss recent warnings from Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman suggesting that the pace of AI development could threaten humanity.

“If your product isn’t ready to ship, don’t ship it,” Huang told The Ezra Klein Show podcast. “This is the first time I’ve heard a company or CEO say I need product liability laws to be eased so I can keep up with myself.”

Huang has repeatedly called the position of major AI labs “strange,” given that these companies are at the forefront of AI innovation while security risks he says can be mitigated with the technology.

“No one builds more computing today than those who ask to be slowed down,” Huang told Klein. “It seems strange to me. … I know a lot of people in these two labs who dedicate their lives to doing good work. They know what happened. I know they know what happened. I know they know how to fix this, and I know they’re fixing it.”

Read more: AI won’t destroy humanity, but experts say the real threats are here

The new security platform aims to establish security protocols that could prevent alarming violations from being revealed by border laboratories.

“NVIDIA Open Agent Safety Platform brings together industry, researchers, and public sector organizations to share best practices, align on assessment methods, and foster international cooperation,” Huang added in the press release. “Together we can raise the bar on global AI security.”

Speaking to Klein, Huang suggested that AI labs simply rebalance their priorities.

“So when I say we need to accelerate AI technology, people think, for some reason, that security is not part of it,” the Nvidia CEO said. “Security is part of it. Alignment is part of it. Assessment is part of it: guardrails, sandboxing, isolation technology, monitoring technology, telemetry technology, external AI monitoring technology – all of that is AI technology. Accelerate daylight from that.”