OpenAI puts major frontier AI training run on hold over cyber risks

OpenAI temporarily paused reinforcement learning (RL) training on its latest models intended for deployment for two weeks while it hardened and red-teamed research environments and expanded monitoring.

“Our largest planned frontier RL run remains on hold while we conduct smaller-scale training and evaluations to assess model behavior, validate our safeguards, and establish more evidence of alignment before proceeding,” the company said.

The move followed the OpenAI-Hugging Face incident and preliminary evidence that the company’s upcoming Astra model may meet the Critical cybersecurity capability threshold under its Preparedness Framework.

The changes are aimed at strengthening monitoring, alignment and containment throughout model development.

OpenAI has outlined updates to its research processes and infrastructure, along with work that remains underway.

Building safeguards for more capable models

Developing more capable models relies on three reinforcing safeguards. Monitoring helps detect and respond to concerning behavior, alignment reduces the likelihood of harmful or unauthorized actions, and security measures limit what AI systems can access or affect.

OpenAI expects models to soon perform most security work, including defending against other models. It applies the three safeguards across research and deployment, adapting them to each system’s capabilities, operating environment and level of risk.