Anthropic and OpenAI need truly independent safety evaluators, experts say in public letter

Over 100 artificial intelligence experts and evaluators are banding together to warn they won't have the necessary resources and protections to test the safety of AI technology, which is facing heightened scrutiny due to concerns from insiders about the potential dangers of frontier models.

"We're just trying to really demonstrate a shared common ground on basic principles and ensure that independent oversight can be a meaningful tool for managing AI risk broadly," said Conrad Stosz, chair of the AI Evaluator Forum consortium that organized the letter, in an interview.

The group published a public letter on the matter on Friday, and shared it exclusively with CNBC. The signatories include AI luminaries like Geoffrey Hinton and members of organizations such as Johns Hopkins University, Stanford University and the nonprofit evaluator METR. They want to compel foundation model providers to ensure that third-party AI evaluators are allowed the necessary "scientific objectivity, transparency, independence, and robust protections" to do their jobs effectively and credibly, the letter said.