OpenAI withdraws three preprints a day after releasing 722 manuscripts on unsolved math problems

Less than 24 hours after OpenAI posted over 700 preprints describing major math results by an internal AI model, the company has withdrawn three of the manuscripts for errors. 

On Oct. 6, OpenAI published 722 preprints in a GitHub repository about purported progress in solving 372 math problems in geometry, computer science, algebra and other subjects. The company called the release an effort “to push the frontier of human knowledge and enable further progress in mathematics.” 

But on Oct. 7, OpenAI announced the withdrawal of three manuscripts because of a sign error. The error invalidated an argument in one manuscript and the construction used by two dependent papers, according to the announcement. Each of the withdrawn papers carry notices explaining “the gap,” and that OpenAI has “revised 14 other manuscripts with proof repairs, corrected statements, clearer hypotheses and dependencies, and one correction to an obsolete citation.” 

That an error cascaded into three of the OpenAI manuscripts is not surprising, said Alex Townsend, an associate professor of mathematics at Cornell University in Ithaca. He suspects there will be more errors found, he said. 

“Given the skepticism of AI in the mathematics community, I think that OpenAI should have announced the manuscripts that were lean verified first,” Townsend told us, referring to Lean, the open-source programming language that checks math proofs. “They could have made a separate announcement for the other ones and ask for help verifying them. This would have been more clear to the community and general public.”