OpenAI releases 722 AI-generated mathematics papers as verification questions arise

Summary

OpenAI releases 722 AI-generated mathematics papers as researchers weigh what comes next OpenAI has published hundreds of mathematical manuscripts produced by an unreleased AI model, opening a much bigger debate over how AI-generated research should be checked, understood and incorporated into mathematics OpenAI has released a collection of 722 mathematical manuscripts generated by an internal frontier AI model, covering hundreds of research problems across mathematics and theoretical computer science. The collection is organized into 372 groups of related results and includes proofs, alternative arguments, consequences and supporting material. Many of the results also include formal proofs written in Lean, a programming language that allows mathematical arguments to be checked computationally. OpenAI says the work emerged from testing its internal models on open research problems after performance on its existing mathematics evaluations began to plateau. Around 4,000 problems were presented to the model during the evaluation process. OpenAI says the average result used computing resources equivalent to roughly three hours of ChatGPT Pro thinking. The scale of the release makes it considerably different from a typical AI benchmark. Rather than measuring whether a model can answer a fixed set of questions, OpenAI is publishing work that is intended to enter the mathematical research process itself. But the company is also explicit that publication does not mean every result has already been fully verified. The repository contains work at different stages of checking, and OpenAI says some manuscripts that have not yet been formalized in Lean could contain errors. Corrections and revisions will be recorded while earlier versions remain available. From solving problems to publishing research OpenAI first outlined its approach to releasing AI-generated mathematical results in September, when it said it was working with mathematicians on how such work should be presented responsibly. The company said it wanted to improve transparency around AI-generated mathematics by publishing supporting information alongside the results, including formal proofs where available, reasoning summaries and details about the computational resources used. Ten abridged summaries of the model’s reasoning have also been published for results spanning areas including number theory, compl…