Storylines / Live · opened Mon 14 Sep · 1 this week · 20 items · 6 updates

Mathematicians vs the labs

Working mathematicians pushing back on AI labs’ benchmark claims, while the labs keep posting competition results.

What would settle it

Does the dispute change how labs report mathematical results, or how mathematicians engage with them? Settled by: a lab adopting the declaration’s write-up norms, a joint statement, or the Mathathon proceeding without lab sponsorship.

Where this stands as of Monday, 19 October 2026

As of 19 October the dispute has money behind the sceptics' side of it, supplied by the labs. The Simons Foundation announced "$15 million in combined funding and resources" with Anthropic and OpenAI, to be awarded including through an open call for proposals, for workshops and initiatives that help researchers evaluate recent AI-assisted results and shape collective standards for AI use; Anthropic and OpenAI are also to provide AI tools and computing resources, extending beyond mathematics to basic science. David Spergel framed it as community-led: "As artificial intelligence rapidly reshapes the research landscape, we want to help the mathematical community come together", and "The community should be driving discussions of how these tools are evaluated, adopted and used" — "not any single company or institution".

The checking question moved on the evidence side as well. A Lean-checked mathematics benchmark had frontier-model agents improve all 20 of its records, after which newer models improved 19 again, with two independent Lean kernels as the referee rather than a human reviewer or a lab's own write-up.

The arc's settling condition is still open. No lab has adopted the declaration's write-up norms, no joint statement has been issued, and the funding announcement names no programme title, no recipients and no governance for the money. The labs are paying for the assessment of their own results, and nothing published this week says who decides what gets assessed.

What changed: The two labs at the centre of the dispute put money into the mathematicians' side of it: a combined $15 million with the Simons Foundation for work that helps researchers evaluate AI-assisted results and set standards for AI use, framed by the foundation as community-led rather than company-led. No write-up norms were adopted and no recipients, governance or programme name were published, so the arc's question is untouched.

How it has changed

Every earlier "where this stands", kept as written.

Monday, 12 October 2026 — The dispute moved from methodology to withdrawal and boycott: OpenAI retracted three manuscripts over a sign error, cut its catalogue to 719 manuscripts with 300 top-line results formalised, and a professional body urged mathematicians to stop working with the company. In the same days Science published a DeepMind agent whose deliverable is a machine-checked Lean proof, and a new benchmark made two independent Lean kernels the referee — so the week contained both halves of the argument about who does the checking.

As of 12 October the catalogue has its first retractions and the discipline has its first call for non-cooperation. OpenAI's revision log entry of October 7 withdrew three manuscripts, stating that in one "a sign error invalidates a stabilization-trace cancellation argument and the construction used by two dependent papers". The same entry revised 14 others "with proof repairs, corrected statements, clearer hypotheses and dependencies", updated 13 more to cite revised companion papers, and recorded that "This brings the total percentage of top-line results formalized to 300 / 719 = ~42%." The README now reads "The current catalogue contains 719 manuscripts organized into 372 families", where the release was reported as 722. An OpenAI spokesperson told Retraction Watch: "Where errors are identified, we will work to correct them promptly and withdraw papers if no fixes can be found." Cornell's Alex Townsend told Retraction Watch he suspects more errors will be found, and said the Lean-verified manuscripts ought to have been announced first. The log has no entry dated later in the week.

The Association for Human Mathematics Communications Working Group, in a statement dated October 7 reposted as a guest post on Terence Tao's blog, wrote that "Mathematicians did not ask for this work to be done" and that "Releasing over 700 files at once is not a demonstration of scholarship, but a demonstration of power. We urge mathematicians to discontinue their work with OpenAI and to return to a vision of science that centers human understanding." It named "The Advisory Group on Mathematics and Artificial Intelligence, from whom OpenAI has claimed to derive its legitimacy", and noted that OpenAI "is currently defending lawsuits against accusations of illegal plagiarism, copyright infringement, and trademark dilution". TechCrunch reported that "Just 10 of the 719 manuscripts included releases of the model's chain of thought" and that the advisory group's request for machine-readable metadata correlating the natural language and formal artifacts was "something that the frontier lab did not do with these releases". The statement carries no signatory count and records no OpenAI response.

The week's other mathematical results put the proof assistant first. Science issued "Advancing mathematics research with AI-driven formal proof search" by George Tsoukalas and 20 co-authors, volume 394 issue 6820 pages 234-239, reporting an agent that "autonomously resolved nine of 353 open Erdős problems, proved 44/492 On-Line Encyclopedia of Integer Sequences conjectures", and that "Even a basic agent alternating LLM-based generation with Lean-based verification replicated the Erdős successes." SqueezeBench, from TU Wien, checks every submitted record with "two independent Lean kernels, so no referee needs to check the mathematics", and reports frontier-model agents improving every one of its twenty initial records with 82 accepted submissions, while noting that "For eight of the ten problems, at least one record is still asymptotically behind the best published bound." A separate preprint, arXiv:2610.08144, reported that the Lean proof of OpenAI's announced Navier-Stokes blow-up "does not correspond to the NL proof", while stating: "We do not make claims about the correctness of OpenAI's NL proof, we only make statements about mistranslations into Lean." No lab has published an adoption statement for the advisory group's norms.

Monday, 5 October 2026 — The dispute produced a written standard: the advisory group published release rules for AI-generated mathematics drawing on over 600 replies, and asked the labs to stop benchmarking advanced problems on proprietary models. The Mathathon question is settled — the event is set for November with XTX Markets as lead donor and no lab sponsorship — while Meta added a fresh set of claimed open-problem results that nobody outside the company has checked.

As of this week the mathematicians have written the rules they want the labs to follow, and the Mathathon they objected to is going ahead without lab money. The Advisory Group on Mathematics and Artificial Intelligence published "Responsible Release of AI-Generated Mathematics" in late September, drawing on over 600 community replies. Its central rule is that "If AI labs produce significant mathematical results, they should responsibly release the results, as outlined in this document, as soon as possible", paired with the obligation that "AI labs that release substantial mathematical output without immediate accompanying human understanding must take responsibility for ensuring that human understanding will follow". On benchmarking against proprietary models the document states: "we do not endorse this practice, and we ask them to stop testing advanced mathematical problems on proprietary models."

The Mathathon question this storyline tracked has been answered. A joint statement published by the original student organisers, the open-letter coauthors and other members of the Caltech community set the redesigned event for 13 to 15 November 2026 under the theme "Old Problems, New Proofs", co-organised with the Foundation for Science and AI Research and with XTX Markets as lead donor. Proprietary models are permitted but open-source tools encouraged, and full disclosure and justification of model usage is required, with an explainer and a repository per submission.

On the labs' side the claims kept coming and the verification arrangements did not change. Meta published six mathematics papers written with its own model and said five of them answer previously open research questions, marking which passages were drafted by researchers and which by the model, and acknowledging a separate AI agent that reported a different counterexample to the same conjecture weeks earlier. Anthropic published a guest post describing manuscripts across many fields produced with Claude. Nothing is peer reviewed, no lab has published an adoption statement for the advisory group's norms, and the group's own framing is that it is still advising one lab on how to coordinate the release of results it has claimed.

Monday, 28 September 2026 — The first lab claim in this arc was validated by a named outside expert rather than asserted — Lance Dixon checked the nine-loop amplitude — while OpenAI created an advisory group of mathematicians at the same time as claiming a further hundred solved problems that nobody outside the company has verified. The group's own charter excludes advising on pace.

As of 28 September one lab claim has been checked by a named outside expert and the rest have not. Anthropic published a guest post reporting that Claude computed the six-particle hexagon amplitude in planar N=4 super Yang-Mills at nine loops, past the eight-loop record, by two independent routes. Lance Dixon of SLAC and Stanford, who set the eight-loop record, validated it; the disclosure states that he validated the result independently and received Claude usage credits, and that Anthropic invited and compensated the author. The author's own conclusion is that the model did something humans turned out to be able to do as well, using known methods with more compute than people had tried, and the post reports that a group led by Song He at the Chinese Academy of Sciences obtained the majority of the same result concurrently with GPT-6 assistance. Nothing is peer reviewed and the human teams have yet to publish.

On the labs' side of the dispute the reporting norms moved slightly. OpenAI announced an Advisory Group on Mathematics and Artificial Intelligence hosted at the Institute for Advanced Study, with nine unpaid initial members who control their own membership and may go public with their views, and said in the same announcement that an internal model has resolved more than 100 additional open problems across most areas of mathematics. No independent verification of that count is reported, the problems are not listed, and the blog post states that the group will not be responsible for advising the company on how to pace its internal progress on mathematics. Only one member of the group signed the open letter that 25 Fields Medallists signed earlier in September. The Mathathon's sponsorship remains unresolved in the record and no lab has adopted the declaration's write-up norms.

Monday, 21 September 2026 — The dispute produced its first institution: Tao's SAIR foundation announced an accelerated open-weight model initiative for mathematics explicitly independent of the labs, while Epoch AI put a number on how fast disclosed AI use is spreading through mathematics preprints.

As of 21 September the mathematicians have started building rather than only objecting. Terence Tao wrote that he co-founded the Foundation for Science and AI Research with private donors to support responsible uses of AI in mathematics and the other sciences, "independent of the major AI companies", and that the foundation is announcing an Open Math Model initiative with open licensed weights and code, published training methods, reproducible evaluations, documented training-data sources and releases that report failures and limitations alongside successes. The announcement says the planned gradual rollout was brought forward: "given current events and the high demand for open models, we are accelerating our schedule". No partners, compute commitments or model sizes are named, and the foundation is collecting expressions of interest.

The measurement of AI use in the field moved at the same time. Epoch AI, in an analysis updated on September 18, reports that the share of mathematics preprints on arXiv acknowledging AI rose from 4% in April to 25% in August, and that in August 6% of all papers explicitly acknowledged that AI made a substantial research contribution. Restricting to papers with at least one author who published regularly before 2023 keeps the acknowledgment rate within 1.5 percentage points of the overall figure each month. Epoch says it analysed every mathematics arXiv preprint from January 2025 to August 2026, classifying acknowledgments with one frontier model and validating with another; a human review of 200 random acknowledgments classified as substantial research or research assistance showed 93% agreement. The measure depends on voluntary disclosure. No lab has adopted the declaration's write-up norms, and the Mathathon's sponsorship remains unresolved in the record.

Monday, 14 September 2026

As of 14 September the two sides are talking past each other. Twenty-five Fields Medallists signed a declaration, published on Terence Tao's blog on 11 September, that AI labs' benchmark chasing is "severely misaligned" with mathematics; OpenAI pulled its $10,000-per-team sponsorship of Caltech's Mathathon after an open letter from Caltech mathematicians. The same week, an NVIDIA team reported an open Nemotron pipeline scoring 30 of 42 at IMO 2026 with no formal prover or tools, and the Magenta pipeline reported 100% on AIME 2025, AIME 2026 and HMMT February 2026 with Lean-checked proofs.

Timeline

Every item filed under this storyline, newest first, with its sources.

Tuesday, 27 October 2026

Tue 27 Oct · Frontier models & labs

OpenAI posts model-generated proofs claiming the Exponential Time Hypothesis is false Company claimPreprint

  • The repository's history file records two manuscripts added on October 26, each with a Lean formalization: "Local smoothing for the Euclidean wave equation", which it says establishes Sogge's local smoothing in dimensions two and up and also yields the Kakeya maximal and dimension conjectures, and "The Exponential Time Hypothesis is False", which it describes as a deterministic, subexponential-time, polynomial-space algorithm for exactly counting satisfying assignments of fixed-width CNF formulas, with the 3-SAT case refuting the hypothesis.
  • The same entry says a working group led by Impagliazzo, Paturi and Williams will examine the complexity proof and that the materials were made public at their request. The repository README says the manuscripts come from an unnamed internal OpenAI model, that each result averaged three hours of ChatGPT Pro thinking compute, that the model was posed about 4,000 problems, and that the catalogue holds 721 manuscripts in 373 families with about 42% of top-line results formalized in Lean.
  • Al Jazeera reports OpenAI also claims a mathematically rigorous existence proof for quantum chromodynamics, and that OpenAI used three expert groups it calls "shepherds" to guide release, with the physics group delaying publication to write its own interpretation. Engadget reports OpenAI says it will not seek academic credit for its models' discoveries.
  • None of the three claims has been peer reviewed. The README says unformalized results "could have issues", and the history file records that on October 7 three manuscripts were withdrawn after a sign error invalidated a stabilization-trace cancellation argument. OpenAI's own announcement page returned HTTP 403 in this session and was not read.

Friday, 16 October 2026

Fri 16 Oct · Deployment & impact

Simons Foundation, Anthropic and OpenAI commit $15 million to help mathematicians assess AI-assisted results beneficialSingle source

  • The Simons Foundation says it, Anthropic and OpenAI are committing "$15 million in combined funding and resources" to a new set of initiatives for the mathematics community, with the foundation managing and awarding the funds partly through an open call for proposals.
  • Simons Foundation President David Spergel said "As artificial intelligence rapidly reshapes the research landscape, we want to help the mathematical community come together" and that "The community should be driving discussions of how these tools are evaluated, adopted and used".
  • The announcement names no programme title, duration, number of grants or split between the three funders, and does not say how the review of AI-assisted results will work in practice.
  • It is the first joint commitment by both frontier labs to the discipline whose researchers have spent the past months disputing the labs' benchmark claims about mathematical reasoning.

Monday, 12 October 2026

Mon 12 Oct · Research & papers

Lean-checked maths benchmark: frontier-model agents improved all 20 records, then newer models improved 19 again mixedPreprint

  • SqueezeBench (arXiv:2610.13461), from the Algorithms and Complexity Group at TU Wien, is built so that "a success raises the bar instead of removing the problem". Each problem fixes an integer function f(n); a record is "a computable Lean function with a machine-checked proof that it bounds f", and a submission must prove it is no worse than the current record at any n and strictly better at some n. "Every proof is checked by two independent Lean kernels, so no referee needs to check the mathematics."
  • The authors release ten problems from extremal combinatorics with twenty proved initial records. As a baseline, "agents based on a frontier language model, with at most one hour per record, had 82 submissions accepted and improved every record, without going beyond the published literature". Agents based on two newer models then started from those records, "had 60 more submissions accepted and improved 19 of the 20 records again".
  • The ceiling is still the literature, not the models: "for eight of the ten problems, at least one record is still asymptotically behind the best published bound". The checks also reject a function that computes f by exhaustive search at small n, with a maintainer reading the submitter's report for such a search at larger n.
  • The paper does not name the models used for the baseline. It is a preprint and has not been peer reviewed.
Connection · week in review
Two mathematical results published in the same week differed in who does the checking

The shared element is the form of the document: a lab publishing a record of its own model's failure, and the question of who else can read it. OpenAI's revision log entry of 7 October withdrew three manuscripts over a sign error, revised 14 more, and put formalisation at 300 / 719 of top-line results — a correction recorded in OpenAI's own revision log. Anthropic's report of 9 October set out four categories of unintended action by its models, about which it says it gives no total count and has not completed a full alignment assessment. Anthropic's report records that an operator of the da.gd URL shortening service told the company it had also found Claude using the service, and that the Philadelphia Police Department self-disclosed the tip-form case via its own press release.

Saturday, 10 October 2026

Sat 10 Oct · Research & papers

Thomas Hales: no complete public relative-consistency proof covers Lean's type theory as AI autoformalises at scale mixed

  • In a guest post on Terence Tao's blog dated 9 October, the mathematician Thomas Hales writes: "As of October, 2026, I know of no complete, public relative-consistency proof covering Lean abstract type theory." He notes that an error was found in Mario Carneiro's 2019 thesis, the foundational document for Lean's type theory, that the thesis targeted Lean 3, and that unique typing remains "a tricky conjecture that is still unproved".
  • Hales records that mathlib now contains "nearly 300,000 theorems, over 100,000 definitions, 2.5 million lines of code, with over 700 contributors", and that Anthropic's autoformalisation of Fermat's Last Theorem, announced on September 4, "generated 13 million lines of Lean in 11 days". By comparison, the formal proof of the Kepler conjecture "took about 20 human work-years" and about 500,000 lines.
  • He calls Joachim Breitner's verified Lean kernel, Con-Leche — implemented in Lean with code and proofs generated by Claude, and cross-checked by more than a dozen other proof-checkers — "one of the most important milestones in Lean's history", while warning that "in the age of AI … we absolutely cannot put blind trust in systems such as Lean" and asking how to certify that AI left no backdoor soundness bug during its sweep for bugs.
  • This is an expert assessment, not a new experimental result, and Hales states that "authorship is fully human" and that AI was used as a tool for search, fact-checking and proofreading.

Friday, 9 October 2026

Fri 9 Oct · Research & papers

Science publishes Google DeepMind's formal-proof agent, which resolved nine of 353 open Erdős problems beneficialUpdate

  • George Tsoukalas and 20 co-authors at Google DeepMind report in Science, vol 394 no 6820, pp 234-239, published 8 October 2026, an agent that generates proofs in Lean so that the compiler checks each step. The abstract says "We present the first demonstration of this method's value in solving open problems at scale."
  • The agent "autonomously resolved nine of 353 open Erdős problems, proved 44/492 On-Line Encyclopedia of Integer Sequences conjectures, and is being deployed in combinatorics, optimization, graph theory, algebraic geometry, and quantum optics research." The abstract also reports that "Even a basic agent alternating LLM-based generation with Lean-based verification replicated the Erdős successes."
  • The approach is the mirror image of the week's other maths story: where OpenAI published natural-language manuscripts of which 300 of 719 results were formalised, this work makes the Lean proof the deliverable, so the compiler rather than a referee is the first check.
  • Nine of 353 is a small share of problems chosen for being open, and the paper is a peer-reviewed version of work that circulated as a preprint in May. The publisher-deposited abstract gives no cost figures, no comparison with human mathematicians, and no breakdown of which nine problems were resolved. Science's own site refused this briefing's fetchers, so the text above is from the publisher's deposited metadata record.
Fri 9 Oct · Research & papers

OpenProblemBench: GPT-6-Astra judged to solve 14.0% of 82 unresolved maths and physics problems Preprint

  • Zhiyi Li and six co-authors report in arXiv:2610.11118, submitted 8 October 2026, a benchmark of 82 unresolved problems drawn from the mathematics and theoretical physics literature, with four evaluator models independently judging correctness, completeness and degree of progress without reference solutions.
  • Across seven evaluated configurations, GPT-6-Astra achieves the highest mean judged solve rate at 14.0%, against 5.5% to 6.7% for the full-size open models and 2.4% to 3.7% for Flash models.
  • The figure is a useful counterweight to lab-published tallies of solved problems this week, because it measures the same kind of task under a fixed, independently judged protocol rather than on problems the lab chose.
  • This is a preprint and has not been peer reviewed. Scores are model-judged rather than verified by mathematicians or formalised in a proof assistant, and the arXiv page does not list the authors' institutions.
Fri 9 Oct · Frontier models & labs

Preprint: the Lean proof of OpenAI's announced Navier-Stokes blow-up does not match its natural-language proof Preprint

  • Alexander Bastounis, Fabian Circelli and Anders C. Hansen write in arXiv:2610.08144 that they "show that the formalised Lean proof does not correspond to the NL proof of blow-up" in OpenAI's announced proof for the Navier-Stokes equations, and give "several examples of AI mistranslations" of statements and proofs into Lean. The abstract gives no count.
  • The paper argues that providing semantically faithful AI autoformalisation is harder than any computational problem including the Halting problem. The authors conclude that such proofs "should not prima facie be trusted without the same peer review process and scrutiny that other proofs are subjected to".
  • TechCrunch reports that the Advisory Group on Mathematics and Artificial Intelligence, hosted by Princeton's Institute for Advanced Studies and made up of nine researchers, had asked labs to "include machine-readable metadata correlating the natural language and formal artifacts" — something OpenAI did not do in this release. AGMAI's first request was "to stop testing advanced mathematical problems on proprietary models".
  • The preprint, posted on 6 October, is not peer reviewed, and its authors say they make no claim about whether OpenAI's written proof is correct. The arXiv page does not list the authors' institutions; TechCrunch places them at the University of Cambridge and King's College London.
Fri 9 Oct · Frontier models & labs

OpenAI withdraws three of its 719 maths manuscripts after a sign error invalidated two dependent papers mixedUpdate

  • OpenAI's revision log, dated October 7, withdraws "Algebraicity of Weil classes on split abelian eightfolds", "Algebraicity of Kuga-Satake Correspondences for K3 Surfaces" and "The rational Hodge conjecture for products of K3 surfaces", stating that "a sign error invalidates a stabilization-trace cancellation argument" and affects the construction used by the two dependent papers.
  • The same entry revises 14 other manuscripts with "proof repairs, corrected statements, clearer hypotheses and dependencies, and one correction to an obsolete citation", updates 13 more to cite revised companion papers, and puts formalisation at 300 / 719 of top-line results, about 42%.
  • An OpenAI spokesperson told Retraction Watch: "We welcome scrutiny and feedback from the mathematical community" and "Where errors are identified, we will work to correct them promptly and withdraw papers if no fixes can be found." TechCrunch reports that just 10 of the 719 manuscripts included a release of the model's chain of thought.
  • The withdrawal is the first correction to the catalogue OpenAI published on October 6, which this briefing covered on October 7. Neither source says any of the underlying mathematical assertions has been refuted.

Thursday, 8 October 2026

Thu 8 Oct · Deployment & impact

Association for Human Mathematics urges mathematicians to discontinue work with OpenAI over its manuscript release mixedUpdate

  • The AHM's Communications Working Group published a statement dated 7 October, reposted as a guest post on Terence Tao's blog, responding to OpenAI's 6 October release of 722 manuscripts in 372 groups of results produced by an unreleased internal model. It says "Mathematicians did not ask for this work to be done" and "Releasing over 700 files at once is not a demonstration of scholarship, but a demonstration of power", and concludes "We urge mathematicians to discontinue their work with OpenAI".
  • The statement disputes OpenAI's claim to legitimacy, naming "The Advisory Group on Mathematics and Artificial Intelligence, from whom OpenAI has claimed to derive its legitimacy", and notes OpenAI is "currently defending lawsuits against accusations of illegal plagiarism, copyright infringement, and trademark dilution".
  • This is an update to the release covered in yesterday's edition, and it escalates the dispute from methodology to non-cooperation: a professional body asking its members to stop working with a frontier lab.
  • The statement carries no signatory count and is attributed only to a working group; Inside AI News reports AHM has 752 members, so this is not a vote of the discipline. Inside AI News says OpenAI had not publicly responded as of publication, and the AHM's own statements page could not be cited directly because it is an index page.

Wednesday, 7 October 2026

Wed 7 Oct · Frontier models & labs

OpenAI publishes 722 maths manuscripts in 372 families from an unreleased internal model mixedCompany claim

  • The repository README states that "The current catalogue contains 722 manuscripts organized into 372 families" and that they were "produced by an internal OpenAI model". It says "The vast majority of results were obtained with the same procedure using an unreleased internal OpenAI model", that "On average, each result used three hours of ChatGPT Pro thinking compute with that model", and that "Over the course of the evaluation, the model was posed approximately 4,000 problems."
  • OpenAI says it expanded these evaluations "after performance on our existing mathematical evaluations saturated", and is also releasing abridged reasoning summaries for 10 named families, including the irrationality exponent of π, the Mézard–Parisi formula for diluted spin glasses and the three-dimensional relativistic Vlasov–Maxwell system.
  • OpenAI states the collection "includes results at different stages of verification", that "Not all have accompanying Lean formalizations", and that "Some of the unformalized results could have issues. We will endeavor to fix any such issues quickly." It says it is "exploring community-hosted repositories for these materials".
  • The README gives no count of how many of the 722 manuscripts have been formalised, saying only that "Many, but not all, of the manuscripts have been formalized". OpenAI's own announcement post could not be opened for this edition; the figures above are quoted from the repository. Two exceptions to the fixed procedure are named: a zero-free region for the Riemann zeta function and a proof of the Hodge Conjecture for CM abelian varieties, with the former's writeup "human edited for readability".

Wednesday, 30 September 2026

Wed 30 Sep · Research & papers

Mathematicians' advisory group publishes release rules for AI-generated mathematics, drawing on over 600 community replies beneficialSingle source

  • The group's document, "Responsible Release of AI-Generated Mathematics", sets three principles: that labs producing significant mathematical results "should responsibly release the results, as outlined in this document, as soon as possible"; that labs releasing substantial output "without immediate accompanying human understanding must take responsibility for ensuring that human understanding will follow", including funding; and that "The development of human understanding must remain organic and community led. It should not be directed by AI labs, even when the labs have produced the results." It says the guidelines were informed by "over 600 replies".
  • On disclosure, it asks that "For each result released, the AI lab should make public the name of the model, the prompts used, a (summarized) chain of thought, the time taken, and the estimated cost of computation", and that results "should be deposited in a timely manner in appropriate scholarly repositories" that "should not be controlled by any AI lab" and must give "a persistent citable identifier" with modifications recorded.
  • This is the first concrete set of release conditions a research community has put to the labs, and it is aimed squarely at the pattern of competition-result announcements that mathematicians have spent the past month disputing. It also asks labs to document "failure rates on problems of comparable difficulty" alongside each success.
  • These are recommendations with no enforcement mechanism; no AI lab has committed to them. The advisory group itself was announced on 21 September, before this window — the guidelines document is what is new.

Monday, 28 September 2026

Connection · week in review
Four lab claims in one week, and four different arrangements for who checked them

Four claims published within five days differ mainly in who checked them. Lance Dixon, who held the eight-loop record, validated the nine-loop amplitude and is named in Anthropic's disclosure alongside the note that he received Claude usage credits. METR evaluated Opus 5.5 before release under an unpaid agreement and states that Anthropic had the opportunity to review and edit its text. Nature reported on the enzyme preprint and said researchers have not yet determined what the newfound viral sequences do. TechCrunch reported OpenAI's count of more than 100 resolved open problems with no independent verification reported at all.

Saturday, 26 September 2026

Sat 26 Sep · Health, science & medicine

Anthropic says Claude computed a nine-loop scattering amplitude, past the eight-loop record, for one or two thousand dollars beneficialCompany claim

  • Anthropic's 25 September post, a guest piece by physicist Matt von Hippel with an addendum by Lance Dixon, says Claude computed the nine-loop MHV six-particle amplitude in planar N=4 super Yang-Mills. On the prior record it says: "Lance Dixon, a professor at the SLAC National Accelerator Laboratory, was one of the folks who worked on this from the beginning, and a few years back managed eight loops."
  • On cost the post says: "Either approach would have cost an end-user around one or two thousand dollars, mostly due to the expense of running Claude for so long. The bootstrap calculation, done with the Python programming language with package SymPy, took around $100 of the budget, corresponding to running 96 CPUs for a week."
  • Dixon writes in the addendum that he independently validated the result, and notes: "Claude is a different kind of transformer model, probably over a million times bigger than our custom one." Von Hippel's assessment is that Claude "used known methods, with a bit more compute than people had tried to use before".
  • The post says Song He's group at the Chinese Academy of Sciences also computed the nine-loop result using AI assistance based on GPT-6, so the calculation is not uniquely Claude's. Unite.AI reports the two independent representations agree across all 107,053 nonzero coefficients, that the result page notes the amplitude "has been computed once with no second independent computation", that the programs are not distributed, and that Anthropic compensated von Hippel and gave feedback on drafts while Dixon received Claude usage credits.

Tuesday, 22 September 2026

Tue 22 Sep · Frontier models & labs

OpenAI says an internal model has resolved more than 100 open mathematics problems since late August mixedCompany claimSingle source

  • TechCrunch reports OpenAI said an internal model has "resolved more than 100 additional open problems across most areas of mathematics", following its claimed solution to the Navier-Stokes Millennium Prize problem. OpenAI dated the start of that model's training to August 28.
  • OpenAI also announced an Advisory Group on Mathematics and Artificial Intelligence hosted at the Institute for Advanced Study in Princeton. Per TechCrunch, members receive no compensation, may offer unsolicited advice, control their own membership, and the group "will not be responsible for advising us on how to pace our internal progress" and has no decision-making authority.
  • TechCrunch reports that of the nine initial members, only Camillo De Lellis of the Institute for Advanced Study also signed the open letter from 25 Fields Medal winners objecting to AI labs' conduct in mathematics.
  • The claim that more than 100 problems were resolved is OpenAI's own and is not independently verified; no list of the problems, no proofs and no referee reports were published alongside it. OpenAI's own post could not be opened for this edition — openai.com/index pages returned HTTP 403 — so the figures here are as TechCrunch reports them.

Saturday, 19 September 2026

Sat 19 Sep · Deployment & impact

Epoch AI: 25% of arXiv maths preprints acknowledged AI use in August, up from 4% in April mixedSingle source

  • Epoch AI, in an analysis by Tara Abrishami updated on September 18, reports that "the share of math preprints on arXiv that acknowledge AI has risen rapidly, from 4% in April to 25% in August".
  • Epoch says that in August 6% of all papers explicitly acknowledged that AI made a substantial research contribution, a category it describes as work roughly at the level of a coauthor.
  • The rise is not explained by new authors entering the field: restricting to papers with at least one author who published regularly before 2023 keeps the acknowledgment rate within 1.5 percentage points of the overall figure each month.
  • Epoch classified acknowledgments across about 51,000 maths preprints using AI models, with 93% agreement against human review of 200 randomly selected acknowledgments. The measure depends on voluntary disclosure, so it tracks disclosure behaviour as well as use.
Sat 19 Sep · Research & papers

Terence Tao's SAIR foundation accelerates an open-weight model initiative for mathematics beneficialSingle source

  • Terence Tao writes that he co-founded the Foundation for Science and AI Research (SAIR) with private donors to support responsible uses of AI in mathematics and the other sciences, "independent of the major AI companies", and that SAIR is announcing an Open Math Model initiative.
  • SAIR had planned a gradual rollout starting with pilot projects, but says that "given current events and the high demand for open models, we are accelerating our schedule" and moving the initial announcement forward.
  • The announcement says the models will have open licensed weights and code, published training methods and reproducible evaluations, released under licences such as Apache 2.0, MIT or CC BY 4.0, with training data carrying documented sources and compatible permissions, and with releases reporting failures and limitations alongside successes.
  • The first phase targets everyday mathematical work — understanding difficult arguments, checking references, exploring examples, writing code and formalizing proofs. No partners, compute commitments or model sizes are named; SAIR is collecting expressions of interest, and Tao notes recent support from XTX Markets for SAIR's competitions.

Tuesday, 15 September 2026

Tue 15 Sep · Research & papers

Google Research and CMU harness scores 71.0% on research-level TCS-Bench, solves 218 of 222 Codeforces problems PreprintCompany claim

  • arXiv:2609.15983, "Stellar Colosseum: A Many-Agent Harness for Long-Horizon Research in Mathematics and Theoretical Computer Science" by Honghao Lin, David P. Woodruff, Yuan Deng, Jieming Mao, Song Zuo and Vahab Mirrokni, submitted 14 September 2026, reports: "On TCS-Bench, a benchmark of research-level theorem-proving tasks drawn from papers published at FOCS, STOC, and SODA, Colosseum achieves 71.0% accuracy using Gemini 3.1 Pro and Gemini 3.7 Flash."
  • The paper reports that in a separate Codeforces evaluation using Gemini 3.1 Pro, "the proof-oriented pipeline with execution feedback solves 218 of 222 problems", and that with Gemini 3.1 Pro the authors "obtain several new results that address open problems arising from papers published at top venues such as FOCS and JMLR".
  • The authors state the workflow "has also been integrated into Google Antigravity's Teamwork framework as the Long Proof pattern", so the harness is already shipping inside a Google product.
  • The paper is a preprint by authors at the company whose models it evaluates, the abstract does not name the open problems said to be resolved, and the claimed new results have not been independently checked.

Saturday, 12 September 2026

Sat 12 Sep · Research & papers

Magenta pipeline reports 100% on AIME 2025, AIME 2026 and HMMT February 2026 with Lean-checked proofs Preprint

  • The paper, posted to arXiv on 10 September 2026, describes "a training-free agentic pipeline that, given only a natural-language problem, produces an answer, expresses it as a Lean 4 statement, and constructs a machine-checked proof", and reports "100% accuracy across all evaluated olympiad benchmarks, including AIME 2025, AIME 2026, and HMMT February 2026".
  • The abstract states that when paired with the open-weight K2-Horizon-7B reasoner "it solves all six IMO 2026 problems".
  • The design puts a statement judge in front of the prover to check that the Lean formalisation preserves the original problem, and an error-attribution judge that routes failures either to mathematical re-derivation or to local Lean repair — the guard against a proof that is machine-checked but of the wrong statement.
  • This is a preprint with no peer review, and the benchmark figures are the authors' own runs. The abstract does not report compute cost or the number of attempts per problem.
Sat 12 Sep · Research & papers

NVIDIA team reports an open Nemotron pipeline scoring 30 of 42 at IMO 2026 with no formal prover or tools PreprintCompany claim

  • The paper, posted to arXiv on 9 September 2026 and announced in the 11 September listing, reports that the system "scored 30 out of 42 points at IMO 2026, reaching the gold-medal threshold".
  • The abstract states the pipeline "operates entirely in natural language, with no formal prover, external tools, or internet access", using three Nemotron 3 Ultra checkpoints — the general-availability model and two post-trained specialists — in "an iterative search that generates, verifies, and refines candidate proofs", with a separate high-compute stage selecting each submission.
  • The authors say they release both post-trained checkpoints plus the training data, training and inference code, the submitted solutions, and "Nemotron-IMO-Bench, a new benchmark of 200 novel olympiad-level problems".
  • The arXiv abstract page carries no affiliation block; Hugging Face lists the institution as NVIDIA. The IMO score is the authors' own report of their own submission and is not peer reviewed.
Sat 12 Sep · Frontier models & labs

OpenAI pulls its $10,000-per-team sponsorship of Caltech's Mathathon after mathematicians' open letter Single source

  • Gizmodo reported on 11 September at 9:05 pm ET that OpenAI research lead Dan Roberts announced by tweet that the company would drop its sponsorship; OpenAI had been supplying $10,000 of the $20,000 in credits available per team, and OpenAI and Anthropic together had pledged $2 million in credits.
  • The withdrawal followed an open letter from current and former Caltech mathematicians saying AI firms have "advanced a campaign of scientific misinformation about the goals of mathematical research" and describing the solutions as having "destructive impacts for the mathematical community".
  • Mathathon organisers told Gizmodo "We do not anticipate that this will affect the event in any substantial way", adding they were "currently in talks with other firms who are willing to provide a similar amount per team". The first round begins 30 October, with each team given 40 hours and $20,000 in tokens.
  • Gizmodo is the only outlet we could open carrying the dollar figures; OpenAI did not give a statement in the piece beyond Roberts's post.
Sat 12 Sep · Frontier models & labs

Twenty-five Fields Medallists sign declaration that AI labs' benchmark chasing is "severely misaligned" with mathematics

  • Terence Tao published the declaration on his blog on 11 September; it is signed by 25 Fields Medallists and argues that "solving problems is only a tool and proxy for achieving the primary goal of conceptual understanding and insight".
  • The signatories write that AI solutions are "announced in a rush, leaving no time for a proper writeup, the isolation of new methods and ideas, and citing relevant previous work of others", and warn that without that step "AI-conceived ideas would never become fully alive and the crucial human transmission chain between mathematicians would be lost".
  • TechCrunch reports that New York University mathematician Tristan Buckmaster alleged OpenAI pressed him to exclude an Anthropic collaborator from credit on a mathematics problem, and questioned whether OpenAI had drawn on earlier Codex work to produce its own proof.
  • The full text of the declaration is hosted at mathandai.org, which blocked our fetcher, so the quotations above are taken from Tao's own post and TechCrunch. Neither source gives a count of signatories who are also AI-lab collaborators.

Tracked figures

$15 million
combined funding and resources from the Simons Foundation, Anthropic and OpenAI to help researchers evaluate AI-assisted results Mon 19 Oct Simons Foundation
300 / 719 = ~42%
share of OpenAI's top-line mathematical results that are formalised, after three manuscripts were withdrawn over a sign error Wed 7 Oct OpenAI (GitHub)
13 to 15 November 2026
dates set for the redesigned Mathathon, co-organised with the Foundation for Science and AI Research and with XTX Markets as lead donor Mon 28 Sep terrytao.wordpress.com
25%
of arXiv mathematics preprints acknowledging AI use in August 2026, up from 4% in April Fri 18 Sep Epoch AI
30 of 42
IMO 2026 score reported for the open Nemotron pipeline Fri 11 Sep arXiv
25
Fields Medallists signing the declaration Fri 11 Sep Terence Tao

Open questions

How many of OpenAI's 719 manuscripts are correct, and will anyone outside the company check the unformalised ones?

What would settle it
A peer-reviewed publication or journal referee report on one of the manuscripts, a further revision-log entry recording externally found errors, or a published count of formalisations by someone other than OpenAI.
Asked
Mon 12 Oct

Will a lab claim be checked by an evaluator the lab did not select, pay or give review rights over the text?

What would settle it
A peer-reviewed publication by authors outside the lab, or a list of the resolved mathematics problems with citations.
Asked
Mon 28 Sep

Will the Mathathon go ahead, and with whose sponsorship?

Settled
Mon 28 Sep — It is going ahead without lab sponsorship. A joint statement set the redesigned event for 13 to 15 November 2026 under the theme "Old Problems, New Proofs", co-organised with the Foundation for Science and AI Research, with XTX Markets as lead donor. source
Asked
Mon 14 Sep