What happened?
The Mathesis paper introduced an autoformalization-and-proving pipeline trained with reinforcement and preference feedback, together with LeanScorer and the Gaokao-Formal benchmark, and reported that pairing its autoformalizer with existing provers substantially improved end-to-end proving accuracy on natural-language problems.
Mathesis translates an informal problem into a Lean 4 statement, scores candidate formalizations for syntactic and semantic quality, and uses downstream prover feedback to prefer statements that can support machine-checked proofs. Gaokao-Formal provides hundreds of challenging proof problems derived from Chinese college-entrance examinations for evaluating this full pipeline.
Why it matters
The work moved formal-math systems closer to the way mathematical problems are actually presented to humans: in natural language. It also made autoformalization quality part of an end-to-end proving objective rather than an isolated translation task.
Significance rationale: Mathesis addressed a major interface bottleneck in neural theorem proving by coupling learned autoformalization of ordinary mathematical language with downstream Lean proof generation and feedback, rather than assuming an expert-written formal statement as the starting point.
Evidence & status at a glance
- Significance
- H2 · Field milestone
- Verification
- Paper released
- Evidence level
- E3 · Inspectable artifact
- AI role
- Autonomous primary role
- Formal assurance
- Machine-checked
How should these labels be read? →
Contribution & verification
- Mathematical novelty
- Tooling only
- Interface
- Informal, Formal, Hybrid
- AI contribution
- Learned models generate Lean statements and downstream formal proofs, while Lean compilation, semantic scoring and prover feedback constrain and evaluate the automated pipeline.
- Human contribution
- Researchers designed the autoformalization training procedure, LeanScorer, Gaokao-Formal and the end-to-end evaluation protocol, curated problems and analyzed the resulting system performance.
- Verification
- Paper released · E3 · Inspectable artifact · Machine-checked
- Last reviewed
- 2026-09-14
Technical details
- Systems
- mathesis, mathesis-autoformalizer, leanscorer, lean
- Organizations
- huawei
- Problems
- natural-language-to-formal-theorem-proving, gaokao-formal
- Methods
- autoformalization, reinforcement-learning, preference-optimization, prover-feedback, lean
Verification history
- 2025-06-08 · Paper released · E2 · Research record
The arXiv research record introduced Mathesis, LeanScorer and Gaokao-Formal and reported end-to-end formal-proving results.
- 2026-09-11 · Paper released · E3 · Inspectable artifact
The public Mathesis repository exposes implementation and project resources, and the work later appeared at ICLR 2026. Machine-checked refers to Lean acceptance within the evaluated proof pipeline; it does not imply independent replay of every experiment or semantic equivalence judgment.
Corrections
No corrections recorded.