Mathesis connects natural-language mathematics to end-to-end Lean theorem proving

Mathesis translates an informal problem into a Lean 4 statement, scores candidate formalizations for syntactic and semantic quality, and uses downstream prover feedback to prefer statements that can support machine-checked proofs.

What happened?

The Mathesis paper introduced an autoformalization-and-proving pipeline trained with reinforcement and preference feedback, together with LeanScorer and the Gaokao-Formal benchmark, and reported that pairing its autoformalizer with existing provers substantially improved end-to-end proving accuracy on natural-language problems.

Mathesis translates an informal problem into a Lean 4 statement, scores candidate formalizations for syntactic and semantic quality, and uses downstream prover feedback to prefer statements that can support machine-checked proofs. Gaokao-Formal provides hundreds of challenging proof problems derived from Chinese college-entrance examinations for evaluating this full pipeline.

Why it matters

The work moved formal-math systems closer to the way mathematical problems are actually presented to humans: in natural language. It also made autoformalization quality part of an end-to-end proving objective rather than an isolated translation task.

Significance rationale: Mathesis addressed a major interface bottleneck in neural theorem proving by coupling learned autoformalization of ordinary mathematical language with downstream Lean proof generation and feedback, rather than assuming an expert-written formal statement as the starting point.

Historical context

Primary evidence

Evidence & status at a glance

Significance
H2 · Field milestone
Verification
Paper released
Evidence level
E3 · Inspectable artifact
AI role
Autonomous primary role
Formal assurance
Machine-checked

How should these labels be read? →

Contribution & verification

Mathematical novelty
Tooling only
Interface
Informal, Formal, Hybrid
AI contribution
Learned models generate Lean statements and downstream formal proofs, while Lean compilation, semantic scoring and prover feedback constrain and evaluate the automated pipeline.
Human contribution
Researchers designed the autoformalization training procedure, LeanScorer, Gaokao-Formal and the end-to-end evaluation protocol, curated problems and analyzed the resulting system performance.
Verification
Paper released · E3 · Inspectable artifact · Machine-checked
Last reviewed
2026-09-14

Technical details

Systems
mathesis, mathesis-autoformalizer, leanscorer, lean
Organizations
huawei
Problems
natural-language-to-formal-theorem-proving, gaokao-formal
Methods
autoformalization, reinforcement-learning, preference-optimization, prover-feedback, lean

Sources & artifacts

Verification history

  • 2025-06-08 · Paper released · E2 · Research record

    The arXiv research record introduced Mathesis, LeanScorer and Gaokao-Formal and reported end-to-end formal-proving results.

  • 2026-09-11 · Paper released · E3 · Inspectable artifact

    The public Mathesis repository exposes implementation and project resources, and the work later appeared at ICLR 2026. Machine-checked refers to Lean acceptance within the evaluated proof pipeline; it does not imply independent replay of every experiment or semantic equivalence judgment.

Corrections

No corrections recorded.