HOList and DeepHOL open a reinforcement-learning environment for higher-order theorem proving

HOList instrumented HOL Light so learning systems could interact with proof states and tactics through a machine-learning environment. The benchmark packaged theorem statements from core, complex and Flyspeck corpora with train, validation and test labels, while DeepHOL supplied a neural prover and…

What happened?

Google Research and collaborators released HOList, an open-source reinforcement-learning environment and benchmark built on HOL Light, together with DeepHOL, a deep-learning-driven tactic-based prover trained on human and synthesized proofs and evaluated on theorem corpora including Flyspeck-derived material.

HOList instrumented HOL Light so learning systems could interact with proof states and tactics through a machine-learning environment. The benchmark packaged theorem statements from core, complex and Flyspeck corpora with train, validation and test labels, while DeepHOL supplied a neural prover and reinforcement-learning loop for generating additional successful proof traces.

Why it matters

The release showed how a mature proof assistant and a substantial mathematical library could be exposed as a learning environment rather than only as a static corpus. That environment-plus-benchmark pattern became central to later neural theorem-proving infrastructure and made proof-assistant-native reinforcement learning a concrete experimental program.

Significance rationale: HOList combined an open HOL Light interaction environment, a benchmark drawn from a substantial formal mathematics library, and the DeepHOL neural prover in one reproducible research stack. It became an important early reference point for reinforcement-learning and neural proof guidance inside interactive theorem provers, preceding later systems that learned more of search and tactic selection end to end.

Historical context

Primary evidence

Evidence & status at a glance

Significance
H2 · Field milestone
Verification
Paper released
Evidence level
E3 · Inspectable artifact
AI role
Autonomous primary role
Formal assurance
Machine-checked

How should these labels be read? →

Contribution & verification

Mathematical novelty
Tooling only
Interface
Formal, Symbolic
AI contribution
DeepHOL used learned models to guide tactic choice, premise selection and proof search, including reinforcement from synthesized successful proofs; candidate proofs were ultimately checked through the HOL Light environment.
Human contribution
Researchers built the HOL Light interface, benchmark extraction, training pipeline, proof-search machinery, neural models, reinforcement-learning loop and evaluation protocol.
Verification
Paper released · E3 · Inspectable artifact · Machine-checked
Last reviewed
2026-09-15

Technical details

Systems
holist, deephol, hol-light
Organizations
google-research
Problems
higher-order-logic-theorem-proving
Methods
reinforcement-learning, tactic-prediction, premise-selection, proof-search, benchmarking

Sources & artifacts

Verification history

  • 2019-04-05 · Paper released · E2 · Research record

    The arXiv and ICML research records establish HOList, its benchmark and the reported DeepHOL experiments. Machine checking refers to proof traces accepted through HOL Light and does not imply independent reproduction of the reported benchmark performance.

  • 2026-09-15 · Paper released · E3 · Inspectable artifact

    The public Deepmath codebase and HOList benchmark site expose the prover code, benchmark definition, model resources and proof-checking workflow. E3 denotes inspectable artifacts rather than independent confirmation of all experimental claims.

Corrections

No corrections recorded.