Primary evidence
- Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human AnnotationsS1 · Primary research · Paper · 2023-12-14
Math-Shepherd automates step-level process supervision for math reasoning
The verifier scores intermediate reasoning steps rather than only final answers and can be used for selection or reinforcement learning.
What happened?
Math-Shepherd trained a process reward model from automatically constructed step-wise supervision and improved both reranking and reinforcement-learning performance on GSM8K and MATH.
Why it matters
Process-level verification became a central ingredient in the later generation of reasoning models and verifier-guided math systems.
Significance rationale: Math-Shepherd made process reward modeling more scalable by generating step-level supervision without manual annotation.
Historical context
Earlier developments
Later developments
—
Related milestones
—
Evidence & status at a glance
- Significance
- H2 · Field milestone
- Verification
- Paper released
- Evidence level
- E2 · Research record
- AI role
- Substantive AI support
- Formal assurance
- No formal assurance
Contribution & verification
- Mathematical novelty
- Tooling only
- Interface
- Informal, Symbolic
- AI contribution
- A learned verifier judges intermediate reasoning steps and supplies selection or training signals.
- Human contribution
- Researchers designed automatic supervision construction, reward modeling and evaluation.
- Verification
- Paper released · E2 · Research record · No formal assurance
- Last reviewed
- 2026-09-11
Technical details
- Systems
- math-shepherd
- Organizations
- peking-university, deepseek
- Problems
- gsm8k, math-benchmark
- Methods
- process-reward-model, reinforcement-learning, verification
Sources & artifacts
- Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human AnnotationsS1 · Primary research · Paper · accessed 2026-09-10
Verification history
- 2023-12-14 · Paper released · E2 · Research record
The Chronicle records this event from the cited primary or official source; the status does not imply independent Chronicle verification.
Corrections
No corrections recorded.