Mathematical Proofs

20 benchmarks90 papers

Benchmarks

Mathematical Proofs on miniF2F-test

cumulativePass@1Pass@32Pass@64Pass@100pass@1024pass@8192ITP

Mathematical Proofs on HolStep (Conditional)

Classification Accuracy

Mathematical Proofs on HOList benchmark

Percentage correct

Mathematical Proofs on HolStep (Unconditional)

Classification Accuracy

Mathematical Proofs on miniF2F-curriculum

Pass@64

Mathematical Proofs on miniF2F-valid

Pass@64Pass@1Pass@100Pass@8

Mathematical Proofs on Metamath set.mm

Percentage correctPass@32

Mathematical Proofs on CompCert

Percentage correct

Mathematical Proofs on CoqGym

Percentage correct