TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Metamath GPT-f

Metamath GPT-f

Reported on 8 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Miscellaneous8 results

  • Automated Theorem ProvingonminiF2F-valid
    Pass@1· 2021-08-31
    1
    best: 23.9 (Lean GPT-f)
    MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicsarXiv:2109.00110
  • Automated Theorem ProvingonminiF2F-valid
    Pass@8· 2021-08-31
    2
    best: 29.3 (Lean GPT-f)
    MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicsarXiv:2109.00110
  • Automated Theorem ProvingonminiF2F-test
    Pass@1· 2021-08-31
    1.3
    best: 52.94 (Kimina-Prover-Preview)
    MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicsarXiv:2109.00110
  • Automated Theorem ProvingonminiF2F-test
    cumulative· 2021-08-31
    1.6
    best: 80.74 (Kimina-Prover-Preview)
    MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicsarXiv:2109.00110
  • Mathematical ProofsonminiF2F-valid
    Pass@1· 2021-08-31
    1
    best: 23.9 (Lean GPT-f)
    MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicsarXiv:2109.00110
  • Mathematical ProofsonminiF2F-valid
    Pass@8· 2021-08-31
    2
    best: 29.3 (Lean GPT-f)
    MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicsarXiv:2109.00110
  • Mathematical ProofsonminiF2F-test
    Pass@1· 2021-08-31
    1.3
    best: 52.94 (Kimina-Prover-Preview)
    MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicsarXiv:2109.00110
  • Mathematical ProofsonminiF2F-test
    cumulative· 2021-08-31
    1.6
    best: 80.74 (Kimina-Prover-Preview)
    MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicsarXiv:2109.00110