TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/GPT-f

GPT-f

Reported on 10 benchmarks across 2 tasks · 2 papers · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Miscellaneous10 results

  • Automated Theorem ProvingonMetamath set.mm
    Percentage correct· 2020-09-07
    56.2
    SOTA
    Generative Language Modeling for Automated Theorem ProvingarXiv:2009.03393
  • Mathematical ProofsonMetamath set.mm
    Percentage correct· 2020-09-07
    56.2
    SOTA
    Generative Language Modeling for Automated Theorem ProvingarXiv:2009.03393
  • Automated Theorem ProvingonminiF2F-valid
    Pass@64· 2022-05-23
    47.3
    best: 58.6 (Evariste)
    HyperTree Proof Search for Neural Theorem ProvingarXiv:2205.11491
  • Automated Theorem ProvingonminiF2F-curriculum
    Pass@64· 2022-05-23
    30.6
    best: 42.5 (Evariste-7d)
    HyperTree Proof Search for Neural Theorem ProvingarXiv:2205.11491
  • Automated Theorem ProvingonminiF2F-test
    Pass@64· 2022-05-23
    36.6
    best: 50.7 (DeepSeek-Prover-V1.5)
    HyperTree Proof Search for Neural Theorem ProvingarXiv:2205.11491
  • Automated Theorem ProvingonminiF2F-test
    cumulative· 2022-05-23
    36.6
    best: 80.74 (Kimina-Prover-Preview)
    HyperTree Proof Search for Neural Theorem ProvingarXiv:2205.11491
  • Mathematical ProofsonminiF2F-valid
    Pass@64· 2022-05-23
    47.3
    best: 58.6 (Evariste)
    HyperTree Proof Search for Neural Theorem ProvingarXiv:2205.11491
  • Mathematical ProofsonminiF2F-curriculum
    Pass@64· 2022-05-23
    30.6
    best: 42.5 (Evariste-7d)
    HyperTree Proof Search for Neural Theorem ProvingarXiv:2205.11491
  • Mathematical ProofsonminiF2F-test
    Pass@64· 2022-05-23
    36.6
    best: 50.7 (DeepSeek-Prover-V1.5)
    HyperTree Proof Search for Neural Theorem ProvingarXiv:2205.11491
  • Mathematical ProofsonminiF2F-test
    cumulative· 2022-05-23
    36.6
    best: 80.74 (Kimina-Prover-Preview)
    HyperTree Proof Search for Neural Theorem ProvingarXiv:2205.11491