PACT (reproduced by Thor)

Reported on 4 benchmarks across 2 tasks · 1 paper · 4 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Miscellaneous4 results

Automated Theorem ProvingonminiF2F-test
Pass@1· 2021-02-11
24.6
best: 52.94 (Kimina-Prover-Preview)
SOTA
Proof Artifact Co-training for Theorem Proving with Language Models arXiv:2102.06203
Automated Theorem ProvingonminiF2F-test
cumulative· 2021-02-11
24.6
best: 80.74 (Kimina-Prover-Preview)
SOTA
Proof Artifact Co-training for Theorem Proving with Language Models arXiv:2102.06203
Mathematical ProofsonminiF2F-test
Pass@1· 2021-02-11
24.6
best: 52.94 (Kimina-Prover-Preview)
SOTA
Proof Artifact Co-training for Theorem Proving with Language Models arXiv:2102.06203
Mathematical ProofsonminiF2F-test
cumulative· 2021-02-11
24.6
best: 80.74 (Kimina-Prover-Preview)
SOTA
Proof Artifact Co-training for Theorem Proving with Language Models arXiv:2102.06203