LLEMMA-34b

Reported on 4 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Miscellaneous4 results

Automated Theorem ProvingonminiF2F-test
Pass@32· 2023-10-16
25.8
best: 68.85 (Kimina-Prover-Preview)
Llemma: An Open Language Model For Mathematics arXiv:2310.10631
Automated Theorem ProvingonminiF2F-test
cumulative· 2023-10-16
25.8
best: 80.74 (Kimina-Prover-Preview)
Llemma: An Open Language Model For Mathematics arXiv:2310.10631
Mathematical ProofsonminiF2F-test
Pass@32· 2023-10-16
25.8
best: 68.85 (Kimina-Prover-Preview)
Llemma: An Open Language Model For Mathematics arXiv:2310.10631
Mathematical ProofsonminiF2F-test
cumulative· 2023-10-16
25.8
best: 80.74 (Kimina-Prover-Preview)
Llemma: An Open Language Model For Mathematics arXiv:2310.10631