Minerva 62B (8-shot)

Reported on 2 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Reasoning2 results

Arithmetic ReasoningonGSM8K
Accuracy· uses extra data· 2022-06-29
52.4
best: 97.72 (Claude 3.5 Sonnet (HPT))
Solving Quantitative Reasoning Problems with Language Models arXiv:2206.14858
Arithmetic ReasoningonGSM8K
Parameters (Billion)· uses extra data· 2022-06-29
62
best: 540 (PaLM 540B (Self Improvement, Self Consistency))
Solving Quantitative Reasoning Problems with Language Models arXiv:2206.14858