Orca-Math 7B (fine-tuned)

Reported on 2 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Reasoning2 results

Arithmetic ReasoningonGSM8K
Accuracy· uses extra data· 2024-02-16
86.8
best: 97.72 (Claude 3.5 Sonnet (HPT))
Orca-Math: Unlocking the potential of SLMs in Grade School Math arXiv:2402.14830
Arithmetic ReasoningonGSM8K
Parameters (Billion)· uses extra data· 2024-02-16
7
best: 540 (PaLM 540B (Self Improvement, Self Consistency))
Orca-Math: Unlocking the potential of SLMs in Grade School Math arXiv:2402.14830