text-davinci-002 175B (2-shot, CoT)

Reported on 2 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Reasoning2 results

Arithmetic ReasoningonGSM8K
Accuracy· uses extra data· 2022-05-24
41.3
best: 97.72 (Claude 3.5 Sonnet (HPT))
Large Language Models are Zero-Shot Reasoners arXiv:2205.11916
Arithmetic ReasoningonGSM8K
Parameters (Billion)· uses extra data· 2022-05-24
175
best: 540 (PaLM 540B (Self Improvement, Self Consistency))
Large Language Models are Zero-Shot Reasoners arXiv:2205.11916