code-davinci-002 175B (CoT)

Reported on 4 benchmarks across 2 tasks · 1 paper · 4 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Methodology4 results

Transfer LearningonBBH-alg
Average (%)· 2021-07-07
73.9
SOTA
Evaluating Large Language Models Trained on Code arXiv:2107.03374
Transfer LearningonBBH-nlp
Average (%)· 2021-07-07
73.5
best: 86.3 (Qwen2.5-72B)
SOTA
Evaluating Large Language Models Trained on Code arXiv:2107.03374
Multi-Task LearningonBBH-alg
Average (%)· 2021-07-07
73.9
SOTA
Evaluating Large Language Models Trained on Code arXiv:2107.03374
Multi-Task LearningonBBH-nlp
Average (%)· 2021-07-07
73.5
best: 86.3 (Qwen2.5-72B)
SOTA
Evaluating Large Language Models Trained on Code arXiv:2107.03374