GPT-3.5 Turbo (few-shot)

Reported on 1 benchmark across 1 task · 2 papers

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Code GenerationonMBPP
Accuracy· uses extra data· 2024-01-25
70.8
best: 96.6 (EG-CFG (DeepSeek-V3-0324))
DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence arXiv:2401.14196
Code GenerationonMBPP
Accuracy· 2023-11-16
45.4
best: 96.6 (EG-CFG (DeepSeek-V3-0324))
INTERVENOR: Prompting the Coding Ability of Large Language Models with the Interactive Chain of Repair arXiv:2311.09868