WizardCoder-15B

Reported on 4 benchmarks across 1 task · 1 paper · 4 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

Code GenerationonCodeContests
Test Set pass@1· 2023-06-14
1.11
best: 58.18 (EG-CFG (DeepSeek-V3-0324))
SOTA
WizardCoder: Empowering Code Large Language Models with Evol-Instruct arXiv:2306.08568
Code GenerationonCodeContests
Test Set pass@5· 2023-06-14
3.18
best: 35.2 (MapCoder (GPT-4))
SOTA
WizardCoder: Empowering Code Large Language Models with Evol-Instruct arXiv:2306.08568
Code GenerationonCodeContests
Val Set pass@1· 2023-06-14
1.98
best: 28.5 (MapCoder (GPT-4))
SOTA
WizardCoder: Empowering Code Large Language Models with Evol-Instruct arXiv:2306.08568
Code GenerationonCodeContests
Val Set pass@5· 2023-06-14
3.27
best: 3.3 (CodeChain + WizardCoder-15B)
SOTA
WizardCoder: Empowering Code Large Language Models with Evol-Instruct arXiv:2306.08568