DeepSeek-Coder-V2-Instruct

Reported on 2 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Code GenerationonBigCodeBench-Instruct
Pass@1· 2024-06-22
48.2
best: 51.1 (GPT-4o-2024-05-13)
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions arXiv:2406.15877
Code GenerationonBigCodeBench-Complete
Pass@1· 2024-06-22
59.7
best: 61.1 (GPT-4o-2024-05-13)
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions arXiv:2406.15877