Code Generation on BigCodeBench-Instruct
Metric: Pass@1 (higher is better)
Metric: Pass@1 (higher is better)
| # | Model↕ | Pass@1▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | GPT-4o-2024-05-13 | 51.1 | No | BigCodeBench: Benchmarking Code Generation with ... | 2024-06-22 | Code |
| 2 | DeepSeek-Coder-V2-Instruct | 48.2 | No | BigCodeBench: Benchmarking Code Generation with ... | 2024-06-22 | Code |