Code Generation on BigCodeBench-Complete

Metric: Pass@1 (higher is better)

LeaderboardDataset
Loading chart...
#ModelPass@1Extra DataPaperDateCode
1GPT-4o-2024-05-1361.1NoBigCodeBench: Benchmarking Code Generation with ...2024-06-22Code
2DeepSeek-Coder-V2-Instruct59.7NoBigCodeBench: Benchmarking Code Generation with ...2024-06-22Code