Code Generation on CodeContests
Metric: Test Set pass@5 (higher is better)
Metric: Test Set pass@5 (higher is better)
| # | Model↕ | Test Set pass@5▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | MapCoder (GPT-4) | 35.2 | No | MapCoder: Multi-Agent Code Generation for Compet... | 2024-05-18 | Code |
| 2 | CodeChain + WizardCoder-15B | 3.29 | No | CodeChain: Towards Modular Code Generation Throu... | 2023-10-13 | Code |
| 3 | WizardCoder-15B | 3.18 | No | WizardCoder: Empowering Code Large Language Mode... | 2023-06-14 | Code |