Metric: Val Set pass@1 (higher is better)
| # | Model↕ | Val Set pass@1▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | MapCoder (GPT-4) | 28.5 | No | MapCoder: Multi-Agent Code Generation for Compet... | 2024-05-18 | Code |
| 2 | MoTCoder-15B | 20.35 | No | MoTCoder: Elevating Large Language Models with M... | 2023-12-26 | Code |
| 3 | MoTCoder-7B-v1.5 | 16.72 | No | MoTCoder: Elevating Large Language Models with M... | 2023-12-26 | Code |
| 4 | CodeChain + WizardCoder-15B | 2.48 | No | CodeChain: Towards Modular Code Generation Throu... | 2023-10-13 | Code |
| 5 | WizardCoder-15B | 1.98 | No | WizardCoder: Empowering Code Large Language Mode... | 2023-06-14 | Code |