Code Generation on CodeContests

Metric: Val Set pass@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Val Set pass@1▼	Extra Data	Paper	Date↕	Code
1	MapCoder (GPT-4)	28.5	No	MapCoder: Multi-Agent Code Generation for Compet...	2024-05-18	Code
2	MoTCoder-15B	20.35	No	MoTCoder: Elevating Large Language Models with M...	2023-12-26	Code
3	MoTCoder-7B-v1.5	16.72	No	MoTCoder: Elevating Large Language Models with M...	2023-12-26	Code
4	CodeChain + WizardCoder-15B	2.48	No	CodeChain: Towards Modular Code Generation Throu...	2023-10-13	Code
5	WizardCoder-15B	1.98	No	WizardCoder: Empowering Code Large Language Mode...	2023-06-14	Code

#1MapCoder (GPT-4)SOTA
28.5
Val Set pass@1· 2024-05-18
MapCoder: Multi-Agent Code Generation for Competitive Problem Solving Code
#2MoTCoder-15BSOTA
20.35
Val Set pass@1· 2023-12-26
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks Code
#3MoTCoder-7B-v1.5
16.72
Val Set pass@1· 2023-12-26
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks Code
#4CodeChain + WizardCoder-15BSOTA
2.48
Val Set pass@1· 2023-10-13
CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules Code
#5WizardCoder-15BSOTA
1.98
Val Set pass@1· 2023-06-14
WizardCoder: Empowering Code Large Language Models with Evol-Instruct Code