Code Generation on APPS

Metric: Competition Pass@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Competition Pass@1▼	Extra Data	Paper	Date↕	Code
1	LPW (GPT-4o)	34.8	No	Planning-Driven Programming: A Large Language Mo...	2024-11-21	Code
2	CodeRL+CodeT5	33.3	No	CodeRL: Mastering Code Generation through Pretra...	2022-07-05	Code
3	MoTCoder-32B-V1.5	27.84	No	MoTCoder: Elevating Large Language Models with M...	2023-12-26	Code
4	MoTCoder-7B-V1.5	21.18	No	MoTCoder: Elevating Large Language Models with M...	2023-12-26	Code
5	deepseek-ai/deepseek-coder-6.7b-instruct	11.09	No	DeepSeek-Coder: When the Large Language Model Me...	2024-01-25	Code
6	WizardCoder-15b	3.75	No	CodeChain: Towards Modular Code Generation Throu...	2023-10-13	Code
7	CodeSim (GPT4)	0.81	No	CODESIM: Multi-Agent Code Generation and Problem...	2025-02-08	Code

#1LPW (GPT-4o)SOTA
34.8
Competition Pass@1· 2024-11-21
Planning-Driven Programming: A Large Language Model Programming Workflow Code
#2CodeRL+CodeT5SOTA
33.3
Competition Pass@1· 2022-07-05
CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning Code
#3MoTCoder-32B-V1.5
27.84
Competition Pass@1· 2023-12-26
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks Code
#4MoTCoder-7B-V1.5
21.18
Competition Pass@1· 2023-12-26
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks Code
#5deepseek-ai/deepseek-coder-6.7b-instruct
11.09
Competition Pass@1· 2024-01-25
DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence Code
#6WizardCoder-15b
3.75
Competition Pass@1· 2023-10-13
CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules Code
#7CodeSim (GPT4)
0.81
Competition Pass@1· 2025-02-08
CODESIM: Multi-Agent Code Generation and Problem Solving through Simulation-Driven Planning and Debugging Code