CodeRL+CodeT5

Reported on 3 benchmarks across 1 task · 1 paper · 3 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing3 results

Code GenerationonAPPS
Competition Pass@1· 2022-07-05
33.3
best: 34.8 (LPW (GPT-4o))
SOTA
CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning arXiv:2207.01780
Code GenerationonAPPS
Interview Pass@1· 2022-07-05
13.5
best: 65.2 (LPW (GPT-4o))
SOTA
CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning arXiv:2207.01780
Code GenerationonAPPS
Introductory Pass@1· 2022-07-05
20
best: 87.2 (LPW (GPT-4o))
SOTA
CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning arXiv:2207.01780