MoTCoder-15B

Reported on 2 benchmarks across 1 task · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Code GenerationonCodeContests
Test Set pass@1· 2023-12-26
26.34
best: 58.18 (EG-CFG (DeepSeek-V3-0324))
SOTA
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks arXiv:2312.15960
Code GenerationonCodeContests
Val Set pass@1· 2023-12-26
20.35
best: 28.5 (MapCoder (GPT-4))
SOTA
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks arXiv:2312.15960