MoTCoder-7B-v1.5

Reported on 2 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Code GenerationonCodeContests
Test Set pass@1· 2023-12-26
20.77
best: 58.18 (EG-CFG (DeepSeek-V3-0324))
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks arXiv:2312.15960
Code GenerationonCodeContests
Val Set pass@1· 2023-12-26
16.72
best: 28.5 (MapCoder (GPT-4))
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks arXiv:2312.15960