MGDebugger (DeepSeek-Coder-V2-Lite)

Reported on 2 benchmarks across 2 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Code2 results

Program SynthesisonHumanEvalPack
Pass@1· 2024-10-02
97.6
SOTA
From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging arXiv:2410.01215
Program RepaironHumanEvalPack
Pass@1· 2024-10-02
97.6
SOTA
From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging arXiv:2410.01215