CoML

Reported on 3 benchmarks across 1 task · 1 paper · 3 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing3 results

Code GenerationonDSEval-LeetCode
Pass Rate· 2023-04-28
42.5
best: 57.5 (Jupyter-AI)
SOTA
MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks arXiv:2304.14979
Code GenerationonDSEval-LeetCode
w/o Intact· 2023-04-28
42.5
best: 57.5 (Jupyter-AI)
SOTA
MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks arXiv:2304.14979
Code GenerationonDSEval-LeetCode
w/o PE· 2023-04-28
62.5
best: 70 (Jupyter-AI)
SOTA
MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks arXiv:2304.14979