Code Generation on DSEval-LeetCode
Metric: w/o PE (higher is better)
Metric: w/o PE (higher is better)
| # | Model↕ | w/o PE▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | Jupyter-AI | 70 | No | - | - | - |
| 2 | CoML | 62.5 | No | MLCopilot: Unleashing the Power of Large Languag... | 2023-04-28 | Code |
| 3 | Chapyter | 60 | No | - | - | - |
| 4 | Code Interpreter API | 55 | No | - | - | - |
| 5 | ChatDev | 50 | No | - | - | - |