Code Generation on DSEval-LeetCode
Metric: Pass Rate (higher is better)
Metric: Pass Rate (higher is better)
| # | Model↕ | Pass Rate▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | Jupyter-AI | 57.5 | No | - | - | - |
| 2 | Chapyter | 45 | No | - | - | - |
| 3 | Code Interpreter API | 45 | No | - | - | - |
| 4 | CoML | 42.5 | No | MLCopilot: Unleashing the Power of Large Languag... | 2023-04-28 | Code |
| 5 | ChatDev | 32.5 | No | - | - | - |