Metric: Correctness, avg., % (higher is better)
| # | Model↕ | Correctness, avg., %▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | Code Llama 7B, fine-tuned with document splitting | 34 | No | Optimizing Large Language Models for OpenAPI Cod... | 2024-05-24 | Code |
| 2 | Code Llama 7B, fine-tuned at 4096 tokens | 32 | No | Optimizing Large Language Models for OpenAPI Cod... | 2024-05-24 | Code |
| 3 | Code Llama 7B | 31.1 | No | Optimizing Large Language Models for OpenAPI Cod... | 2024-05-24 | Code |
| 4 | GitHub Copilot | 29 | No | Optimizing Large Language Models for OpenAPI Cod... | 2024-05-24 | Code |