Metric: Correctness, max., % (higher is better)
| # | Model↕ | Correctness, max., %▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | Code Llama 7B, fine-tuned at 4096 tokens | 45 | No | Optimizing Large Language Models for OpenAPI Cod... | 2024-05-24 | Code |
| 2 | Code Llama 7B, fine-tuned with document splitting | 42 | No | Optimizing Large Language Models for OpenAPI Cod... | 2024-05-24 | Code |
| 3 | Code Llama 7B | 36 | No | Optimizing Large Language Models for OpenAPI Cod... | 2024-05-24 | Code |
| 4 | GitHub Copilot | 29 | No | Optimizing Large Language Models for OpenAPI Cod... | 2024-05-24 | Code |