OpenAPI code completion on OpenAPI completion refined

Metric: Correctness, avg., % (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Correctness, avg., %▼	Extra Data	Paper	Date↕	Code
1	Code Llama 7B, fine-tuned with document splitting	34	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
2	Code Llama 7B, fine-tuned at 4096 tokens	32	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
3	Code Llama 7B	31.1	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
4	GitHub Copilot	29	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code

#1Code Llama 7B, fine-tuned with document splittingSOTA
34
Correctness, avg., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#2Code Llama 7B, fine-tuned at 4096 tokens
32
Correctness, avg., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#3Code Llama 7B
31.1
Correctness, avg., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#4GitHub Copilot
29
Correctness, avg., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code