OpenAPI code completion on OpenAPI completion refined

Metric: Correctness, max., % (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Correctness, max., %▼	Extra Data	Paper	Date↕	Code
1	Code Llama 7B, fine-tuned at 4096 tokens	45	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
2	Code Llama 7B, fine-tuned with document splitting	42	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
3	Code Llama 7B	36	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
4	GitHub Copilot	29	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code

#1Code Llama 7B, fine-tuned at 4096 tokensSOTA
45
Correctness, max., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#2Code Llama 7B, fine-tuned with document splitting
42
Correctness, max., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#3Code Llama 7B
36
Correctness, max., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#4GitHub Copilot
29
Correctness, max., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code