Code Completion on OpenAPI completion refined

Metric: Validness, max., % (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Validness, max., %▼	Extra Data	Paper	Date↕	Code
1	Code Llama 7B, fine-tuned at 4096 tokens	84	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
2	Code Llama 7B, fine-tuned with document splitting	76	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
3	GitHub Copilot	68	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
4	Code Llama 7B	64	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code

#1Code Llama 7B, fine-tuned at 4096 tokensSOTA
84
Validness, max., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#2Code Llama 7B, fine-tuned with document splitting
76
Validness, max., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#3GitHub Copilot
68
Validness, max., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#4Code Llama 7B
64
Validness, max., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code