OpenAPI code completion on OpenAPI completion refined

Metric: Validness, avg., % (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Validness, avg., %▼	Extra Data	Paper	Date↕	Code
1	Code Llama 7B, fine-tuned with document splitting	69.1	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
2	GitHub Copilot	68	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
3	Code Llama 7B, fine-tuned at 4096 tokens	63.1	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code
4	Code Llama 7B	60.7	No	Optimizing Large Language Models for OpenAPI Cod...	2024-05-24	Code

#1Code Llama 7B, fine-tuned with document splittingSOTA
69.1
Validness, avg., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#2GitHub Copilot
68
Validness, avg., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#3Code Llama 7B, fine-tuned at 4096 tokens
63.1
Validness, avg., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code
#4Code Llama 7B
60.7
Validness, avg., %· 2024-05-24
Optimizing Large Language Models for OpenAPI Code Completion Code