TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Computer Code/Code Completion/OpenAPI completion refined

Code Completion on OpenAPI completion refined

Metric: Validness, avg., % (higher is better)

LeaderboardDataset
Loading chart...

Results

Submit a result
#Model↕Validness, avg., %▼Extra DataPaperDate↕Code
1Code Llama 7B, fine-tuned with document splitting69.1NoOptimizing Large Language Models for OpenAPI Cod...2024-05-24Code
2GitHub Copilot68NoOptimizing Large Language Models for OpenAPI Cod...2024-05-24Code
3Code Llama 7B, fine-tuned at 4096 tokens63.1NoOptimizing Large Language Models for OpenAPI Cod...2024-05-24Code
4Code Llama 7B60.7NoOptimizing Large Language Models for OpenAPI Cod...2024-05-24Code