TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Code Llama 7B, fine-tuned at 4096 tokens

Code Llama 7B, fine-tuned at 4096 tokens

Reported on 8 benchmarks across 2 tasks · 1 paper · 4 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Code8 results

  • Code CompletiononOpenAPI completion refined
    Correctness, max., %· 2024-05-24
    45
    SOTA
    Optimizing Large Language Models for OpenAPI Code CompletionarXiv:2405.15729
  • Code CompletiononOpenAPI completion refined
    Validness, max., %· 2024-05-24
    84
    SOTA
    Optimizing Large Language Models for OpenAPI Code CompletionarXiv:2405.15729
  • OpenAPI code completiononOpenAPI completion refined
    Correctness, max., %· 2024-05-24
    45
    SOTA
    Optimizing Large Language Models for OpenAPI Code CompletionarXiv:2405.15729
  • OpenAPI code completiononOpenAPI completion refined
    Validness, max., %· 2024-05-24
    84
    SOTA
    Optimizing Large Language Models for OpenAPI Code CompletionarXiv:2405.15729
  • Code CompletiononOpenAPI completion refined
    Correctness, avg., %· 2024-05-24
    32
    best: 34 (Code Llama 7B, fine-tuned with document splitting)
    Optimizing Large Language Models for OpenAPI Code CompletionarXiv:2405.15729
  • Code CompletiononOpenAPI completion refined
    Validness, avg., %· 2024-05-24
    63.1
    best: 69.1 (Code Llama 7B, fine-tuned with document splitting)
    Optimizing Large Language Models for OpenAPI Code CompletionarXiv:2405.15729
  • OpenAPI code completiononOpenAPI completion refined
    Correctness, avg., %· 2024-05-24
    32
    best: 34 (Code Llama 7B, fine-tuned with document splitting)
    Optimizing Large Language Models for OpenAPI Code CompletionarXiv:2405.15729
  • OpenAPI code completiononOpenAPI completion refined
    Validness, avg., %· 2024-05-24
    63.1
    best: 69.1 (Code Llama 7B, fine-tuned with document splitting)
    Optimizing Large Language Models for OpenAPI Code CompletionarXiv:2405.15729