TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Redcoder-ext

Redcoder-ext

Reported on 9 benchmarks across 1 task · 1 paper · 9 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing9 results

  • Code GenerationonCodeXGLUE - CodeSearchNet
    Java/BLEU· uses extra data· 2021-08-26
    28.98
    SOTA
    Retrieval Augmented Code Generation and SummarizationarXiv:2108.11601
  • Code GenerationonCodeXGLUE - CodeSearchNet
    Java/CodeBLEU· uses extra data· 2021-08-26
    33.18
    SOTA
    Retrieval Augmented Code Generation and SummarizationarXiv:2108.11601
  • Code GenerationonCodeXGLUE - CodeSearchNet
    Java/EM· uses extra data· 2021-08-26
    10.21
    SOTA
    Retrieval Augmented Code Generation and SummarizationarXiv:2108.11601
  • Code GenerationonCodeXGLUE - CodeSearchNet
    Python/BLEU· uses extra data· 2021-08-26
    24.43
    SOTA
    Retrieval Augmented Code Generation and SummarizationarXiv:2108.11601
  • Code GenerationonCodeXGLUE - CodeSearchNet
    Python/CodeBLEU· uses extra data· 2021-08-26
    30.21
    SOTA
    Retrieval Augmented Code Generation and SummarizationarXiv:2108.11601
  • Code GenerationonCodeXGLUE - CodeSearchNet
    Python/EM· uses extra data· 2021-08-26
    9.61
    SOTA
    Retrieval Augmented Code Generation and SummarizationarXiv:2108.11601
  • Code GenerationonCONCODE
    BLEU· 2021-08-26
    42.5
    SOTA
    Retrieval Augmented Code Generation and SummarizationarXiv:2108.11601
  • Code GenerationonCONCODE
    CodeBLEU· 2021-08-26
    43.4
    best: 44.1 (CodeT5)
    SOTA
    Retrieval Augmented Code Generation and SummarizationarXiv:2108.11601
  • Code GenerationonCONCODE
    Exact Match· 2021-08-26
    23.4
    SOTA
    Retrieval Augmented Code Generation and SummarizationarXiv:2108.11601