Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/CodeT5

CodeT5

Reported on 10 benchmarks across 2 tasks · 1 paper · 8 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing7 results

Code GenerationonCONCODE
CodeBLEU· 2021-09-02
44.1
SOTA
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation arXiv:2109.00859
Code GenerationonCodeXGLUE - CodeTrans
Accuracy (C#→Java)· 2021-09-02
66.9
SOTA
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation arXiv:2109.00859
Code GenerationonCodeXGLUE - CodeTrans
Accuracy (Java→C#)· 2021-09-02
65.9
SOTA
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation arXiv:2109.00859
Code GenerationonCodeXGLUE - CodeTrans
BLEU (C#→Java)· 2021-09-02
79.87
SOTA
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation arXiv:2109.00859
Code GenerationonCodeXGLUE - CodeTrans
BLEU (Java→C#)· 2021-09-02
84.03
SOTA
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation arXiv:2109.00859
Code GenerationonCONCODE
BLEU· 2021-09-02
41.48
best: 42.5 (Redcoder-ext)
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation arXiv:2109.00859
Code GenerationonCONCODE
Exact Match· 2021-09-02
22.7
best: 23.4 (Redcoder-ext)
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation arXiv:2109.00859

Computer Code3 results

Text-to-Code GenerationonCodeXGLUE - CONCODE
BLEU· 2021-09-02
41.48
SOTA
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation arXiv:2109.00859
Text-to-Code GenerationonCodeXGLUE - CONCODE
CodeBLEU· 2021-09-02
44.1
SOTA
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation arXiv:2109.00859
Text-to-Code GenerationonCodeXGLUE - CONCODE
EM· 2021-09-02
22.7
SOTA
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation arXiv:2109.00859