Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/CodeTrans-TF-Large

CodeTrans-TF-Large

Reported on 8 benchmarks across 5 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Code4 results

Git Commit Message GenerationonCommitGen
BLEU-4· 2021-04-06
44.41
SOTA
CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing arXiv:2104.02443
Code Comment GenerationonDeepCom
Smoothed BLEU-4· 2021-04-06
39.5
SOTA
CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing arXiv:2104.02443
Code Documentation GenerationonCodeSearchNet - Go
Smoothed BLEU-4· 2021-04-06
19.54
best: 26.79 (CodeBERT (MLM))
CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing arXiv:2104.02443
Code Documentation GenerationonCodeSearchNet - JavaScript
Smoothed BLEU-4· 2021-04-06
18.98
best: 25.61 (Transformer)
CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing arXiv:2104.02443

Adversarial2 results

Text GenerationonCodeSearchNet - Go
Smoothed BLEU-4· 2021-04-06
19.54
best: 26.79 (CodeBERT (MLM))
CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing arXiv:2104.02443
Text GenerationonCodeSearchNet - JavaScript
Smoothed BLEU-4· 2021-04-06
18.98
best: 25.61 (Transformer)
CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing arXiv:2104.02443

Natural Language Processing2 results

Code GenerationonCodeSearchNet - Go
Smoothed BLEU-4· 2021-04-06
19.54
best: 26.79 (CodeBERT (MLM))
CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing arXiv:2104.02443
Code GenerationonCodeSearchNet - JavaScript
Smoothed BLEU-4· 2021-04-06
18.98
best: 25.61 (Transformer)
CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing arXiv:2104.02443