TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/CodeTrans-MT-Base

CodeTrans-MT-Base

Reported on 10 benchmarks across 4 tasks · 1 paper · 10 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

  • Code GenerationonCodeSearchNet - Python
    Smoothed BLEU-4· 2021-04-06
    20.39
    SOTA
    CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingarXiv:2104.02443
  • Code GenerationonCodeSearchNet - Php
    Smoothed BLEU-4· 2021-04-06
    26.23
    SOTA
    CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingarXiv:2104.02443
  • Code GenerationonCodeSearchNet - Ruby
    Smoothed BLEU-4· 2021-04-06
    15.26
    SOTA
    CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingarXiv:2104.02443
  • Source Code SummarizationonSummarizing Source Code using a Neural Attention Model - Python
    Smoothed BLEU-4· 2021-04-06
    13.37
    SOTA
    CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingarXiv:2104.02443

Adversarial3 results

  • Text GenerationonCodeSearchNet - Python
    Smoothed BLEU-4· 2021-04-06
    20.39
    SOTA
    CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingarXiv:2104.02443
  • Text GenerationonCodeSearchNet - Php
    Smoothed BLEU-4· 2021-04-06
    26.23
    SOTA
    CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingarXiv:2104.02443
  • Text GenerationonCodeSearchNet - Ruby
    Smoothed BLEU-4· 2021-04-06
    15.26
    SOTA
    CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingarXiv:2104.02443

Computer Code3 results

  • Code Documentation GenerationonCodeSearchNet - Python
    Smoothed BLEU-4· 2021-04-06
    20.39
    SOTA
    CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingarXiv:2104.02443
  • Code Documentation GenerationonCodeSearchNet - Php
    Smoothed BLEU-4· 2021-04-06
    26.23
    SOTA
    CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingarXiv:2104.02443
  • Code Documentation GenerationonCodeSearchNet - Ruby
    Smoothed BLEU-4· 2021-04-06
    15.26
    SOTA
    CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingarXiv:2104.02443