TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Natural Language Processing/Code Generation/CodeSearchNet - JavaScript

Code Generation on CodeSearchNet - JavaScript

Metric: Smoothed BLEU-4 (higher is better)

LeaderboardDataset
Loading chart...

Results

Submit a result
#Model↕Smoothed BLEU-4▼Extra DataPaperDate↕Code
1Transformer25.61NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
2CodeTrans-TF-Large18.98NoCodeTrans: Towards Cracking the Language of Sili...2021-04-06Code
3CodeBERT (MLM+RTD)9.54NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
4CodeBERT (RTD)8.73NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
5CodeBERT (MLM)8.51NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
6pre-train w/ code only8.3NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
7seq2seq6.88NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
8RoBERTa5.72NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code