TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Natural Language Processing/Code Generation/CodeSearchNet - Php

Code Generation on CodeSearchNet - Php

Metric: Smoothed BLEU-4 (higher is better)

LeaderboardDataset
Loading chart...

Results

Submit a result
#Model↕Smoothed BLEU-4▼Extra DataPaperDate↕Code
1CodeTrans-MT-Base26.23NoCodeTrans: Towards Cracking the Language of Sili...2021-04-06Code
2CodeBERT (MLM+RTD)21.32NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
3CodeBERT (MLM)21NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
4pre-train w/ code only20.71NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
5CodeBERT (RTD)20.25NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
6RoBERTa19.9NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
7seq2seq18.4NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code
8Transformer18.25NoCodeBERT: A Pre-Trained Model for Programming an...2020-02-19Code