Text Generation on CodeSearchNet - JavaScript
Metric: Smoothed BLEU-4 (higher is better)
Metric: Smoothed BLEU-4 (higher is better)
| # | Model↕ | Smoothed BLEU-4▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | Transformer | 25.61 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 2 | CodeTrans-TF-Large | 18.98 | No | CodeTrans: Towards Cracking the Language of Sili... | 2021-04-06 | Code |
| 3 | CodeBERT (MLM+RTD) | 9.54 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 4 | CodeBERT (RTD) | 8.73 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 5 | CodeBERT (MLM) | 8.51 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 6 | pre-train w/ code only | 8.3 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 7 | seq2seq | 6.88 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 8 | RoBERTa | 5.72 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |