Metric: Average Recall (higher is better)
| # | Model↕ | Average Recall▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | GraphCodeBERT | 61.08 | No | GraphCodeBERT: Pre-training Code Representations... | 2020-09-17 | Code |
| 2 | CodeBERT | 59.8 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 3 | PolyGot | 58.91 | No | Multilingual training for Software Engineering | 2021-12-03 | - |
| 4 | GraphPolyGot | 58.91 | No | Multilingual training for Software Engineering | 2021-12-03 | - |
| 5 | RoBERTa | 57.62 | No | RoBERTa: A Robustly Optimized BERT Pretraining A... | 2019-07-26 | Code |
| 6 | CodeBERTa | 56.85 | No | - | - | - |
| 7 | BERT | 54.02 | No | BERT: Pre-training of Deep Bidirectional Transfo... | 2018-10-11 | Code |