Metric: Average Precision (higher is better)
| # | Model↕ | Average Precision▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | GraphCodeBERT | 60.06 | No | GraphCodeBERT: Pre-training Code Representations... | 2020-09-17 | Code |
| 2 | CodeBERT | 59.34 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 3 | PolyGot | 58.81 | No | Multilingual training for Software Engineering | 2021-12-03 | - |
| 4 | GraphPolyGot | 58.36 | No | Multilingual training for Software Engineering | 2021-12-03 | - |
| 5 | RoBERTa | 57.45 | No | RoBERTa: A Robustly Optimized BERT Pretraining A... | 2019-07-26 | Code |
| 6 | CodeBERTa | 56.57 | No | - | - | - |
| 7 | BERT | 54.18 | No | BERT: Pre-training of Deep Bidirectional Transfo... | 2018-10-11 | Code |