Metric: Average Accuracy (higher is better)
| # | Model↕ | Average Accuracy▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | CodeTIDAL5 | 71.27 | No | Learning Type Inference for Enhanced Dataflow An... | 2023-10-01 | Code |
| 2 | GraphCodeBERT-MT4TS | 63.42 | No | - | - | Code |
| 3 | GraphCodeBERT | 62.51 | No | GraphCodeBERT: Pre-training Code Representations... | 2020-09-17 | Code |
| 4 | CodeBERT | 61.72 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 5 | PolyGot | 61.29 | No | Multilingual training for Software Engineering | 2021-12-03 | - |
| 6 | GraphPolyGot | 61 | No | Multilingual training for Software Engineering | 2021-12-03 | - |
| 7 | RoBERTa | 59.84 | No | RoBERTa: A Robustly Optimized BERT Pretraining A... | 2019-07-26 | Code |
| 8 | CodeBERTa | 59.81 | No | - | - | - |
| 9 | BERT | 57.52 | No | BERT: Pre-training of Deep Bidirectional Transfo... | 2018-10-11 | Code |