Program Synthesis on ManyTypes4TypeScript
Metric: Average F1 (higher is better)
Metric: Average F1 (higher is better)
| # | Model↕ | Average F1▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | GraphCodeBERT | 60.57 | No | GraphCodeBERT: Pre-training Code Representations... | 2020-09-17 | Code |
| 2 | CodeBERT | 59.57 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 3 | PolyGot | 58.86 | No | Multilingual training for Software Engineering | 2021-12-03 | - |
| 4 | GraphPolyGot | 58.63 | No | Multilingual training for Software Engineering | 2021-12-03 | - |
| 5 | RoBERTa | 57.54 | No | RoBERTa: A Robustly Optimized BERT Pretraining A... | 2019-07-26 | Code |
| 6 | CodeBERTa | 56.71 | No | - | - | - |
| 7 | BERT | 54.1 | No | BERT: Pre-training of Deep Bidirectional Transfo... | 2018-10-11 | Code |