Metric: Java (higher is better)
| # | Model↕ | Java▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | cpt-code M | 94.4 | No | Text and Code Embeddings by Contrastive Pre-Trai... | 2022-01-24 | Code |
| 2 | cpt-code S | 94 | No | Text and Code Embeddings by Contrastive Pre-Trai... | 2022-01-24 | Code |
| 3 | CodeBERT | 86.8 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 4 | CodeT5+ 770M | 76.2 | No | CodeT5+: Open Code Large Language Models for Cod... | 2023-05-13 | Code |
| 5 | CodeT5+ 220M | 76.1 | No | CodeT5+: Open Code Large Language Models for Cod... | 2023-05-13 | Code |
| 6 | GraphCodeBERT | 75.7 | No | GraphCodeBERT: Pre-training Code Representations... | 2020-09-17 | Code |