Metric: PHP (higher is better)
| # | Model↕ | PHP▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | cpt-code M | 97.2 | No | Text and Code Embeddings by Contrastive Pre-Trai... | 2022-01-24 | Code |
| 2 | cpt-code S | 96.7 | No | Text and Code Embeddings by Contrastive Pre-Trai... | 2022-01-24 | Code |
| 3 | GraphCodeBERT | 72.5 | No | GraphCodeBERT: Pre-training Code Representations... | 2020-09-17 | Code |
| 4 | CodeBERT | 70.6 | No | CodeBERT: A Pre-Trained Model for Programming an... | 2020-02-19 | Code |
| 5 | CodeT5+ 770M | 70.1 | No | CodeT5+: Open Code Large Language Models for Cod... | 2023-05-13 | Code |
| 6 | CodeT5+ 220M | 69.8 | No | CodeT5+: Open Code Large Language Models for Cod... | 2023-05-13 | Code |