Image Retrieval on CREPE (Compositional REPresentation Evaluation)
Metric: Recall@1 (HN-Atom + HN-Comp, SC) (higher is better)
Metric: Recall@1 (HN-Atom + HN-Comp, SC) (higher is better)
| # | Model↕ | Recall@1 (HN-Atom + HN-Comp, SC)▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | ViT-L-14 (LAION400M) | 39.44 | No | CREPE: Can Vision-Language Foundation Models Rea... | 2022-12-13 | Code |
| 2 | ViT-B-16+240 (LAION400M) | 37.32 | No | CREPE: Can Vision-Language Foundation Models Rea... | 2022-12-13 | Code |
| 3 | ViT-B-16 (LAION400M) | 37.01 | No | CREPE: Can Vision-Language Foundation Models Rea... | 2022-12-13 | Code |
| 4 | ViT-B-32 (LAION400M) | 34.28 | No | CREPE: Can Vision-Language Foundation Models Rea... | 2022-12-13 | Code |
| 5 | RN50 (YFCC15M) | 23.38 | No | CREPE: Can Vision-Language Foundation Models Rea... | 2022-12-13 | Code |
| 6 | RN50 (CC12M) | 23.26 | No | CREPE: Can Vision-Language Foundation Models Rea... | 2022-12-13 | Code |
| 7 | RN101 (YFCC15M) | 22.74 | No | CREPE: Can Vision-Language Foundation Models Rea... | 2022-12-13 | Code |
| 8 | Random | 9.09 | No | CREPE: Can Vision-Language Foundation Models Rea... | 2022-12-13 | Code |