Image-to-Text Retrieval on Flickr30k

Metric: Recall@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Recall@1▼	Extra Data	Paper	Date↕	Code
1	InternVL-G-FT (finetuned, w/o ranking)	97.9	No	InternVL: Scaling up Vision Foundation Models an...	2023-12-21	Code
2	BLIP-2 ViT-G (zero-shot, 1K test set)	97.6	No	BLIP-2: Bootstrapping Language-Image Pre-trainin...	2023-01-30	Code
3	ONE-PEACE (finetuned, w/o ranking)	97.6	No	ONE-PEACE: Exploring One General Representation ...	2023-05-18	Code
4	InternVL-C-FT (finetuned, w/o ranking)	97.2	No	InternVL: Scaling up Vision Foundation Models an...	2023-12-21	Code
5	BLIP-2 ViT-L (zero-shot, 1K test set)	96.9	No	BLIP-2: Bootstrapping Language-Image Pre-trainin...	2023-01-30	Code
6	ERNIE-ViL 2.0	96.1	No	ERNIE-ViL 2.0: Multi-view Contrastive Learning f...	2022-09-30	Code
7	ALBEF	95.9	No	Align before Fuse: Vision and Language Represent...	2021-07-16	Code
8	ALBEF	92.6	No	HADA: A Graph-based Amalgamation Framework in Im...	2023-01-11	Code
9	UNITER	87.3	No	HADA: A Graph-based Amalgamation Framework in Im...	2023-01-11	Code
10	GSMN	76.4	No	A Deep Local and Global Scene-Graph Matching for...	2021-06-04	Code
11	LGSGM	71	No	A Deep Local and Global Scene-Graph Matching for...	2021-06-04	Code

#1InternVL-G-FT (finetuned, w/o ranking)SOTA
97.9
Recall@1· 2023-12-21
InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks Code
#2BLIP-2 ViT-G (zero-shot, 1K test set)SOTA
97.6
Recall@1· 2023-01-30
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Code
#3ONE-PEACE (finetuned, w/o ranking)
97.6
Recall@1· 2023-05-18
ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities Code
#4InternVL-C-FT (finetuned, w/o ranking)
97.2
Recall@1· 2023-12-21
InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks Code
#5BLIP-2 ViT-L (zero-shot, 1K test set)
96.9
Recall@1· 2023-01-30
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Code
#6ERNIE-ViL 2.0SOTA
96.1
Recall@1· 2022-09-30
ERNIE-ViL 2.0: Multi-view Contrastive Learning for Image-Text Pre-training Code
#7ALBEFSOTA
95.9
Recall@1· 2021-07-16
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation Code
#8ALBEF
92.6
Recall@1· 2023-01-11
HADA: A Graph-based Amalgamation Framework in Image-text Retrieval Code
#9UNITER
87.3
Recall@1· 2023-01-11
HADA: A Graph-based Amalgamation Framework in Image-text Retrieval Code
#10GSMNSOTA
76.4
Recall@1· 2021-06-04
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval Code
#11LGSGM
71
Recall@1· 2021-06-04
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval Code