Cross-Modal Information Retrieval on Flickr30k

Metric: Text-to-image R@10 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	Text-to-image R@10▼	Extra Data	Paper	Date↕	Code
1	ERNIE-ViL 2.0	99.8	Yes	ERNIE-ViL 2.0: Multi-view Contrastive Learning f...	2022-09-30	Code
2	X2-VLM (large)	99.5	Yes	X$^2$-VLM: All-In-One Pre-trained Model For Visi...	2022-11-22	Code
3	BEiT-3	99.5	Yes	Image as a Foreign Language: BEiT Pretraining fo...	2022-08-22	Code
4	VAST	99.5	Yes	VAST: A Vision-Audio-Subtitle-Text Omni-Modality...	2023-05-29	Code
5	X2-VLM (base)	99.3	Yes	X$^2$-VLM: All-In-One Pre-trained Model For Visi...	2022-11-22	Code
6	OmniVL (14M)	99.1	Yes	OmniVL:One Foundation Model for Image-Language a...	2022-09-15	-
7	VSE-Gradient	99	Yes	Dissecting Deep Metric Learning Losses for Image...	2022-10-21	Code
8	Aurora (ours, r=128)	98.9	Yes	-	-	-
9	X-VLM (base)	98.7	Yes	Multi-Grained Vision Language Pre-Training: Alig...	2021-11-16	Code
10	ALIGN	98.6	Yes	Scaling Up Visual and Vision-Language Representa...	2021-02-11	Code
11	ViSTA	96.9	Yes	ViSTA: Vision and Scene Text Aggregation for Cro...	2022-03-31	-
12	IAIS	95.72	Yes	Learning Relation Alignment for Calibrated Cross...	2021-05-28	Code
13	3SHNet	94.7	No	3SHNet: Boosting Image-Sentence Retrieval via Vi...	2024-04-26	Code
14	DSMD	94.4	No	Dynamic Self-adaptive Multiscale Distillation fr...	2024-04-16	Code
15	ViLT-B/32	93.8	Yes	ViLT: Vision-and-Language Transformer Without Co...	2021-02-05	Code
16	RCAR	91.1	No	Plug-and-Play Regulators for Image-Text Matching	2023-03-23	Code
17	GSMN	89	No	Graph Structured Network for Image-Text Matching	2020-04-01	Code
18	SGRAF	88.8	No	Similarity Reasoning and Filtration for Image-Te...	2021-01-05	Code
19	Pearl	88.26	No	-	-	-
20	IMRAM	87.2	No	IMRAM: Iterative Matching with Recurrent Attenti...	2020-03-08	Code
21	SCAN	85.2	No	Stacked Cross Attention for Image-Text Matching	2018-03-21	Code
22	Dual-Path (ResNet)	80.9	No	Dual-Path Convolutional Image-Text Embeddings wi...	2017-11-15	Code
23	SCO (ResNet)	80.1	No	Learning Semantic Concepts and Order for Image a...	2017-12-06	-
24	VSE++ (ResNet)	79.5	No	VSE++: Improving Visual-Semantic Embeddings with...	2017-07-18	Code
25	CMPL (ResNet)	75.5	No	-	-	Code