Cross-Modal Information Retrieval on COCO 2014

Metric: Text-to-image R@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	Text-to-image R@1▼	Extra Data	Paper	Date↕	Code
1	VAST	68	Yes	VAST: A Vision-Audio-Subtitle-Text Omni-Modality...	2023-05-29	Code
2	X2-VLM (large)	67.7	Yes	X$^2$-VLM: All-In-One Pre-trained Model For Visi...	2022-11-22	Code
3	BEiT-3	67.2	Yes	Image as a Foreign Language: BEiT Pretraining fo...	2022-08-22	Code
4	XFM (base)	67	Yes	Toward Building General Foundation Models for La...	2023-01-12	Code
5	X2-VLM (base)	66.2	Yes	X$^2$-VLM: All-In-One Pre-trained Model For Visi...	2022-11-22	Code
6	PTP-BLIP (14M)	64.9	Yes	Position-guided Text Prompt for Vision-Language ...	2022-12-19	Code
7	OmniVL (14M)	64.8	Yes	OmniVL:One Foundation Model for Image-Language a...	2022-09-15	-
8	VSE-Gradient	63.6	Yes	Dissecting Deep Metric Learning Losses for Image...	2022-10-21	Code
9	X-VLM (base)	63.4	Yes	Multi-Grained Vision Language Pre-Training: Alig...	2021-11-16	Code
10	Florence	63.2	Yes	Florence: A New Foundation Model for Computer Vi...	2021-11-22	Code
11	VK-OOD	62.9	Yes	-	-	Code
12	Aurora (ours, r=128)	62.8	Yes	-	-	-
13	DSMD	62.1	No	Dynamic Self-adaptive Multiscale Distillation fr...	2024-04-16	Code
14	VALOR	61.4	Yes	VALOR: Vision-Audio-Language Omni-Perception Pre...	2023-04-17	Code
15	ALBEF	60.7	Yes	Align before Fuse: Vision and Language Represent...	2021-07-16	Code
16	ALIGN	59.9	Yes	Scaling Up Visual and Vision-Language Representa...	2021-02-11	Code
17	ERNIE-ViL 2.0	59.5	Yes	ERNIE-ViL 2.0: Multi-view Contrastive Learning f...	2022-09-30	Code
18	TCL	59	Yes	Vision-Language Pre-Training with Triple Contras...	2022-02-21	Code
19	Oscar	57.5	Yes	Oscar: Object-Semantics Aligned Pre-training for...	2020-04-13	Code
20	METER	57.08	Yes	An Empirical Study of Training End-to-End Vision...	2021-11-03	Code
21	ViSTA	52.6	Yes	ViSTA: Vision and Scene Text Aggregation for Cro...	2022-03-31	-
22	ALADIN	51.3	Yes	ALADIN: Distilling Fine-grained Alignment Scores...	2022-07-29	Code
23	3SHNet	50.3	No	3SHNet: Boosting Image-Sentence Retrieval via Vi...	2024-04-26	Code
24	VisualSparta	44.4	Yes	VisualSparta: An Embarrassingly Simple Approach ...	2021-01-01	Code
25	RCAR	44.3	No	Plug-and-Play Regulators for Image-Text Matching	2023-03-23	Code
26	NAPReg	43	No	-	-	Code
27	ViLT-B/32	42.7	Yes	ViLT: Vision-and-Language Transformer Without Co...	2021-02-05	Code
28	SGRAF	41.9	No	Similarity Reasoning and Filtration for Image-Te...	2021-01-05	Code
29	LILE	41.5	No	LILE: Look In-Depth before Looking Elsewhere -- ...	2022-03-02	-
30	VSRN	40.5	No	Visual Semantic Reasoning for Image-Text Matching	2019-09-06	Code
31	IMRAM	39.7	No	IMRAM: Iterative Matching with Recurrent Attenti...	2020-03-08	Code
32	SCAN	38.6	No	Stacked Cross Attention for Image-Text Matching	2018-03-21	Code
33	SCO (ResNet)	33.1	No	Learning Semantic Concepts and Order for Image a...	2017-12-06	-
34	PVSE	32.4	No	Polysemous Visual-Semantic Embedding for Cross-M...	2019-06-11	Code
35	Dual-Path (ResNet)	25.3	No	Deep Visual-Semantic Alignments for Generating I...	2014-12-07	Code