Image Retrieval on CIRR

Metric: (Recall@5+Recall_subset@1)/2 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	(Recall@5+Recall_subset@1)/2▼	Extra Data	Paper	Date↕	Code
1	TMCIR	83.46	No	TMCIR: Token Merge Benefits Composed Image Retri...	2025-04-15	-
2	SPN4CIR (SPRC)	82.69	Yes	Improving Composed Image Retrieval via Contrasti...	2024-04-17	Code
3	SPRC2	82.66	No	Sentence-level Prompts Benefit Composed Image Re...	2023-10-09	Code
4	SPRC	81.39	No	Sentence-level Prompts Benefit Composed Image Re...	2023-10-09	Code
5	Candidate Set Re-ranking	80.9	No	Candidate Set Re-ranking for Composed Image Retr...	2023-05-25	Code
6	CaLa	78.74	No	CaLa: Complementary Association Learning for Aug...	2024-05-29	Code
7	CASE (Pre-trained on LaSCo.Ca)	78.25	Yes	Data Roaming and Quality Assessment for Composed...	2023-03-16	Code
8	CASE	77.5	No	Data Roaming and Quality Assessment for Composed...	2023-03-16	Code
9	VISTA (base)	75.9	No	VISTA: Visualized Text Embedding For Universal M...	2024-06-06	Code
10	MMRet-MLLM	75.7	No	MegaPairs: Massive Data Synthesis For Universal ...	2024-12-19	Code
11	TG-CIR (Wen et al., 2023)	75.6	No	-	-	-
12	CLIP4Cir (v3)	75.1	No	Composed Image Retrieval using Contrastive Learn...	2023-08-22	Code
13	BLIP4CIR+Bi	72.59	No	Bi-directional Training for Composed Image Retri...	2023-03-29	Code
14	CLIP4Cir (v2)	69.09	No	-	-	Code
15	CLIP4Cir	63.87	No	-	-	Code
16	CIRPLANT	45.88	No	Image Retrieval on Real-life Images with Pre-tra...	2021-08-09	Code
17	ARTEMIS	43.05	No	ARTEMIS: Attention-based Retrieval with Text-Exp...	2022-03-15	Code

#1TMCIRSOTA
83.46
(Recall@5+Recall_subset@1)/2· 2025-04-15
TMCIR: Token Merge Benefits Composed Image Retrieval
#2SPN4CIR (SPRC)SOTA
82.69
(Recall@5+Recall_subset@1)/2· Extra Data· 2024-04-17
Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negatives Code
#3SPRC2SOTA
82.66
(Recall@5+Recall_subset@1)/2· 2023-10-09
Sentence-level Prompts Benefit Composed Image Retrieval Code
#4SPRC
81.39
(Recall@5+Recall_subset@1)/2· 2023-10-09
Sentence-level Prompts Benefit Composed Image Retrieval Code
#5Candidate Set Re-rankingSOTA
80.9
(Recall@5+Recall_subset@1)/2· 2023-05-25
Candidate Set Re-ranking for Composed Image Retrieval with Dual Multi-modal Encoder Code
#6CaLa
78.74
(Recall@5+Recall_subset@1)/2· 2024-05-29
CaLa: Complementary Association Learning for Augmenting Composed Image Retrieval Code
#7CASE (Pre-trained on LaSCo.Ca)SOTA
78.25
(Recall@5+Recall_subset@1)/2· Extra Data· 2023-03-16
Data Roaming and Quality Assessment for Composed Image Retrieval Code
#8CASE
77.5
(Recall@5+Recall_subset@1)/2· 2023-03-16
Data Roaming and Quality Assessment for Composed Image Retrieval Code
#9VISTA (base)
75.9
(Recall@5+Recall_subset@1)/2· 2024-06-06
VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval Code
#10MMRet-MLLM
75.7
(Recall@5+Recall_subset@1)/2· 2024-12-19
MegaPairs: Massive Data Synthesis For Universal Multimodal Retrieval Code
#11TG-CIR (Wen et al., 2023)
75.6
(Recall@5+Recall_subset@1)/2
No paper
#12CLIP4Cir (v3)
75.1
(Recall@5+Recall_subset@1)/2· 2023-08-22
Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Features Code
#13BLIP4CIR+Bi
72.59
(Recall@5+Recall_subset@1)/2· 2023-03-29
Bi-directional Training for Composed Image Retrieval via Text Prompt Learning Code
#14CLIP4Cir (v2)
69.09
(Recall@5+Recall_subset@1)/2
No paperCode
#15CLIP4Cir
63.87
(Recall@5+Recall_subset@1)/2
No paperCode
#16CIRPLANTSOTA
45.88
(Recall@5+Recall_subset@1)/2· 2021-08-09
Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Models Code
#17ARTEMIS
43.05
(Recall@5+Recall_subset@1)/2· 2022-03-15
ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similarity Code