Composed Image Retrieval (CoIR) on Fashion IQ

Metric: (Recall@10+Recall@50)/2 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	(Recall@10+Recall@50)/2▼	Extra Data	Paper	Date↕	Code
1	CoVR-BLIP-2	60.57	No	CoVR-2: Automatic Data Construction for Composed...	2023-08-28	Code
2	RTD + LinCIR (CLIP G/14)	56.74	No	An Efficient Post-hoc Framework for Reducing Tas...	2024-06-13	Code
3	LinCIR (CLIP G/14)	55.4	No	Language-only Efficient Training of Zero-shot Co...	2023-12-04	Code
4	SEIZE (CLIP G/14)	54.45	No	-	-	Code
5	CoLLM (finetuned - BLIP-L/16)	49.9	No	CoLLM: A Large Language Model for Composed Image...	2025-03-25	Code
6	SCOT (WACV 2025)	49.24	No	SCOT: Self-Supervised Contrastive Pretraining Fo...	2025-01-12	-
7	CoVR-BLIP-2	48.3	No	CoVR-2: Automatic Data Construction for Composed...	2023-08-28	Code
8	MagicLens (CoCa L)	48.1	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
9	OSrCIR (CLIP G/14)	47.34	No	Reason-before-Retrieve: One-Stage Reflective Cha...	2024-12-15	Code
10	WeiMoCIR (CLIP G/14)	47.16	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
11	MTCIR (CLIP L/14)	46.42	No	Pretrain like Your Inference: Masked Tuning Impr...	2023-11-13	Code
12	CompoDiff (CLIP G/14)	45.37	No	CompoDiff: Versatile Composed Image Retrieval Wi...	2023-03-21	Code
13	CoLLM (Pretrained - BLIP-L/16)	45.3	No	CoLLM: A Large Language Model for Composed Image...	2025-03-25	Code
14	MagicLens (CoCa B)	45.3	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
15	TransAgg (Laion-CIR-Combined)	44.75	No	Zero-shot Composed Text-Image Retrieval	2023-06-12	Code
16	WeiMoCIR (CLIP H/14)	44.58	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
17	CompoDiff (CLIP L/14)	44.11	No	CompoDiff: Versatile Composed Image Retrieval Wi...	2023-03-21	Code
18	LDRE (CLIP G/14)	43.98	No	-	-	Code
19	OSrCIR (CLIP B/32)	42.87	No	Reason-before-Retrieve: One-Stage Reflective Cha...	2024-12-15	Code
20	OSrCIR (CLIP L/14)	42.82	No	Reason-before-Retrieve: One-Stage Reflective Cha...	2024-12-15	Code
21	CIReVL (CLIP G/14)	42.28	No	Vision-by-Language for Training-Free Composition...	2023-10-13	Code
22	MagicLens (CLIP L)	41.6	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
23	WeiMoCIR (CLIP L/14)	41.27	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
24	RTD + LinCIR (CLIP L/14)	40.66	No	An Efficient Post-hoc Framework for Reducing Tas...	2024-06-13	Code
25	WeiMoCIR (CLIP B/32)	39.84	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
26	CoLLM (Pretrained - CLIP-L/14)	39.8	No	CoLLM: A Large Language Model for Composed Image...	2025-03-25	Code
27	iSEARLE-XL-OTI (CLIP L/14)	39.39	No	iSEARLE: Improving Textual Inversion for Zero-Sh...	2024-05-05	Code
28	CIReVL (CLIP B/32)	38.82	No	Vision-by-Language for Training-Free Composition...	2023-10-13	Code
29	CIReVL (CLIP L/14)	38.56	No	Vision-by-Language for Training-Free Composition...	2023-10-13	Code
30	Context-I2W (CLIP L/14)	38.35	No	Context-I2W: Mapping Images to Context-dependent...	2023-09-28	Code
31	iSEARLE-XL (CLIP L/14)	38.24	No	iSEARLE: Improving Textual Inversion for Zero-Sh...	2024-05-05	Code
32	SEARLE-XL-OTI (CLIP L/14)	37.76	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code
33	MagicLens (CLIP B)	36.85	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
34	LinCIR (CLIP L/14)	36.39	No	Language-only Efficient Training of Zero-shot Co...	2023-12-04	Code
35	SEARLE-XL (CLIP L/14)	35.9	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code
36	iSEARLE-OTI (CLIP B/32)	34.93	No	iSEARLE: Improving Textual Inversion for Zero-Sh...	2024-05-05	Code
37	iSEARLE (CLIP B/32)	34.6	No	iSEARLE: Improving Textual Inversion for Zero-Sh...	2024-05-05	Code
38	Pic2Word	34.2	No	Pic2Word: Mapping Pictures to Words for Zero-sho...	2023-02-06	Code
39	SEARLE (CLIP B/32)	32.71	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code
40	SEARLE-OTI (CLIP B/32)	32.39	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code
41	PALAVRA	28.51	No	"This is my unicorn, Fluffy": Personalizing froz...	2022-04-04	Code

#1CoVR-BLIP-2SOTA
60.57
(Recall@10+Recall@50)/2· 2023-08-28
CoVR-2: Automatic Data Construction for Composed Video Retrieval Code
#2RTD + LinCIR (CLIP G/14)
56.74
(Recall@10+Recall@50)/2· 2024-06-13
An Efficient Post-hoc Framework for Reducing Task Discrepancy of Text Encoders for Composed Image Retrieval Code
#3LinCIR (CLIP G/14)
55.4
(Recall@10+Recall@50)/2· 2023-12-04
Language-only Efficient Training of Zero-shot Composed Image Retrieval Code
#4SEIZE (CLIP G/14)
54.45
(Recall@10+Recall@50)/2
No paperCode
#5CoLLM (finetuned - BLIP-L/16)
49.9
(Recall@10+Recall@50)/2· 2025-03-25
CoLLM: A Large Language Model for Composed Image Retrieval Code
#6SCOT (WACV 2025)
49.24
(Recall@10+Recall@50)/2· 2025-01-12
SCOT: Self-Supervised Contrastive Pretraining For Zero-Shot Compositional Retrieval
#7CoVR-BLIP-2
48.3
(Recall@10+Recall@50)/2· 2023-08-28
CoVR-2: Automatic Data Construction for Composed Video Retrieval Code
#8MagicLens (CoCa L)
48.1
(Recall@10+Recall@50)/2· 2024-03-28
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions Code
#9OSrCIR (CLIP G/14)
47.34
(Recall@10+Recall@50)/2· 2024-12-15
Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrieval Code
#10WeiMoCIR (CLIP G/14)
47.16
(Recall@10+Recall@50)/2· 2024-09-07
Training-free Zero-shot Composed Image Retrieval via Weighted Modality Fusion and Similarity Code
#11MTCIR (CLIP L/14)
46.42
(Recall@10+Recall@50)/2· 2023-11-13
Pretrain like Your Inference: Masked Tuning Improves Zero-Shot Composed Image Retrieval Code
#12CompoDiff (CLIP G/14)SOTA
45.37
(Recall@10+Recall@50)/2· 2023-03-21
CompoDiff: Versatile Composed Image Retrieval With Latent Diffusion Code
#13CoLLM (Pretrained - BLIP-L/16)
45.3
(Recall@10+Recall@50)/2· 2025-03-25
CoLLM: A Large Language Model for Composed Image Retrieval Code
#14MagicLens (CoCa B)
45.3
(Recall@10+Recall@50)/2· 2024-03-28
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions Code
#15TransAgg (Laion-CIR-Combined)
44.75
(Recall@10+Recall@50)/2· 2023-06-12
Zero-shot Composed Text-Image Retrieval Code
#16WeiMoCIR (CLIP H/14)
44.58
(Recall@10+Recall@50)/2· 2024-09-07
Training-free Zero-shot Composed Image Retrieval via Weighted Modality Fusion and Similarity Code
#17CompoDiff (CLIP L/14)
44.11
(Recall@10+Recall@50)/2· 2023-03-21
CompoDiff: Versatile Composed Image Retrieval With Latent Diffusion Code
#18LDRE (CLIP G/14)
43.98
(Recall@10+Recall@50)/2
No paperCode
#19OSrCIR (CLIP B/32)
42.87
(Recall@10+Recall@50)/2· 2024-12-15
Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrieval Code
#20OSrCIR (CLIP L/14)
42.82
(Recall@10+Recall@50)/2· 2024-12-15
Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrieval Code
#21CIReVL (CLIP G/14)
42.28
(Recall@10+Recall@50)/2· 2023-10-13
Vision-by-Language for Training-Free Compositional Image Retrieval Code
#22MagicLens (CLIP L)
41.6
(Recall@10+Recall@50)/2· 2024-03-28
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions Code
#23WeiMoCIR (CLIP L/14)
41.27
(Recall@10+Recall@50)/2· 2024-09-07
Training-free Zero-shot Composed Image Retrieval via Weighted Modality Fusion and Similarity Code
#24RTD + LinCIR (CLIP L/14)
40.66
(Recall@10+Recall@50)/2· 2024-06-13
An Efficient Post-hoc Framework for Reducing Task Discrepancy of Text Encoders for Composed Image Retrieval Code
#25WeiMoCIR (CLIP B/32)
39.84
(Recall@10+Recall@50)/2· 2024-09-07
Training-free Zero-shot Composed Image Retrieval via Weighted Modality Fusion and Similarity Code
#26CoLLM (Pretrained - CLIP-L/14)
39.8
(Recall@10+Recall@50)/2· 2025-03-25
CoLLM: A Large Language Model for Composed Image Retrieval Code
#27iSEARLE-XL-OTI (CLIP L/14)
39.39
(Recall@10+Recall@50)/2· 2024-05-05
iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval Code
#28CIReVL (CLIP B/32)
38.82
(Recall@10+Recall@50)/2· 2023-10-13
Vision-by-Language for Training-Free Compositional Image Retrieval Code
#29CIReVL (CLIP L/14)
38.56
(Recall@10+Recall@50)/2· 2023-10-13
Vision-by-Language for Training-Free Compositional Image Retrieval Code
#30Context-I2W (CLIP L/14)
38.35
(Recall@10+Recall@50)/2· 2023-09-28
Context-I2W: Mapping Images to Context-dependent Words for Accurate Zero-Shot Composed Image Retrieval Code
#31iSEARLE-XL (CLIP L/14)
38.24
(Recall@10+Recall@50)/2· 2024-05-05
iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval Code
#32SEARLE-XL-OTI (CLIP L/14)
37.76
(Recall@10+Recall@50)/2· 2023-03-27
Zero-Shot Composed Image Retrieval with Textual Inversion Code
#33MagicLens (CLIP B)
36.85
(Recall@10+Recall@50)/2· 2024-03-28
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions Code
#34LinCIR (CLIP L/14)
36.39
(Recall@10+Recall@50)/2· 2023-12-04
Language-only Efficient Training of Zero-shot Composed Image Retrieval Code
#35SEARLE-XL (CLIP L/14)
35.9
(Recall@10+Recall@50)/2· 2023-03-27
Zero-Shot Composed Image Retrieval with Textual Inversion Code
#36iSEARLE-OTI (CLIP B/32)
34.93
(Recall@10+Recall@50)/2· 2024-05-05
iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval Code
#37iSEARLE (CLIP B/32)
34.6
(Recall@10+Recall@50)/2· 2024-05-05
iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval Code
#38Pic2WordSOTA
34.2
(Recall@10+Recall@50)/2· 2023-02-06
Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrieval Code
#39SEARLE (CLIP B/32)
32.71
(Recall@10+Recall@50)/2· 2023-03-27
Zero-Shot Composed Image Retrieval with Textual Inversion Code
#40SEARLE-OTI (CLIP B/32)
32.39
(Recall@10+Recall@50)/2· 2023-03-27
Zero-Shot Composed Image Retrieval with Textual Inversion Code
#41PALAVRASOTA
28.51
(Recall@10+Recall@50)/2· 2022-04-04
"This is my unicorn, Fluffy": Personalizing frozen vision-language representations Code