Composed Image Retrieval (CoIR) on Fashion IQ

Metric: (Recall@10+Recall@50)/2 (higher is better)

LeaderboardDataset

Loading chart...

Results

#	Model↕	(Recall@10+Recall@50)/2▼	Extra Data	Paper	Date↕	Code
1	CoVR-BLIP-2	60.57	No	CoVR-2: Automatic Data Construction for Composed...	2023-08-28	Code
2	RTD + LinCIR (CLIP G/14)	56.74	No	An Efficient Post-hoc Framework for Reducing Tas...	2024-06-13	Code
3	LinCIR (CLIP G/14)	55.4	No	Language-only Efficient Training of Zero-shot Co...	2023-12-04	Code
4	SEIZE (CLIP G/14)	54.45	No	-	-	Code
5	CoLLM (finetuned - BLIP-L/16)	49.9	No	CoLLM: A Large Language Model for Composed Image...	2025-03-25	Code
6	SCOT (WACV 2025)	49.24	No	SCOT: Self-Supervised Contrastive Pretraining Fo...	2025-01-12	-
7	CoVR-BLIP-2	48.3	No	CoVR-2: Automatic Data Construction for Composed...	2023-08-28	Code
8	MagicLens (CoCa L)	48.1	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
9	OSrCIR (CLIP G/14)	47.34	No	Reason-before-Retrieve: One-Stage Reflective Cha...	2024-12-15	Code
10	WeiMoCIR (CLIP G/14)	47.16	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
11	MTCIR (CLIP L/14)	46.42	No	Pretrain like Your Inference: Masked Tuning Impr...	2023-11-13	Code
12	CompoDiff (CLIP G/14)	45.37	No	CompoDiff: Versatile Composed Image Retrieval Wi...	2023-03-21	Code
13	CoLLM (Pretrained - BLIP-L/16)	45.3	No	CoLLM: A Large Language Model for Composed Image...	2025-03-25	Code
14	MagicLens (CoCa B)	45.3	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
15	TransAgg (Laion-CIR-Combined)	44.75	No	Zero-shot Composed Text-Image Retrieval	2023-06-12	Code
16	WeiMoCIR (CLIP H/14)	44.58	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
17	CompoDiff (CLIP L/14)	44.11	No	CompoDiff: Versatile Composed Image Retrieval Wi...	2023-03-21	Code
18	LDRE (CLIP G/14)	43.98	No	-	-	Code
19	OSrCIR (CLIP B/32)	42.87	No	Reason-before-Retrieve: One-Stage Reflective Cha...	2024-12-15	Code
20	OSrCIR (CLIP L/14)	42.82	No	Reason-before-Retrieve: One-Stage Reflective Cha...	2024-12-15	Code
21	CIReVL (CLIP G/14)	42.28	No	Vision-by-Language for Training-Free Composition...	2023-10-13	Code
22	MagicLens (CLIP L)	41.6	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
23	WeiMoCIR (CLIP L/14)	41.27	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
24	RTD + LinCIR (CLIP L/14)	40.66	No	An Efficient Post-hoc Framework for Reducing Tas...	2024-06-13	Code
25	WeiMoCIR (CLIP B/32)	39.84	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
26	CoLLM (Pretrained - CLIP-L/14)	39.8	No	CoLLM: A Large Language Model for Composed Image...	2025-03-25	Code
27	iSEARLE-XL-OTI (CLIP L/14)	39.39	No	iSEARLE: Improving Textual Inversion for Zero-Sh...	2024-05-05	Code
28	CIReVL (CLIP B/32)	38.82	No	Vision-by-Language for Training-Free Composition...	2023-10-13	Code
29	CIReVL (CLIP L/14)	38.56	No	Vision-by-Language for Training-Free Composition...	2023-10-13	Code
30	Context-I2W (CLIP L/14)	38.35	No	Context-I2W: Mapping Images to Context-dependent...	2023-09-28	Code
31	iSEARLE-XL (CLIP L/14)	38.24	No	iSEARLE: Improving Textual Inversion for Zero-Sh...	2024-05-05	Code
32	SEARLE-XL-OTI (CLIP L/14)	37.76	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code
33	MagicLens (CLIP B)	36.85	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
34	LinCIR (CLIP L/14)	36.39	No	Language-only Efficient Training of Zero-shot Co...	2023-12-04	Code
35	SEARLE-XL (CLIP L/14)	35.9	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code
36	iSEARLE-OTI (CLIP B/32)	34.93	No	iSEARLE: Improving Textual Inversion for Zero-Sh...	2024-05-05	Code
37	iSEARLE (CLIP B/32)	34.6	No	iSEARLE: Improving Textual Inversion for Zero-Sh...	2024-05-05	Code
38	Pic2Word	34.2	No	Pic2Word: Mapping Pictures to Words for Zero-sho...	2023-02-06	Code
39	SEARLE (CLIP B/32)	32.71	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code
40	SEARLE-OTI (CLIP B/32)	32.39	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code
41	PALAVRA	28.51	No	"This is my unicorn, Fluffy": Personalizing froz...	2022-04-04	Code