Composed Image Retrieval (CoIR) on CIRR

Metric: R@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	R@1▼	Extra Data	Paper	Date↕	Code
1	CoVR-BLIP-2	50.43	No	CoVR-2: Automatic Data Construction for Composed...	2023-08-28	Code
2	CoLLM (finetuned - BLIP-L/16)	45.8	No	CoLLM: A Large Language Model for Composed Image...	2025-03-25	Code
3	CoVR-BLIP-2	43.74	No	CoVR-2: Automatic Data Construction for Composed...	2023-08-28	Code
4	ImageScope (CLIP-ViT-L/14)	39.37	No	ImageScope: Unifying Language-Guided Image Retri...	2025-03-13	Code
5	IP-CIR + LDRE (CLIP G/14)	39.25	No	Imagine and Seek: Improving Composed Image Retri...	2024-11-24	-
6	SEIZE (CLIP G/14)	38.87	No	-	-	Code
7	TransAgg (Laion-CIR-Combined)	37.87	No	Zero-shot Composed Text-Image Retrieval	2023-06-12	Code
8	OSrCIR (CLIP G/14)	37.26	No	Reason-before-Retrieve: One-Stage Reflective Cha...	2024-12-15	Code
9	SCOT (WACV 2025)	36.82	No	SCOT: Self-Supervised Contrastive Pretraining Fo...	2025-01-12	-
10	CoLLM (Pretrained - BLIP-L/16)	35	No	CoLLM: A Large Language Model for Composed Image...	2025-03-25	Code
11	CIReVL (CLIP G/14)	34.65	No	Vision-by-Language for Training-Free Composition...	2023-10-13	Code
12	MagicLens (CoCa L)	33.3	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
13	WeiMoCIR (CLIP G/14)	31.04	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
14	WeiMoCIR (CLIP L/14)	30.94	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
15	MagicLens (CLIP L)	30.1	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
16	IP-CIR + LDRE (CLIP L/14)	29.76	No	Imagine and Seek: Improving Composed Image Retri...	2024-11-24	-
17	CoLLM (Pretrained - CLIP-L/14)	29.7	No	CoLLM: A Large Language Model for Composed Image...	2025-03-25	Code
18	OSrCIR (CLIP L/14)	29.45	No	Reason-before-Retrieve: One-Stage Reflective Cha...	2024-12-15	Code
19	WeiMoCIR (CLIP H/14)	29.11	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
20	WeiMoCIR (CLIP B/32)	26.31	No	Training-free Zero-shot Composed Image Retrieval...	2024-09-07	Code
21	OSrCIR (CLIP B/32)	25.42	No	Reason-before-Retrieve: One-Stage Reflective Cha...	2024-12-15	Code
22	CIReVL (CLIP L/14)	24.55	No	Vision-by-Language for Training-Free Composition...	2023-10-13	Code
23	CIReVL (CLIP B/32)	23.94	No	Vision-by-Language for Training-Free Composition...	2023-10-13	Code

#1CoVR-BLIP-2SOTA
50.43
R@1· 2023-08-28
CoVR-2: Automatic Data Construction for Composed Video Retrieval Code
#2CoLLM (finetuned - BLIP-L/16)
45.8
R@1· 2025-03-25
CoLLM: A Large Language Model for Composed Image Retrieval Code
#3CoVR-BLIP-2
43.74
R@1· 2023-08-28
CoVR-2: Automatic Data Construction for Composed Video Retrieval Code
#4ImageScope (CLIP-ViT-L/14)
39.37
R@1· 2025-03-13
ImageScope: Unifying Language-Guided Image Retrieval via Large Multimodal Model Collective Reasoning Code
#5IP-CIR + LDRE (CLIP G/14)
39.25
R@1· 2024-11-24
Imagine and Seek: Improving Composed Image Retrieval with an Imagined Proxy
#6SEIZE (CLIP G/14)
38.87
R@1
No paperCode
#7TransAgg (Laion-CIR-Combined)SOTA
37.87
R@1· 2023-06-12
Zero-shot Composed Text-Image Retrieval Code
#8OSrCIR (CLIP G/14)
37.26
R@1· 2024-12-15
Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrieval Code
#9SCOT (WACV 2025)
36.82
R@1· 2025-01-12
SCOT: Self-Supervised Contrastive Pretraining For Zero-Shot Compositional Retrieval
#10CoLLM (Pretrained - BLIP-L/16)
35
R@1· 2025-03-25
CoLLM: A Large Language Model for Composed Image Retrieval Code
#11CIReVL (CLIP G/14)
34.65
R@1· 2023-10-13
Vision-by-Language for Training-Free Compositional Image Retrieval Code
#12MagicLens (CoCa L)
33.3
R@1· 2024-03-28
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions Code
#13WeiMoCIR (CLIP G/14)
31.04
R@1· 2024-09-07
Training-free Zero-shot Composed Image Retrieval via Weighted Modality Fusion and Similarity Code
#14WeiMoCIR (CLIP L/14)
30.94
R@1· 2024-09-07
Training-free Zero-shot Composed Image Retrieval via Weighted Modality Fusion and Similarity Code
#15MagicLens (CLIP L)
30.1
R@1· 2024-03-28
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions Code
#16IP-CIR + LDRE (CLIP L/14)
29.76
R@1· 2024-11-24
Imagine and Seek: Improving Composed Image Retrieval with an Imagined Proxy
#17CoLLM (Pretrained - CLIP-L/14)
29.7
R@1· 2025-03-25
CoLLM: A Large Language Model for Composed Image Retrieval Code
#18OSrCIR (CLIP L/14)
29.45
R@1· 2024-12-15
Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrieval Code
#19WeiMoCIR (CLIP H/14)
29.11
R@1· 2024-09-07
Training-free Zero-shot Composed Image Retrieval via Weighted Modality Fusion and Similarity Code
#20WeiMoCIR (CLIP B/32)
26.31
R@1· 2024-09-07
Training-free Zero-shot Composed Image Retrieval via Weighted Modality Fusion and Similarity Code
#21OSrCIR (CLIP B/32)
25.42
R@1· 2024-12-15
Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrieval Code
#22CIReVL (CLIP L/14)
24.55
R@1· 2023-10-13
Vision-by-Language for Training-Free Compositional Image Retrieval Code
#23CIReVL (CLIP B/32)
23.94
R@1· 2023-10-13
Vision-by-Language for Training-Free Compositional Image Retrieval Code