Composed Image Retrieval (CoIR) on ImageNet-R

Metric: (Recall@10+Recall@50)/2 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	(Recall@10+Recall@50)/2▼	Extra Data	Paper	Date↕	Code
1	MagicLens (CoCa L)	52.95	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
2	MagicLens (CoCa B)	51.75	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
3	MagicLens (CLIP L)	48	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
4	MagicLens (CLIP B)	36.4	No	MagicLens: Self-Supervised Image Retrieval with ...	2024-03-28	Code
5	iSEARLE-XL (CLIP L/14)	24.46	No	iSEARLE: Improving Textual Inversion for Zero-Sh...	2024-05-05	Code
6	LinCIR (CLIP L/14)	21.64	No	Language-only Efficient Training of Zero-shot Co...	2023-12-04	Code
7	SEARLE-XL (CLIP L/14)	21.54	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code
8	SEARLE-XL-OTI (CLIP B/32)	20.42	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code
9	Context-I2W	20.25	No	Context-I2W: Mapping Images to Context-dependent...	2023-09-28	Code
10	Pic2Word	16.65	No	Pic2Word: Mapping Pictures to Words for Zero-sho...	2023-02-06	Code
11	iSEARLE (CLIP B/32)	16.01	No	iSEARLE: Improving Textual Inversion for Zero-Sh...	2024-05-05	Code
12	iSEARLE-OTI (CLIP B/32)	15.62	No	iSEARLE: Improving Textual Inversion for Zero-Sh...	2024-05-05	Code
13	SEARLE-OTI (CLIP B/32)	12.77	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code
14	SEARLE (CLIP B/32)	11.94	No	Zero-Shot Composed Image Retrieval with Textual ...	2023-03-27	Code

#1MagicLens (CoCa L)SOTA
52.95
(Recall@10+Recall@50)/2· 2024-03-28
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions Code
#2MagicLens (CoCa B)
51.75
(Recall@10+Recall@50)/2· 2024-03-28
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions Code
#3MagicLens (CLIP L)
48
(Recall@10+Recall@50)/2· 2024-03-28
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions Code
#4MagicLens (CLIP B)
36.4
(Recall@10+Recall@50)/2· 2024-03-28
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions Code
#5iSEARLE-XL (CLIP L/14)
24.46
(Recall@10+Recall@50)/2· 2024-05-05
iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval Code
#6LinCIR (CLIP L/14)SOTA
21.64
(Recall@10+Recall@50)/2· 2023-12-04
Language-only Efficient Training of Zero-shot Composed Image Retrieval Code
#7SEARLE-XL (CLIP L/14)SOTA
21.54
(Recall@10+Recall@50)/2· 2023-03-27
Zero-Shot Composed Image Retrieval with Textual Inversion Code
#8SEARLE-XL-OTI (CLIP B/32)
20.42
(Recall@10+Recall@50)/2· 2023-03-27
Zero-Shot Composed Image Retrieval with Textual Inversion Code
#9Context-I2W
20.25
(Recall@10+Recall@50)/2· 2023-09-28
Context-I2W: Mapping Images to Context-dependent Words for Accurate Zero-Shot Composed Image Retrieval Code
#10Pic2WordSOTA
16.65
(Recall@10+Recall@50)/2· 2023-02-06
Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrieval Code
#11iSEARLE (CLIP B/32)
16.01
(Recall@10+Recall@50)/2· 2024-05-05
iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval Code
#12iSEARLE-OTI (CLIP B/32)
15.62
(Recall@10+Recall@50)/2· 2024-05-05
iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval Code
#13SEARLE-OTI (CLIP B/32)
12.77
(Recall@10+Recall@50)/2· 2023-03-27
Zero-Shot Composed Image Retrieval with Textual Inversion Code
#14SEARLE (CLIP B/32)
11.94
(Recall@10+Recall@50)/2· 2023-03-27
Zero-Shot Composed Image Retrieval with Textual Inversion Code