Video Retrieval on MSR-VTT-1kA

Metric: text-to-video Mean Rank (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video Mean Rank▼	Extra Data	Paper	Date↕	Code
1	Collaborative Experts	28.2	Yes	Use What You Have: Video Retrieval Using Represe...	2019-07-31	Code
2	MMT	26.7	No	Multi-modal Transformer for Video Retrieval	2020-07-21	Code
3	MMT-Pretrained	24	Yes	Multi-modal Transformer for Video Retrieval	2020-07-21	Code
4	MDMMT	16.5	Yes	MDMMT: Multidomain Multimodal Transformer for Vi...	2021-03-19	Code
5	CLIP4Clip	15.3	Yes	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
6	CLIP2Video	14.6	Yes	CLIP2Video: Mastering Video-Text Retrieval via I...	2021-06-21	Code
7	X-Pool	14.3	Yes	X-Pool: Cross-Modal Language-Video Attention for...	2022-03-28	Code
8	PAU	14	No	Prototype-based Aleatoric Uncertainty Quantifica...	2023-09-29	Code
9	CenterCLIP (ViT-B/16)	13.8	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
10	CLIP2TV	12.8	Yes	CLIP2TV: Align, Match and Distill for Video-Text...	2021-11-10	-
11	Side4Video	12.8	No	Side4Video: Spatial-Temporal Side Network for Me...	2023-11-27	Code
12	Cap4Video	12.4	No	Cap4Video: What Can Auxiliary Captions Do for Te...	2022-12-31	Code
13	CAMoE	12.4	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
14	X-CLIP	12.2	No	X-CLIP: End-to-End Multi-grained Contrastive Lea...	2022-07-15	Code
15	DiffusionRet	12.1	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
16	DiffusionRet+QB-Norm	12.1	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
17	HBI	12	No	Video-Text as Game Players: Hierarchical Banzhaf...	2023-03-25	Code
18	DRL	11.4	Yes	Disentangled Representation Learning for Text-Vi...	2022-03-14	Code
19	PIDRo	10.7	No	-	-	-
20	DMAE (ViT-B/16)	10	No	Dual-Modal Attention-Enhanced Text-Video Retriev...	2023-09-20	Code
21	HunYuan_tvr (huge)	9.3	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
22	EMCL-Net	2	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
23	EMCL-Net++	1	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code

#1Collaborative ExpertsSOTA
28.2
text-to-video Mean Rank· Extra Data· 2019-07-31
Use What You Have: Video Retrieval Using Representations From Collaborative Experts Code
#2MMT
26.7
text-to-video Mean Rank· 2020-07-21
Multi-modal Transformer for Video Retrieval Code
#3MMT-Pretrained
24
text-to-video Mean Rank· Extra Data· 2020-07-21
Multi-modal Transformer for Video Retrieval Code
#4MDMMT
16.5
text-to-video Mean Rank· Extra Data· 2021-03-19
MDMMT: Multidomain Multimodal Transformer for Video Retrieval Code
#5CLIP4Clip
15.3
text-to-video Mean Rank· Extra Data· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#6CLIP2Video
14.6
text-to-video Mean Rank· Extra Data· 2021-06-21
CLIP2Video: Mastering Video-Text Retrieval via Image CLIP Code
#7X-Pool
14.3
text-to-video Mean Rank· Extra Data· 2022-03-28
X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval Code
#8PAU
14
text-to-video Mean Rank· 2023-09-29
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval Code
#9CenterCLIP (ViT-B/16)
13.8
text-to-video Mean Rank· Extra Data· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval Code
#10CLIP2TV
12.8
text-to-video Mean Rank· Extra Data· 2021-11-10
CLIP2TV: Align, Match and Distill for Video-Text Retrieval
#11Side4Video
12.8
text-to-video Mean Rank· 2023-11-27
Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer Learning Code
#12Cap4Video
12.4
text-to-video Mean Rank· 2022-12-31
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?Code
#13CAMoE
12.4
text-to-video Mean Rank· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code
#14X-CLIP
12.2
text-to-video Mean Rank· 2022-07-15
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval Code
#15DiffusionRet
12.1
text-to-video Mean Rank· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#16DiffusionRet+QB-Norm
12.1
text-to-video Mean Rank· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#17HBI
12
text-to-video Mean Rank· 2023-03-25
Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning Code
#18DRL
11.4
text-to-video Mean Rank· Extra Data· 2022-03-14
Disentangled Representation Learning for Text-Video Retrieval Code
#19PIDRo
10.7
text-to-video Mean Rank
No paper
#20DMAE (ViT-B/16)
10
text-to-video Mean Rank· 2023-09-20
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning Code
#21HunYuan_tvr (huge)
9.3
text-to-video Mean Rank· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#22EMCL-Net
2
text-to-video Mean Rank· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code
#23EMCL-Net++
1
text-to-video Mean Rank· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code