Video on MSVD

Metric: text-to-video Mean Rank (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video Mean Rank▼	Extra Data	Paper	Date↕	Code
1	Collaborative Experts	23.1	No	Use What You Have: Video Retrieval Using Represe...	2019-07-31	Code
2	DiffusionRet	15.7	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
3	DiffusionRet+QB-Norm	15.6	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
4	CLIP4Clip	10	Yes	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
5	DMAE (ViT-B/32)	9.8	No	Dual-Modal Attention-Enhanced Text-Video Retriev...	2023-09-20	Code
6	PAU	9.6	No	Prototype-based Aleatoric Uncertainty Quantifica...	2023-09-29	Code
7	X-Pool	9.3	Yes	X-Pool: Cross-Modal Language-Video Attention for...	2022-03-28	Code
8	CAMoE	8.9	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
9	MDMMT-2	8.8	Yes	MDMMT-2: Multidomain Multimodal Transformer for ...	2022-03-14	-
10	Side4Video	8.4	No	Side4Video: Spatial-Temporal Side Network for Me...	2023-11-27	Code
11	CenterCLIP (ViT-B/16)	8.4	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
12	X-CLIP	8.4	No	X-CLIP: End-to-End Multi-grained Contrastive Lea...	2022-07-15	Code
13	Cap4Video	8.3	No	Cap4Video: What Can Auxiliary Captions Do for Te...	2022-12-31	Code
14	HunYuan_tvr	7.8	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
15	HunYuan_tvr (huge)	7.6	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-

#1Collaborative ExpertsSOTA
23.1
text-to-video Mean Rank· 2019-07-31
Use What You Have: Video Retrieval Using Representations From Collaborative Experts Code
#2DiffusionRet
15.7
text-to-video Mean Rank· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#3DiffusionRet+QB-Norm
15.6
text-to-video Mean Rank· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#4CLIP4Clip
10
text-to-video Mean Rank· Extra Data· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#5DMAE (ViT-B/32)
9.8
text-to-video Mean Rank· 2023-09-20
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning Code
#6PAU
9.6
text-to-video Mean Rank· 2023-09-29
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval Code
#7X-Pool
9.3
text-to-video Mean Rank· Extra Data· 2022-03-28
X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval Code
#8CAMoE
8.9
text-to-video Mean Rank· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code
#9MDMMT-2
8.8
text-to-video Mean Rank· Extra Data· 2022-03-14
MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization
#10Side4Video
8.4
text-to-video Mean Rank· 2023-11-27
Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer Learning Code
#11CenterCLIP (ViT-B/16)
8.4
text-to-video Mean Rank· Extra Data· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval Code
#12X-CLIP
8.4
text-to-video Mean Rank· 2022-07-15
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval Code
#13Cap4Video
8.3
text-to-video Mean Rank· 2022-12-31
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?Code
#14HunYuan_tvr
7.8
text-to-video Mean Rank· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#15HunYuan_tvr (huge)
7.6
text-to-video Mean Rank· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations