Video Retrieval on MSR-VTT-1kA

Metric: video-to-text R@10 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	video-to-text R@10▼	Extra Data	Paper	Date↕	Code
1	HunYuan_tvr (huge)	91.1	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
2	EMCL-Net++	88	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
3	DRL	87.4	Yes	Disentangled Representation Learning for Text-Vi...	2022-03-14	Code
4	PIDRo	87.3	No	-	-	-
5	DMAE (ViT-B/16)	87.2	No	Dual-Modal Attention-Enhanced Text-Video Retriev...	2023-09-20	Code
6	HunYuan_tvr	85.8	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
7	CLIP2TV	85.7	Yes	CLIP2TV: Align, Match and Distill for Video-Text...	2021-11-10	-
8	Cap4Video	85	No	Cap4Video: What Can Auxiliary Captions Do for Te...	2022-12-31	Code
9	X-CLIP	84.5	No	X-CLIP: End-to-End Multi-grained Contrastive Lea...	2022-07-15	Code
10	DiffusionRet	84.5	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
11	SuMA (ViT-B/16)	84.3	No	Video-Text Retrieval by Supervised Sparse Multi-...	2023-02-19	Code
12	HBI	84.3	No	Video-Text as Game Players: Hierarchical Banzhaf...	2023-03-25	Code
13	X-Pool	84	Yes	X-Pool: Cross-Modal Language-Video Attention for...	2022-03-28	Code
14	DiffusionRet+QB-Norm	83.8	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
15	CAMoE	83.8	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
16	EMCL-Net	83.5	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
17	CenterCLIP (ViT-B/16)	83.3	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
18	PAU	83.2	No	Prototype-based Aleatoric Uncertainty Quantifica...	2023-09-29	Code
19	UCoFiA	83	No	Unified Coarse-to-Fine Alignment for Video-Text ...	2023-09-18	Code
20	CLIP2Video	82.1	Yes	CLIP2Video: Mastering Video-Text Retrieval via I...	2021-06-21	Code
21	CLIP4Clip	80.6	Yes	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
22	CLIP	62.6	Yes	A Straightforward Framework For Video Retrieval ...	2021-02-24	Code

#1HunYuan_tvr (huge)SOTA
91.1
video-to-text R@10· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#2EMCL-Net++
88
video-to-text R@10· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code
#3DRLSOTA
87.4
video-to-text R@10· Extra Data· 2022-03-14
Disentangled Representation Learning for Text-Video Retrieval Code
#4PIDRo
87.3
video-to-text R@10
No paper
#5DMAE (ViT-B/16)
87.2
video-to-text R@10· 2023-09-20
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning Code
#6HunYuan_tvr
85.8
video-to-text R@10· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#7CLIP2TVSOTA
85.7
video-to-text R@10· Extra Data· 2021-11-10
CLIP2TV: Align, Match and Distill for Video-Text Retrieval
#8Cap4Video
85
video-to-text R@10· 2022-12-31
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?Code
#9X-CLIP
84.5
video-to-text R@10· 2022-07-15
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval Code
#10DiffusionRet
84.5
video-to-text R@10· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#11SuMA (ViT-B/16)
84.3
video-to-text R@10· 2023-02-19
Video-Text Retrieval by Supervised Sparse Multi-Grained Learning Code
#12HBI
84.3
video-to-text R@10· 2023-03-25
Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning Code
#13X-Pool
84
video-to-text R@10· Extra Data· 2022-03-28
X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval Code
#14DiffusionRet+QB-Norm
83.8
video-to-text R@10· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#15CAMoESOTA
83.8
video-to-text R@10· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code
#16EMCL-Net
83.5
video-to-text R@10· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code
#17CenterCLIP (ViT-B/16)
83.3
video-to-text R@10· Extra Data· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval Code
#18PAU
83.2
video-to-text R@10· 2023-09-29
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval Code
#19UCoFiA
83
video-to-text R@10· 2023-09-18
Unified Coarse-to-Fine Alignment for Video-Text Retrieval Code
#20CLIP2VideoSOTA
82.1
video-to-text R@10· Extra Data· 2021-06-21
CLIP2Video: Mastering Video-Text Retrieval via Image CLIP Code
#21CLIP4ClipSOTA
80.6
video-to-text R@10· Extra Data· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#22CLIPSOTA
62.6
video-to-text R@10· Extra Data· 2021-02-24
A Straightforward Framework For Video Retrieval Using CLIP Code