Video on MSR-VTT-1kA

Metric: video-to-text R@5 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	video-to-text R@5▼	Extra Data	Paper	Date↕	Code
1	PIDRo	783	No	-	-	-
2	HunYuan_tvr (huge)	84.9	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
3	EMCL-Net++	80.2	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
4	DRL	79.9	Yes	Disentangled Representation Learning for Text-Vi...	2022-03-14	Code
5	DMAE (ViT-B/16)	79.2	No	Dual-Modal Attention-Enhanced Text-Video Retriev...	2023-09-20	Code
6	HunYuan_tvr	78.4	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
7	CLIP2TV	77.4	Yes	CLIP2TV: Align, Match and Distill for Video-Text...	2021-11-10	-
8	X-CLIP	76.8	No	X-CLIP: End-to-End Multi-grained Contrastive Lea...	2022-07-15	Code
9	SuMA (ViT-B/16)	76	No	Video-Text Retrieval by Supervised Sparse Multi-...	2023-02-19	Code
10	Cap4Video	75.2	No	Cap4Video: What Can Auxiliary Captions Do for Te...	2022-12-31	Code
11	CenterCLIP (ViT-B/16)	75	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
12	CAMoE	74.6	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
13	UCoFiA	74.3	No	Unified Coarse-to-Fine Alignment for Video-Text ...	2023-09-18	Code
14	DiffusionRet+QB-Norm	74.3	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
15	HBI	74.3	No	Video-Text as Game Players: Hierarchical Banzhaf...	2023-03-25	Code
16	DiffusionRet	73.8	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
17	EMCL-Net	73.5	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
18	X-Pool	73.3	Yes	X-Pool: Cross-Modal Language-Video Attention for...	2022-03-28	Code
19	PAU	73	No	Prototype-based Aleatoric Uncertainty Quantifica...	2023-09-29	Code
20	CLIP2Video	72.3	Yes	CLIP2Video: Mastering Video-Text Retrieval via I...	2021-06-21	Code
21	CLIP4Clip	70.9	Yes	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
22	CLIP	51.7	Yes	A Straightforward Framework For Video Retrieval ...	2021-02-24	Code

#1PIDRo
783
video-to-text R@5
No paper
#2HunYuan_tvr (huge)SOTA
84.9
video-to-text R@5· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#3EMCL-Net++
80.2
video-to-text R@5· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code
#4DRLSOTA
79.9
video-to-text R@5· Extra Data· 2022-03-14
Disentangled Representation Learning for Text-Video Retrieval Code
#5DMAE (ViT-B/16)
79.2
video-to-text R@5· 2023-09-20
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning Code
#6HunYuan_tvr
78.4
video-to-text R@5· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#7CLIP2TVSOTA
77.4
video-to-text R@5· Extra Data· 2021-11-10
CLIP2TV: Align, Match and Distill for Video-Text Retrieval
#8X-CLIP
76.8
video-to-text R@5· 2022-07-15
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval Code
#9SuMA (ViT-B/16)
76
video-to-text R@5· 2023-02-19
Video-Text Retrieval by Supervised Sparse Multi-Grained Learning Code
#10Cap4Video
75.2
video-to-text R@5· 2022-12-31
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?Code
#11CenterCLIP (ViT-B/16)
75
video-to-text R@5· Extra Data· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval Code
#12CAMoESOTA
74.6
video-to-text R@5· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code
#13UCoFiA
74.3
video-to-text R@5· 2023-09-18
Unified Coarse-to-Fine Alignment for Video-Text Retrieval Code
#14DiffusionRet+QB-Norm
74.3
video-to-text R@5· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#15HBI
74.3
video-to-text R@5· 2023-03-25
Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning Code
#16DiffusionRet
73.8
video-to-text R@5· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#17EMCL-Net
73.5
video-to-text R@5· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code
#18X-Pool
73.3
video-to-text R@5· Extra Data· 2022-03-28
X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval Code
#19PAU
73
video-to-text R@5· 2023-09-29
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval Code
#20CLIP2VideoSOTA
72.3
video-to-text R@5· Extra Data· 2021-06-21
CLIP2Video: Mastering Video-Text Retrieval via Image CLIP Code
#21CLIP4ClipSOTA
70.9
video-to-text R@5· Extra Data· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#22CLIPSOTA
51.7
video-to-text R@5· Extra Data· 2021-02-24
A Straightforward Framework For Video Retrieval Using CLIP Code