Video on MSR-VTT-1kA

Metric: video-to-text R@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	video-to-text R@1▼	Extra Data	Paper	Date↕	Code
1	HunYuan_tvr (huge)	64.8	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
2	DRL	56.2	Yes	Disentangled Representation Learning for Text-Vi...	2022-03-14	Code
3	DMAE (ViT-B/16)	55.7	No	Dual-Modal Attention-Enhanced Text-Video Retriev...	2023-09-20	Code
4	HunYuan_tvr	55.5	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
5	PIDRo	54.5	No	-	-	-
6	CLIP2TV	54.1	Yes	CLIP2TV: Align, Match and Distill for Video-Text...	2021-11-10	-
7	EMCL-Net++	51.8	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
8	CAMoE	50.3	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
9	DiffusionRet+QB-Norm	49.3	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
10	Cap4Video	49	No	Cap4Video: What Can Auxiliary Captions Do for Te...	2022-12-31	Code
11	X-CLIP	48.9	No	X-CLIP: End-to-End Multi-grained Contrastive Lea...	2022-07-15	Code
12	PAU	48.3	No	Prototype-based Aleatoric Uncertainty Quantifica...	2023-09-29	Code
13	DiffusionRet	47.7	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
14	CenterCLIP (ViT-B/16)	47.7	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
15	SuMA (ViT-B/16)	47.3	No	Video-Text Retrieval by Supervised Sparse Multi-...	2023-02-19	Code
16	UCoFiA	47.1	No	Unified Coarse-to-Fine Alignment for Video-Text ...	2023-09-18	Code
17	HBI	46.8	No	Video-Text as Game Players: Hierarchical Banzhaf...	2023-03-25	Code
18	EMCL-Net	46.5	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
19	X-Pool	44.4	Yes	X-Pool: Cross-Modal Language-Video Attention for...	2022-03-28	Code
20	CLIP2Video	43.3	Yes	CLIP2Video: Mastering Video-Text Retrieval via I...	2021-06-21	Code
21	Socratic Models	42.8	No	Socratic Models: Composing Zero-Shot Multimodal ...	2022-04-01	Code
22	CLIP4Clip	42.7	Yes	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
23	CLIP	27.2	Yes	A Straightforward Framework For Video Retrieval ...	2021-02-24	Code

#1HunYuan_tvr (huge)SOTA
64.8
video-to-text R@1· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#2DRLSOTA
56.2
video-to-text R@1· Extra Data· 2022-03-14
Disentangled Representation Learning for Text-Video Retrieval Code
#3DMAE (ViT-B/16)
55.7
video-to-text R@1· 2023-09-20
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning Code
#4HunYuan_tvr
55.5
video-to-text R@1· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#5PIDRo
54.5
video-to-text R@1
No paper
#6CLIP2TVSOTA
54.1
video-to-text R@1· Extra Data· 2021-11-10
CLIP2TV: Align, Match and Distill for Video-Text Retrieval
#7EMCL-Net++
51.8
video-to-text R@1· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code
#8CAMoESOTA
50.3
video-to-text R@1· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code
#9DiffusionRet+QB-Norm
49.3
video-to-text R@1· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#10Cap4Video
49
video-to-text R@1· 2022-12-31
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?Code
#11X-CLIP
48.9
video-to-text R@1· 2022-07-15
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval Code
#12PAU
48.3
video-to-text R@1· 2023-09-29
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval Code
#13DiffusionRet
47.7
video-to-text R@1· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#14CenterCLIP (ViT-B/16)
47.7
video-to-text R@1· Extra Data· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval Code
#15SuMA (ViT-B/16)
47.3
video-to-text R@1· 2023-02-19
Video-Text Retrieval by Supervised Sparse Multi-Grained Learning Code
#16UCoFiA
47.1
video-to-text R@1· 2023-09-18
Unified Coarse-to-Fine Alignment for Video-Text Retrieval Code
#17HBI
46.8
video-to-text R@1· 2023-03-25
Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning Code
#18EMCL-Net
46.5
video-to-text R@1· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code
#19X-Pool
44.4
video-to-text R@1· Extra Data· 2022-03-28
X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval Code
#20CLIP2VideoSOTA
43.3
video-to-text R@1· Extra Data· 2021-06-21
CLIP2Video: Mastering Video-Text Retrieval via Image CLIP Code
#21Socratic Models
42.8
video-to-text R@1· 2022-04-01
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language Code
#22CLIP4ClipSOTA
42.7
video-to-text R@1· Extra Data· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#23CLIPSOTA
27.2
video-to-text R@1· Extra Data· 2021-02-24
A Straightforward Framework For Video Retrieval Using CLIP Code