Video on MSR-VTT-1kA

Metric: video-to-text Mean Rank (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	video-to-text Mean Rank▼	Extra Data	Paper	Date↕	Code
1	CenterCLIP (ViT-B/16)	10.2	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
2	CLIP2Video	10.2	Yes	CLIP2Video: Mastering Video-Text Retrieval via I...	2021-06-21	Code
3	CAMoE	9.9	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
4	PAU	9.7	No	Prototype-based Aleatoric Uncertainty Quantifica...	2023-09-29	Code
5	CLIP2TV	9	Yes	CLIP2TV: Align, Match and Distill for Video-Text...	2021-11-10	-
6	X-Pool	9	Yes	X-Pool: Cross-Modal Language-Video Attention for...	2022-03-28	Code
7	HBI	8.9	No	Video-Text as Game Players: Hierarchical Banzhaf...	2023-03-25	Code
8	DiffusionRet	8.8	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
9	DiffusionRet+QB-Norm	8.5	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
10	X-CLIP	8.1	No	X-CLIP: End-to-End Multi-grained Contrastive Lea...	2022-07-15	Code
11	Cap4Video	8	No	Cap4Video: What Can Auxiliary Captions Do for Te...	2022-12-31	Code
12	HunYuan_tvr	7.7	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
13	DRL	7.6	Yes	Disentangled Representation Learning for Text-Vi...	2022-03-14	Code
14	PIDRo	7.5	No	-	-	-
15	DMAE (ViT-B/16)	7.3	No	Dual-Modal Attention-Enhanced Text-Video Retriev...	2023-09-20	Code
16	HunYuan_tvr (huge)	5.5	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
17	EMCL-Net	2	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
18	EMCL-Net++	1	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code

#1CenterCLIP (ViT-B/16)
10.2
video-to-text Mean Rank· Extra Data· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval Code
#2CLIP2VideoSOTA
10.2
video-to-text Mean Rank· Extra Data· 2021-06-21
CLIP2Video: Mastering Video-Text Retrieval via Image CLIP Code
#3CAMoE
9.9
video-to-text Mean Rank· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code
#4PAU
9.7
video-to-text Mean Rank· 2023-09-29
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval Code
#5CLIP2TV
9
video-to-text Mean Rank· Extra Data· 2021-11-10
CLIP2TV: Align, Match and Distill for Video-Text Retrieval
#6X-Pool
9
video-to-text Mean Rank· Extra Data· 2022-03-28
X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval Code
#7HBI
8.9
video-to-text Mean Rank· 2023-03-25
Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning Code
#8DiffusionRet
8.8
video-to-text Mean Rank· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#9DiffusionRet+QB-Norm
8.5
video-to-text Mean Rank· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#10X-CLIP
8.1
video-to-text Mean Rank· 2022-07-15
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval Code
#11Cap4Video
8
video-to-text Mean Rank· 2022-12-31
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?Code
#12HunYuan_tvr
7.7
video-to-text Mean Rank· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#13DRL
7.6
video-to-text Mean Rank· Extra Data· 2022-03-14
Disentangled Representation Learning for Text-Video Retrieval Code
#14PIDRo
7.5
video-to-text Mean Rank
No paper
#15DMAE (ViT-B/16)
7.3
video-to-text Mean Rank· 2023-09-20
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning Code
#16HunYuan_tvr (huge)
5.5
video-to-text Mean Rank· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#17EMCL-Net
2
video-to-text Mean Rank· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code
#18EMCL-Net++
1
video-to-text Mean Rank· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code