Zero-Shot Video Retrieval on MSVD

Metric: text-to-video R@5 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video R@5▼	Extra Data	Paper	Date↕	Code
1	InternVideo2-6B	84.4	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
2	InternVideo2-1B	83	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
3	LanguageBind(ViT-L/14)	81.1	Yes	LanguageBind: Extending Video-Language Pretraini...	2023-10-03	Code
4	VAST, HowToCaption-finetuned	80.9	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
5	LanguageBind(ViT-H/14)	80.4	Yes	LanguageBind: Extending Video-Language Pretraini...	2023-10-03	Code
6	vid-TLDR (UMT-L)	77.6	Yes	vid-TLDR: Training Free Token merging for Light-...	2024-03-20	Code
7	UMT-L (ViT-L/16)	76.9	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
8	MILES	76.2	No	MILES: Visual BERT Pre-training with Injected La...	2022-04-26	Code
9	Y. Ge et. al.	74.9	No	Bridging Video-text Retrieval with Multiple Choi...	2022-01-13	Code
10	HowToCaption	73.3	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
11	LaT	68.6	No	LaT: Latent Translation with Cycle-Consistency f...	2022-07-11	-
12	CLIP4Clip	66.9	No	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
13	SSML	35.7	No	Noise Estimation Using Density Estimation for Se...	2020-03-06	Code

#1InternVideo2-6BSOTA
84.4
text-to-video R@5· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#2InternVideo2-1B
83
text-to-video R@5· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#3LanguageBind(ViT-L/14)SOTA
81.1
text-to-video R@5· Extra Data· 2023-10-03
LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment Code
#4VAST, HowToCaption-finetuned
80.9
text-to-video R@5· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#5LanguageBind(ViT-H/14)
80.4
text-to-video R@5· Extra Data· 2023-10-03
LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment Code
#6vid-TLDR (UMT-L)
77.6
text-to-video R@5· Extra Data· 2024-03-20
vid-TLDR: Training Free Token merging for Light-weight Video Transformer Code
#7UMT-L (ViT-L/16)SOTA
76.9
text-to-video R@5· Extra Data· 2023-03-28
Unmasked Teacher: Towards Training-Efficient Video Foundation Models Code
#8MILESSOTA
76.2
text-to-video R@5· 2022-04-26
MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval Code
#9Y. Ge et. al.SOTA
74.9
text-to-video R@5· 2022-01-13
Bridging Video-text Retrieval with Multiple Choice Questions Code
#10HowToCaption
73.3
text-to-video R@5· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#11LaT
68.6
text-to-video R@5· 2022-07-11
LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval
#12CLIP4ClipSOTA
66.9
text-to-video R@5· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#13SSMLSOTA
35.7
text-to-video R@5· 2020-03-06
Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning Code