Zero-Shot Video Retrieval on MSVD

Metric: text-to-video R@10 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video R@10▼	Extra Data	Paper	Date↕	Code
1	InternVideo2-6B	89.6	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
2	InternVideo2-1B	88.4	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
3	LanguageBind(ViT-L/14)	88.1	Yes	LanguageBind: Extending Video-Language Pretraini...	2023-10-03	Code
4	LanguageBind(ViT-H/14)	87.8	Yes	LanguageBind: Extending Video-Language Pretraini...	2023-10-03	Code
5	VAST, HowToCaption-finetuned	87.2	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
6	MILES	87	No	MILES: Visual BERT Pre-training with Injected La...	2022-04-26	Code
7	vid-TLDR (UMT-L)	85.5	Yes	vid-TLDR: Training Free Token merging for Light-...	2024-03-20	Code
8	Y. Ge et. al.	84.9	No	Bridging Video-text Retrieval with Multiple Choi...	2022-01-13	Code
9	UMT-L (ViT-L/16)	84.7	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
10	HowToCaption	82.1	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
11	LaT	81	No	LaT: Latent Translation with Cycle-Consistency f...	2022-07-11	-
12	CLIP4Clip	76.8	No	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
13	SSML	47.74	No	Noise Estimation Using Density Estimation for Se...	2020-03-06	Code

#1InternVideo2-6BSOTA
89.6
text-to-video R@10· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#2InternVideo2-1B
88.4
text-to-video R@10· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#3LanguageBind(ViT-L/14)SOTA
88.1
text-to-video R@10· Extra Data· 2023-10-03
LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment Code
#4LanguageBind(ViT-H/14)
87.8
text-to-video R@10· Extra Data· 2023-10-03
LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment Code
#5VAST, HowToCaption-finetuned
87.2
text-to-video R@10· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#6MILESSOTA
87
text-to-video R@10· 2022-04-26
MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval Code
#7vid-TLDR (UMT-L)
85.5
text-to-video R@10· Extra Data· 2024-03-20
vid-TLDR: Training Free Token merging for Light-weight Video Transformer Code
#8Y. Ge et. al.SOTA
84.9
text-to-video R@10· 2022-01-13
Bridging Video-text Retrieval with Multiple Choice Questions Code
#9UMT-L (ViT-L/16)
84.7
text-to-video R@10· Extra Data· 2023-03-28
Unmasked Teacher: Towards Training-Efficient Video Foundation Models Code
#10HowToCaption
82.1
text-to-video R@10· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#11LaT
81
text-to-video R@10· 2022-07-11
LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval
#12CLIP4ClipSOTA
76.8
text-to-video R@10· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#13SSMLSOTA
47.74
text-to-video R@10· 2020-03-06
Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning Code