Zero-Shot Video Retrieval on MSVD

Metric: text-to-video R@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video R@1▼	Extra Data	Paper	Date↕	Code
1	InternVideo2-6B	59.3	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
2	InternVideo2-1B	58.1	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
3	VAST, HowToCaption-finetuned	54.8	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
4	LanguageBind(ViT-L/14)	54.1	Yes	LanguageBind: Extending Video-Language Pretraini...	2023-10-03	Code
5	LanguageBind(ViT-H/14)	53.9	Yes	LanguageBind: Extending Video-Language Pretraini...	2023-10-03	Code
6	vid-TLDR (UMT-L)	50	Yes	vid-TLDR: Training Free Token merging for Light-...	2024-03-20	Code
7	UMT-L (ViT-L/16)	49	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
8	HowToCaption	44.5	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
9	MILES	44.4	No	MILES: Visual BERT Pre-training with Injected La...	2022-04-26	Code
10	Y. Ge et. al.	43.6	No	Bridging Video-text Retrieval with Multiple Choi...	2022-01-13	Code
11	InternVideo	43.4	Yes	InternVideo: General Video Foundation Models via...	2022-12-06	Code
12	CLIP4Clip	38.5	No	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
13	LaT	36.9	No	LaT: Latent Translation with Cycle-Consistency f...	2022-07-11	-
14	SSML	13.66	No	Noise Estimation Using Density Estimation for Se...	2020-03-06	Code

#1InternVideo2-6BSOTA
59.3
text-to-video R@1· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#2InternVideo2-1B
58.1
text-to-video R@1· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#3VAST, HowToCaption-finetunedSOTA
54.8
text-to-video R@1· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#4LanguageBind(ViT-L/14)SOTA
54.1
text-to-video R@1· Extra Data· 2023-10-03
LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment Code
#5LanguageBind(ViT-H/14)
53.9
text-to-video R@1· Extra Data· 2023-10-03
LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment Code
#6vid-TLDR (UMT-L)
50
text-to-video R@1· Extra Data· 2024-03-20
vid-TLDR: Training Free Token merging for Light-weight Video Transformer Code
#7UMT-L (ViT-L/16)SOTA
49
text-to-video R@1· Extra Data· 2023-03-28
Unmasked Teacher: Towards Training-Efficient Video Foundation Models Code
#8HowToCaption
44.5
text-to-video R@1· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#9MILESSOTA
44.4
text-to-video R@1· 2022-04-26
MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval Code
#10Y. Ge et. al.SOTA
43.6
text-to-video R@1· 2022-01-13
Bridging Video-text Retrieval with Multiple Choice Questions Code
#11InternVideo
43.4
text-to-video R@1· Extra Data· 2022-12-06
InternVideo: General Video Foundation Models via Generative and Discriminative Learning Code
#12CLIP4ClipSOTA
38.5
text-to-video R@1· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#13LaT
36.9
text-to-video R@1· 2022-07-11
LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval
#14SSMLSOTA
13.66
text-to-video R@1· 2020-03-06
Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning Code