Zero-Shot Video Retrieval on MSR-VTT

Metric: text-to-video R@10 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	text-to-video R@10▼	Extra Data	Paper	Date↕	Code
1	InternVideo2-6B	85.1	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
2	GRAM	83.9	Yes	Gramian Multimodal Representation Learning and A...	2024-12-16	Code
3	InternVideo2-1B	82.5	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
4	VAST, HowToCaption-finetuned	81.4	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
5	FluxViT-B	79.6	Yes	Make Your Training Flexible: Towards Deployment-...	2025-03-18	Code
6	mPLUG-2	79	No	mPLUG-2: A Modularized Multi-modal Foundation Mo...	2023-02-01	Code
7	LanguageBind(ViT-H/14)	78.7	Yes	LanguageBind: Extending Video-Language Pretraini...	2023-10-03	Code
8	LanguageBind(ViT-L/14)	76	Yes	LanguageBind: Extending Video-Language Pretraini...	2023-10-03	Code
9	FluxViT-S	75.8	Yes	Make Your Training Flexible: Towards Deployment-...	2025-03-18	Code
10	VAST	73.9	Yes	VAST: A Vision-Audio-Subtitle-Text Omni-Modality...	2023-05-29	Code
11	BT-Adapter	73.5	No	BT-Adapter: Video Conversation is Feasible Witho...	2023-09-27	Code
12	HowToCaption	73.3	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
13	UMT-L (ViT-L/16)	73.1	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
14	Florence	72.6	No	Florence: A New Foundation Model for Computer Vi...	2021-11-22	Code
15	vid-TLDR (UMT-L)	72.4	Yes	vid-TLDR: Training Free Token merging for Light-...	2024-03-20	Code
16	ImageBind	70	No	ImageBind: One Embedding Space To Bind Them All	2023-05-09	Code
17	HiTeA-17M	69.9	No	HiTeA: Hierarchical Temporal-Aware Video-Languag...	2022-12-30	-
18	CLIP4Clip	66.9	No	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
19	Singularity-17M	66.7	Yes	Revealing Single Frame Bias for Video-and-Langua...	2022-06-07	Code
20	OmniVL	66.6	Yes	OmniVL:One Foundation Model for Image-Language a...	2022-09-15	-
21	Yatai Ji et. al.	65	No	Seeing What You Miss: Vision-Language Pre-traini...	2022-11-24	Code
22	HiTeA-5M	62.9	No	HiTeA: Hierarchical Temporal-Aware Video-Languag...	2022-12-30	-
23	Clover	60	No	Clover: Towards A Unified Video-Language Alignme...	2022-07-16	Code
24	VIOLET	59.7	No	VIOLET : End-to-End Video-Language Transformers ...	2021-11-24	Code
25	Singularity-5M	59.5	Yes	Revealing Single Frame Bias for Video-and-Langua...	2022-06-07	Code
26	FROZEN	57.2	No	Frozen in Time: A Joint Video and Image Encoder ...	2021-04-01	Code
27	MILES	56.9	No	MILES: Visual BERT Pre-training with Injected La...	2022-04-26	Code
28	Y. Ge et. al.	56.4	No	Bridging Video-text Retrieval with Multiple Choi...	2022-01-13	Code
29	OA-Trans	55.6	No	Object-aware Video-language Pre-training for Ret...	2021-12-01	Code
30	ALPRO	55.4	No	Align and Prompt: Video-and-Language Pre-trainin...	2021-12-17	Code
31	LaT	53.3	No	LaT: Latent Translation with Cycle-Consistency f...	2022-07-11	-
32	A. Nagrani et. al.	50.3	Yes	Learning Audio-Video Modalities from Image Capti...	2022-04-01	-
33	HD-VILA	44.1	No	Advancing High-Resolution Video-Language Represe...	2021-11-19	Code
34	TACo	33.4	No	TACo: Token-aware Cascade Contrastive Learning f...	2021-08-23	-
35	MIL-NCE	32.4	No	End-to-End Learning of Visual Representations fr...	2019-12-13	Code
36	VideoCLIP	30	No	VideoCLIP: Contrastive Pre-training for Zero-sho...	2021-09-28	Code
37	VATT-MBS	29.7	No	VATT: Transformers for Multimodal Self-Supervise...	2021-04-22	Code
38	SSML	29.3	No	Noise Estimation Using Density Estimation for Se...	2020-03-06	Code