Zero-Shot Video Retrieval on LSMDC

Metric: text-to-video R@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video R@1▼	Extra Data	Paper	Date↕	Code
1	InternVideo2-6B	33.8	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
2	InternVideo2-1B	32	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
3	VAST, HowToCaption-finetuned	27.7	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
4	UMT-L (ViT-L/16)	25.2	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
5	mPLUG-2	24.1	No	mPLUG-2: A Modularized Multi-modal Foundation Mo...	2023-02-01	Code
6	BT-Adapter	19.5	No	BT-Adapter: Video Conversation is Feasible Witho...	2023-09-27	Code
7	HiTeA-17M	18.3	Yes	HiTeA: Hierarchical Temporal-Aware Video-Languag...	2022-12-30	-
8	InternVideo	17.6	Yes	InternVideo: General Video Foundation Models via...	2022-12-06	Code
9	HowToCaption	17.3	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
10	Yatai Ji et. al.	17.2	No	Seeing What You Miss: Vision-Language Pre-traini...	2022-11-24	Code
11	HiTeA-5M	15.5	Yes	HiTeA: Hierarchical Temporal-Aware Video-Languag...	2022-12-30	-
12	CLIP4Clip	15.1	Yes	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
13	Clover	14.7	Yes	Clover: Towards A Unified Video-Language Alignme...	2022-07-16	Code
14	Y. Ge et. al.	12.2	No	Bridging Video-text Retrieval with Multiple Choi...	2022-01-13	Code
15	MILES	11.1	No	MILES: Visual BERT Pre-training with Injected La...	2022-04-26	Code
16	SSML	4.2	No	Noise Estimation Using Density Estimation for Se...	2020-03-06	Code

#1InternVideo2-6BSOTA
33.8
text-to-video R@1· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#2InternVideo2-1B
32
text-to-video R@1· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#3VAST, HowToCaption-finetunedSOTA
27.7
text-to-video R@1· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#4UMT-L (ViT-L/16)SOTA
25.2
text-to-video R@1· Extra Data· 2023-03-28
Unmasked Teacher: Towards Training-Efficient Video Foundation Models Code
#5mPLUG-2SOTA
24.1
text-to-video R@1· 2023-02-01
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video Code
#6BT-Adapter
19.5
text-to-video R@1· 2023-09-27
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning Code
#7HiTeA-17MSOTA
18.3
text-to-video R@1· Extra Data· 2022-12-30
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
#8InternVideoSOTA
17.6
text-to-video R@1· Extra Data· 2022-12-06
InternVideo: General Video Foundation Models via Generative and Discriminative Learning Code
#9HowToCaption
17.3
text-to-video R@1· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#10Yatai Ji et. al.SOTA
17.2
text-to-video R@1· 2022-11-24
Seeing What You Miss: Vision-Language Pre-training with Semantic Completion Learning Code
#11HiTeA-5M
15.5
text-to-video R@1· Extra Data· 2022-12-30
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
#12CLIP4ClipSOTA
15.1
text-to-video R@1· Extra Data· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#13Clover
14.7
text-to-video R@1· Extra Data· 2022-07-16
Clover: Towards A Unified Video-Language Alignment and Fusion Model Code
#14Y. Ge et. al.
12.2
text-to-video R@1· 2022-01-13
Bridging Video-text Retrieval with Multiple Choice Questions Code
#15MILES
11.1
text-to-video R@1· 2022-04-26
MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval Code
#16SSMLSOTA
4.2
text-to-video R@1· 2020-03-06
Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning Code