Zero-Shot Video Retrieval on LSMDC

Metric: text-to-video R@5 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video R@5▼	Extra Data	Paper	Date↕	Code
1	InternVideo2-6B	55.9	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
2	InternVideo2-1B	52.4	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
3	VAST, HowToCaption-finetuned	46.5	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
4	mPLUG-2	43.8	No	mPLUG-2: A Modularized Multi-modal Foundation Mo...	2023-02-01	Code
5	UMT-L (ViT-L/16)	43	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
6	HiTeA-17M	36.7	Yes	HiTeA: Hierarchical Temporal-Aware Video-Languag...	2022-12-30	-
7	BT-Adapter	35.9	No	BT-Adapter: Video Conversation is Feasible Witho...	2023-09-27	Code
8	InternVideo	32.4	Yes	InternVideo: General Video Foundation Models via...	2022-12-06	Code
9	Yatai Ji et. al.	32.4	No	Seeing What You Miss: Vision-Language Pre-traini...	2022-11-24	Code
10	HowToCaption	31.7	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
11	HiTeA-5M	31.1	Yes	HiTeA: Hierarchical Temporal-Aware Video-Languag...	2022-12-30	-
12	Clover	29.2	Yes	Clover: Towards A Unified Video-Language Alignme...	2022-07-16	Code
13	CLIP4Clip	28.5	Yes	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
14	Y. Ge et. al.	25.9	No	Bridging Video-text Retrieval with Multiple Choi...	2022-01-13	Code
15	MILES	24.7	No	MILES: Visual BERT Pre-training with Injected La...	2022-04-26	Code
16	SSML	11.6	No	Noise Estimation Using Density Estimation for Se...	2020-03-06	Code

#1InternVideo2-6BSOTA
55.9
text-to-video R@5· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#2InternVideo2-1B
52.4
text-to-video R@5· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#3VAST, HowToCaption-finetunedSOTA
46.5
text-to-video R@5· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#4mPLUG-2SOTA
43.8
text-to-video R@5· 2023-02-01
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video Code
#5UMT-L (ViT-L/16)
43
text-to-video R@5· Extra Data· 2023-03-28
Unmasked Teacher: Towards Training-Efficient Video Foundation Models Code
#6HiTeA-17MSOTA
36.7
text-to-video R@5· Extra Data· 2022-12-30
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
#7BT-Adapter
35.9
text-to-video R@5· 2023-09-27
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning Code
#8InternVideo
32.4
text-to-video R@5· Extra Data· 2022-12-06
InternVideo: General Video Foundation Models via Generative and Discriminative Learning Code
#9Yatai Ji et. al.SOTA
32.4
text-to-video R@5· 2022-11-24
Seeing What You Miss: Vision-Language Pre-training with Semantic Completion Learning Code
#10HowToCaption
31.7
text-to-video R@5· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#11HiTeA-5M
31.1
text-to-video R@5· Extra Data· 2022-12-30
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
#12CloverSOTA
29.2
text-to-video R@5· Extra Data· 2022-07-16
Clover: Towards A Unified Video-Language Alignment and Fusion Model Code
#13CLIP4ClipSOTA
28.5
text-to-video R@5· Extra Data· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#14Y. Ge et. al.
25.9
text-to-video R@5· 2022-01-13
Bridging Video-text Retrieval with Multiple Choice Questions Code
#15MILES
24.7
text-to-video R@5· 2022-04-26
MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval Code
#16SSMLSOTA
11.6
text-to-video R@5· 2020-03-06
Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning Code