Zero-Shot Video Retrieval on MSR-VTT

Metric: text-to-video Median Rank (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video Median Rank▼	Extra Data	Paper	Date↕	Code
1	MMT	66	Yes	Multi-modal Transformer for Video Retrieval	2020-07-21	Code
2	VATT-MBS	49	No	VATT: Transformers for Multimodal Self-Supervise...	2021-04-22	Code
3	HD-VILA	15	No	Advancing High-Resolution Video-Language Represe...	2021-11-19	Code
4	ALPRO	8	No	Align and Prompt: Video-and-Language Pre-trainin...	2021-12-17	Code
5	OA-Trans	8	No	Object-aware Video-language Pre-training for Ret...	2021-12-01	Code
6	LaT	8	No	LaT: Latent Translation with Cycle-Consistency f...	2022-07-11	-
7	MILES	7	No	MILES: Visual BERT Pre-training with Injected La...	2022-04-26	Code
8	Y. Ge et. al.	7	No	Bridging Video-text Retrieval with Multiple Choi...	2022-01-13	Code
9	FROZEN	7	No	Frozen in Time: A Joint Video and Image Encoder ...	2021-04-01	Code
10	Clover	6	No	Clover: Towards A Unified Video-Language Alignme...	2022-07-16	Code
11	CLIP4Clip	4	No	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
12	HowToCaption	3	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
13	LanguageBind(ViT-H/14)	2	Yes	LanguageBind: Extending Video-Language Pretraini...	2023-10-03	Code
14	LanguageBind(ViT-L/14)	2	Yes	LanguageBind: Extending Video-Language Pretraini...	2023-10-03	Code
15	VAST, HowToCaption-finetuned	1	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code

#1MMTSOTA
66
text-to-video Median Rank· Extra Data· 2020-07-21
Multi-modal Transformer for Video Retrieval Code
#2VATT-MBS
49
text-to-video Median Rank· 2021-04-22
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text Code
#3HD-VILA
15
text-to-video Median Rank· 2021-11-19
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions Code
#4ALPRO
8
text-to-video Median Rank· 2021-12-17
Align and Prompt: Video-and-Language Pre-training with Entity Prompts Code
#5OA-Trans
8
text-to-video Median Rank· 2021-12-01
Object-aware Video-language Pre-training for Retrieval Code
#6LaT
8
text-to-video Median Rank· 2022-07-11
LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval
#7MILES
7
text-to-video Median Rank· 2022-04-26
MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval Code
#8Y. Ge et. al.
7
text-to-video Median Rank· 2022-01-13
Bridging Video-text Retrieval with Multiple Choice Questions Code
#9FROZEN
7
text-to-video Median Rank· 2021-04-01
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval Code
#10Clover
6
text-to-video Median Rank· 2022-07-16
Clover: Towards A Unified Video-Language Alignment and Fusion Model Code
#11CLIP4Clip
4
text-to-video Median Rank· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#12HowToCaption
3
text-to-video Median Rank· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#13LanguageBind(ViT-H/14)
2
text-to-video Median Rank· Extra Data· 2023-10-03
LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment Code
#14LanguageBind(ViT-L/14)
2
text-to-video Median Rank· Extra Data· 2023-10-03
LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment Code
#15VAST, HowToCaption-finetuned
1
text-to-video Median Rank· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code