Video on YouCook2

Metric: text-to-video R@5 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video R@5▼	Extra Data	Paper	Date↕	Code
1	VAST	74.3	Yes	VAST: A Vision-Audio-Subtitle-Text Omni-Modality...	2023-05-29	Code
2	MDMMT-2	64	Yes	MDMMT-2: Multidomain Multimodal Transformer for ...	2022-03-14	-
3	UniVL + MELTR	63.1	No	MELTR: Meta Loss Transformer for Learning to Fin...	2023-03-23	Code
4	VideoCLIP	62.6	Yes	VideoCLIP: Contrastive Pre-training for Zero-sho...	2021-09-28	Code
5	TACo	59.7	Yes	TACo: Token-aware Cascade Contrastive Learning f...	2021-08-23	-
6	UniVL	57.6	Yes	UniVL: A Unified Video and Language Pre-Training...	2020-02-15	Code
7	VLM	56.88	Yes	VLM: Task-agnostic Video-Language Model Pre-trai...	2021-05-20	Code
8	VideoCLIP (zero-shot)	50.4	Yes	VideoCLIP: Contrastive Pre-training for Zero-sho...	2021-09-28	Code
9	VideoCoCa (zero-shot)	43.9	No	VideoCoCa: Video-Text Modeling with Zero-Shot Tr...	2022-12-09	-
10	Text-Video Embedding	24.5	No	HowTo100M: Learning a Text-Video Embedding by Wa...	2019-06-07	Code
11	RoME	16.9	No	RoME: Role-aware Mixture-of-Expert Transformer f...	2022-06-26	Code
12	Satar et al.	14.5	No	Semantic Role Aware Correlation Transformer for ...	2022-06-26	Code
13	HGLMM FV CCA	14.3	No	-	-	-

#1VASTSOTA
74.3
text-to-video R@5· Extra Data· 2023-05-29
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset Code
#2MDMMT-2SOTA
64
text-to-video R@5· Extra Data· 2022-03-14
MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization
#3UniVL + MELTR
63.1
text-to-video R@5· 2023-03-23
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models Code
#4VideoCLIPSOTA
62.6
text-to-video R@5· Extra Data· 2021-09-28
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding Code
#5TACoSOTA
59.7
text-to-video R@5· Extra Data· 2021-08-23
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
#6UniVLSOTA
57.6
text-to-video R@5· Extra Data· 2020-02-15
UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation Code
#7VLM
56.88
text-to-video R@5· Extra Data· 2021-05-20
VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding Code
#8VideoCLIP (zero-shot)
50.4
text-to-video R@5· Extra Data· 2021-09-28
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding Code
#9VideoCoCa (zero-shot)
43.9
text-to-video R@5· 2022-12-09
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners
#10Text-Video EmbeddingSOTA
24.5
text-to-video R@5· 2019-06-07
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips Code
#11RoME
16.9
text-to-video R@5· 2022-06-26
RoME: Role-aware Mixture-of-Expert Transformer for Text-to-Video Retrieval Code
#12Satar et al.
14.5
text-to-video R@5· 2022-06-26
Semantic Role Aware Correlation Transformer for Text to Video Retrieval Code
#13HGLMM FV CCA
14.3
text-to-video R@5
No paper