Video on MSR-VTT-1kA

Metric: text-to-video R@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	text-to-video R@1▼	Extra Data	Paper	Date↕	Code
1	HunYuan_tvr (huge)	62.9	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
2	CLIP-ViP	57.7	Yes	CLIP-ViP: Adapting Pre-trained Image-Text Model ...	2022-09-14	Code
3	PIDRo	55.9	No	-	-	-
4	DMAE (ViT-B/16)	55.5	No	Dual-Modal Attention-Enhanced Text-Video Retriev...	2023-09-20	Code
5	HunYuan_tvr	55	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
6	MuLTI	54.7	No	MuLTI: Efficient Video-and-Language Understandin...	2023-03-10	-
7	STAN	54.1	Yes	Revisiting Temporal Modeling for CLIP-based Imag...	2023-01-26	Code
8	EERCF	54.1	No	Towards Efficient and Effective Text-to-Video Re...	2024-01-01	Code
9	TS2-Net	54	No	TS2-Net: Token Shift and Selection Transformer f...	2022-07-16	Code
10	RTQ	53.4	No	RTQ: Rethinking Video-language Understanding Bas...	2023-12-01	Code
11	DRL	53.3	Yes	Disentangled Representation Learning for Text-Vi...	2022-03-14	Code
12	mPLUG-2	53.1	No	mPLUG-2: A Modularized Multi-modal Foundation Mo...	2023-02-01	Code
13	CLIP2TV	52.9	Yes	CLIP2TV: Align, Match and Distill for Video-Text...	2021-11-10	-
14	Side4Video	52.3	No	Side4Video: Spatial-Temporal Side Network for Me...	2023-11-27	Code
15	EMCL-Net++	51.6	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
16	Cap4Video	51.4	No	Cap4Video: What Can Auxiliary Captions Do for Te...	2022-12-31	Code
17	SuMA (ViT-B/16)	49.8	No	Video-Text Retrieval by Supervised Sparse Multi-...	2023-02-19	Code
18	X2-VLM (large)	49.6	No	X$^2$-VLM: All-In-One Pre-trained Model For Visi...	2022-11-22	Code
19	UCoFiA	49.4	No	Unified Coarse-to-Fine Alignment for Video-Text ...	2023-09-18	Code
20	X-CLIP	49.3	No	X-CLIP: End-to-End Multi-grained Contrastive Lea...	2022-07-15	Code
21	DiffusionRet	49	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
22	DiffusionRet+QB-Norm	48.9	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
23	CAMoE	48.8	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
24	HBI	48.6	No	Video-Text as Game Players: Hierarchical Banzhaf...	2023-03-25	Code
25	PAU	48.5	No	Prototype-based Aleatoric Uncertainty Quantifica...	2023-09-29	Code
26	CenterCLIP (ViT-B/16)	48.4	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
27	TeachCLIP (ViT-B/16)	48	No	-	-	Code
28	X2-VLM (base)	47.6	No	X$^2$-VLM: All-In-One Pre-trained Model For Visi...	2022-11-22	Code
29	QB-Norm+CLIP2Video	47.2	Yes	Cross Modal Retrieval with Querybank Normalisation	2021-12-23	Code
30	X-Pool	46.9	Yes	X-Pool: Cross-Modal Language-Video Attention for...	2022-03-28	Code
31	TeachCLIP	46.8	No	-	-	Code
32	EMCL-Net	46.8	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
33	HiTeA	46.8	No	HiTeA: Hierarchical Temporal-Aware Video-Languag...	2022-12-30	-
34	VindLU	46.5	Yes	VindLU: A Recipe for Effective Video-and-Languag...	2022-12-09	Code
35	LAFF	45.8	No	Lightweight Attentional Feature Fusion: A New Ba...	2021-12-03	Code
36	CLIP2Video	45.6	Yes	CLIP2Video: Mastering Video-Text Retrieval via I...	2021-06-21	Code
37	Singularity	41.5	Yes	Revealing Single Frame Bias for Video-and-Langua...	2022-06-07	Code
38	All-in-one + MELTR	41.3	No	MELTR: Meta Loss Transformer for Learning to Fin...	2023-03-23	Code
39	Clover	40.5	No	Clover: Towards A Unified Video-Language Alignme...	2022-07-16	Code
40	MDMMT	38.9	Yes	MDMMT: Multidomain Multimodal Transformer for Vi...	2021-03-19	Code
41	MAC	38.9	Yes	Masked Contrastive Pre-Training for Efficient Vi...	2022-12-02	-
42	All-in-one-B	37.9	Yes	All in One: Exploring Unified Video-Language Pre...	2022-03-14	Code
43	BridgeFormer	37.6	Yes	Bridging Video-text Retrieval with Multiple Choi...	2022-01-13	Code
44	Florence	37.6	Yes	Florence: A New Foundation Model for Computer Vi...	2021-11-22	Code
45	COTS	36.8	Yes	COTS: Collaborative Two-Stream Vision-Language P...	2022-04-15	-
46	VIOLET + MELTR	35.5	No	MELTR: Meta Loss Transformer for Learning to Fin...	2023-03-23	Code
47	CLIP	31.2	Yes	A Straightforward Framework For Video Retrieval ...	2021-02-24	Code
48	UniVL + MELTR	31.1	No	MELTR: Meta Loss Transformer for Learning to Fin...	2023-03-23	Code
49	FROZEN	31	Yes	Frozen in Time: A Joint Video and Image Encoder ...	2021-04-01	Code
50	VideoCLIP	30.9	Yes	VideoCLIP: Contrastive Pre-training for Zero-sho...	2021-09-28	Code
51	TACo	28.4	No	TACo: Token-aware Cascade Contrastive Learning f...	2021-08-23	-
52	VLM	28.1	Yes	VLM: Task-agnostic Video-Language Model Pre-trai...	2021-05-20	Code
53	MMT-Pretrained	26.6	Yes	Multi-modal Transformer for Video Retrieval	2020-07-21	Code
54	BridgeFormer (Zero-shot)	26	No	Bridging Video-text Retrieval with Multiple Choi...	2022-01-13	Code
55	MMT	24.6	No	Multi-modal Transformer for Video Retrieval	2020-07-21	Code
56	Collaborative Experts	20.9	Yes	Use What You Have: Video Retrieval Using Represe...	2019-07-31	Code
57	HT-Pretrained	14.9	No	HowTo100M: Learning a Text-Video Embedding by Wa...	2019-06-07	Code
58	HT	12.1	No	HowTo100M: Learning a Text-Video Embedding by Wa...	2019-06-07	Code
59	JSFusion	10.2	No	A Joint Sequence Fusion Model for Video Question...	2018-08-07	Code