Video on LSMDC

Metric: text-to-video R@5 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	text-to-video R@5▼	Extra Data	Paper	Date↕	Code
1	HunYuan_tvr (huge)	80.1	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
2	UMT-L (ViT-L/16)	65.5	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
3	vid-TLDR (UMT-L)	64.5	Yes	vid-TLDR: Training Free Token merging for Light-...	2024-03-20	Code
4	VALOR	56	Yes	VALOR: Vision-Audio-Language Omni-Perception Pre...	2023-04-17	Code
5	mPLUG-2	55.2	Yes	mPLUG-2: A Modularized Multi-modal Foundation Mo...	2023-02-01	Code
6	CLIP-ViP	51.4	Yes	CLIP-ViP: Adapting Pre-trained Image-Text Model ...	2022-09-14	Code
7	HiTeA	50.3	Yes	HiTeA: Hierarchical Temporal-Aware Video-Languag...	2022-12-30	-
8	STAN	49.5	Yes	Revisiting Temporal Modeling for CLIP-based Imag...	2023-01-26	Code
9	MDMMT-2	46.7	Yes	MDMMT-2: Multidomain Multimodal Transformer for ...	2022-03-14	-
10	HunYuan_tvr	46.4	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
11	EMCL-Net++	46.4	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
12	CenterCLIP (ViT-B/16)	46.2	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
13	CAMoE	46.1	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
14	Clover	44	No	Clover: Towards A Unified Video-Language Alignme...	2022-07-16	Code
15	X-Pool	43.7	Yes	X-Pool: Cross-Modal Language-Video Attention for...	2022-03-28	Code
16	VIOLETv2	43.5	No	An Empirical Study of End-to-End Video-Language ...	2022-09-04	Code
17	DiffusionRet	43.1	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
18	EMCL-Net	42.4	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
19	CLIP4Clip	41.8	Yes	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
20	QB-Norm+CLIP4Clip	40.1	Yes	Cross Modal Retrieval with Querybank Normalisation	2021-12-23	Code
21	MDMMT	38.5	Yes	MDMMT: Multidomain Multimodal Transformer for Vi...	2021-03-19	Code
22	HD-VILA	34.1	No	Advancing High-Resolution Video-Language Represe...	2021-11-19	Code
23	Ours	33.2	No	Video and Text Matching with Conditioned Embeddi...	2021-10-21	Code
24	FROZEN	30.8	Yes	Frozen in Time: A Joint Video and Image Encoder ...	2021-04-01	Code
25	MMT-Pretrained	29.9	Yes	Multi-modal Transformer for Video Retrieval	2020-07-21	Code
26	MMT	29.2	No	Multi-modal Transformer for Video Retrieval	2020-07-21	Code
27	Collaborative Experts	26.9	No	Use What You Have: Video Retrieval Using Represe...	2019-07-31	Code
28	MoEE	25.6	Yes	Learning a Text-Video Embedding from Incomplete ...	2018-04-07	Code
29	CLIP	22.7	No	A Straightforward Framework For Video Retrieval ...	2021-02-24	Code
30	JSFusion	21.2	No	A Joint Sequence Fusion Model for Video Question...	2018-08-07	Code
31	Text-Video Embedding	19.6	No	HowTo100M: Learning a Text-Video Embedding by Wa...	2019-06-07	Code
32	Large-Scale Discriminative Clustering	19.2	No	Learning from Video and Text via Large-Scale Dis...	2017-07-27	Code
33	CT-SAN	16.3	No	End-to-end Concept Word Detection for Video Capt...	2016-10-10	-