Video on DiDeMo

Metric: text-to-video R@10 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	text-to-video R@10▼	Extra Data	Paper	Date↕	Code
1	vid-TLDR (UMT-L)	94.2	Yes	vid-TLDR: Training Free Token merging for Light-...	2024-03-20	Code
2	UMT-L (ViT-L/16)	93.5	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
3	TESTA (ViT-B/16)	91.5	Yes	TESTA: Temporal-Spatial Token Aggregation for Lo...	2023-10-29	Code
4	VAST	91.4	Yes	VAST: A Vision-Audio-Subtitle-Text Omni-Modality...	2023-05-29	Code
5	VindLU	91	Yes	VindLU: A Recipe for Effective Video-and-Languag...	2022-12-09	Code
6	VALOR	90.4	Yes	VALOR: Vision-Audio-Language Omni-Perception Pre...	2023-04-17	Code
7	GRAM	90.1	Yes	Gramian Multimodal Representation Learning and A...	2024-12-16	Code
8	RTQ	89.9	No	RTQ: Rethinking Video-language Understanding Bas...	2023-12-01	Code
9	HiTeA	89.7	Yes	HiTeA: Hierarchical Temporal-Aware Video-Languag...	2022-12-30	-
10	CLIP-ViP	89.3	Yes	CLIP-ViP: Adapting Pre-trained Image-Text Model ...	2022-09-14	Code
11	VLAB	88.7	Yes	VLAB: Enhancing Video Language Pre-training by F...	2023-05-22	-
12	Cap4Video	87.5	No	Cap4Video: What Can Auxiliary Captions Do for Te...	2022-12-31	Code
13	MuLTI	87	Yes	MuLTI: Efficient Video-and-Language Understandin...	2023-03-10	-
14	Singularity	86.9	Yes	Revealing Single Frame Bias for Video-and-Langua...	2022-06-07	Code
15	DMAE (ViT-B/32)	86.6	No	Dual-Modal Attention-Enhanced Text-Video Retriev...	2023-09-20	Code
16	HunYuan_tvr	85.7	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
17	Clover	85.6	No	Clover: Towards A Unified Video-Language Alignme...	2022-07-16	Code
18	OmniVL	85.4	Yes	OmniVL:One Foundation Model for Image-Language a...	2022-09-15	-
19	Aurora (ours, r=64)	85.3	No	-	-	-
20	mPLUG-2	85.2	Yes	mPLUG-2: A Modularized Multi-modal Foundation Mo...	2023-02-01	Code
21	HunYuan_tvr (huge)	85.2	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
22	STAN	85.1	Yes	Revisiting Temporal Modeling for CLIP-based Imag...	2023-01-26	Code
23	DRL	84.5	Yes	Disentangled Representation Learning for Text-Vi...	2022-03-14	Code
24	PAU	84.5	No	Prototype-based Aleatoric Uncertainty Quantifica...	2023-09-29	Code
25	VIOLETv2	84.1	No	An Empirical Study of End-to-End Video-Language ...	2022-09-04	Code
26	DiffusionRet+QB-Norm	83.3	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
27	HBI	82.7	No	Video-Text as Game Players: Hierarchical Banzhaf...	2023-03-25	Code
28	DiffusionRet	82.7	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
29	QB-Norm+CLIP4Clip	80.9	Yes	Cross Modal Retrieval with Querybank Normalisation	2021-12-23	Code
30	CLIP4Clip	80.6	Yes	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
31	CAMoE	79.9	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
32	ALPRO	78.8	Yes	Align and Prompt: Video-and-Language Pre-trainin...	2021-12-17	Code
33	FROZEN	72.4	Yes	Frozen in Time: A Joint Video and Image Encoder ...	2021-04-01	Code
34	HD-VILA	69.1	No	Advancing High-Resolution Video-Language Represe...	2021-11-19	Code
35	PO Loss	56.5	No	Rudder: A Cross Lingual Video and Text Retrieval...	2021-03-09	Code
36	Collaborative Experts	54.4	No	Use What You Have: Video Retrieval Using Represe...	2019-07-31	Code