Video Retrieval on ActivityNet

Metric: text-to-video R@10 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video R@10▼	Extra Data	Paper	Date↕	Code
1	GRAM	96.1	Yes	Gramian Multimodal Representation Learning and A...	2024-12-16	Code
2	VAST	95.5	Yes	VAST: A Vision-Audio-Subtitle-Text Omni-Modality...	2023-05-29	Code
3	VALOR	95.3	Yes	VALOR: Vision-Audio-Language Omni-Perception Pre...	2023-04-17	Code
4	UMT-L (ViT-L/16)	94.9	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
5	vid-TLDR (UMT-L)	94.4	Yes	vid-TLDR: Training Free Token merging for Light-...	2024-03-20	Code
6	HunYuan_tvr	93.1	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
7	CLIP-ViP	92.6	Yes	CLIP-ViP: Adapting Pre-trained Image-Text Model ...	2022-09-14	Code
8	RTQ	91.9	No	RTQ: Rethinking Video-language Understanding Bas...	2023-12-01	Code
9	VindLU	89.7	Yes	VindLU: A Recipe for Effective Video-and-Languag...	2022-12-09	Code
10	TESTA (ViT-B/16)	89.6	Yes	TESTA: Temporal-Spatial Token Aggregation for Lo...	2023-10-29	Code
11	DMAE (ViT-B/32)	89.2	No	Dual-Modal Attention-Enhanced Text-Video Retriev...	2023-09-20	Code
12	CAMoE	87.6	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
13	CenterCLIP (ViT-B/16)	87.6	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
14	HiTeA	86.7	Yes	HiTeA: Hierarchical Temporal-Aware Video-Languag...	2022-12-30	-
15	DiffusionRet	86.3	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
16	DiffusionRet+QB-Norm	85.7	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
17	Singularity	85.5	Yes	Revealing Single Frame Bias for Video-and-Langua...	2022-06-07	Code
18	HBI	84.6	No	Video-Text as Game Players: Hierarchical Banzhaf...	2023-03-25	Code
19	Collaborative Experts	63.9	No	Use What You Have: Video Retrieval Using Represe...	2019-07-31	Code

#1GRAMSOTA
96.1
text-to-video R@10· Extra Data· 2024-12-16
Gramian Multimodal Representation Learning and Alignment Code
#2VASTSOTA
95.5
text-to-video R@10· Extra Data· 2023-05-29
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset Code
#3VALORSOTA
95.3
text-to-video R@10· Extra Data· 2023-04-17
VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset Code
#4UMT-L (ViT-L/16)SOTA
94.9
text-to-video R@10· Extra Data· 2023-03-28
Unmasked Teacher: Towards Training-Efficient Video Foundation Models Code
#5vid-TLDR (UMT-L)
94.4
text-to-video R@10· Extra Data· 2024-03-20
vid-TLDR: Training Free Token merging for Light-weight Video Transformer Code
#6HunYuan_tvrSOTA
93.1
text-to-video R@10· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#7CLIP-ViP
92.6
text-to-video R@10· Extra Data· 2022-09-14
CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment Code
#8RTQ
91.9
text-to-video R@10· 2023-12-01
RTQ: Rethinking Video-language Understanding Based on Image-text Model Code
#9VindLU
89.7
text-to-video R@10· Extra Data· 2022-12-09
VindLU: A Recipe for Effective Video-and-Language Pretraining Code
#10TESTA (ViT-B/16)
89.6
text-to-video R@10· Extra Data· 2023-10-29
TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding Code
#11DMAE (ViT-B/32)
89.2
text-to-video R@10· 2023-09-20
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning Code
#12CAMoESOTA
87.6
text-to-video R@10· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code
#13CenterCLIP (ViT-B/16)
87.6
text-to-video R@10· Extra Data· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval Code
#14HiTeA
86.7
text-to-video R@10· Extra Data· 2022-12-30
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
#15DiffusionRet
86.3
text-to-video R@10· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#16DiffusionRet+QB-Norm
85.7
text-to-video R@10· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#17Singularity
85.5
text-to-video R@10· Extra Data· 2022-06-07
Revealing Single Frame Bias for Video-and-Language Learning Code
#18HBI
84.6
text-to-video R@10· 2023-03-25
Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning Code
#19Collaborative ExpertsSOTA
63.9
text-to-video R@10· 2019-07-31
Use What You Have: Video Retrieval Using Representations From Collaborative Experts Code