Video Retrieval on ActivityNet

Metric: text-to-video Median Rank (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video Median Rank▼	Extra Data	Paper	Date↕	Code
1	Collaborative Experts	6	No	Use What You Have: Video Retrieval Using Represe...	2019-07-31	Code
2	MMT	5	No	Multi-modal Transformer for Video Retrieval	2020-07-21	Code
3	HD-VILA	4	No	Advancing High-Resolution Video-Language Represe...	2021-11-19	Code
4	MMT-Pretrained	3.3	Yes	Multi-modal Transformer for Video Retrieval	2020-07-21	Code
5	TACo	3	Yes	TACo: Token-aware Cascade Contrastive Learning f...	2021-08-23	-
6	DiffusionRet+QB-Norm	2	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
7	CenterCLIP (ViT-B/16)	2	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
8	DiffusionRet	2	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
9	HBI	2	No	Video-Text as Game Players: Hierarchical Banzhaf...	2023-03-25	Code
10	CLIP4Clip	2	No	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
11	CLIP-ViP	1	Yes	CLIP-ViP: Adapting Pre-trained Image-Text Model ...	2022-09-14	Code
12	HunYuan_tvr	1	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
13	DMAE (ViT-B/32)	1	No	Dual-Modal Attention-Enhanced Text-Video Retriev...	2023-09-20	Code
14	CAMoE	1	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code

#1Collaborative ExpertsSOTA
6
text-to-video Median Rank· 2019-07-31
Use What You Have: Video Retrieval Using Representations From Collaborative Experts Code
#2MMT
5
text-to-video Median Rank· 2020-07-21
Multi-modal Transformer for Video Retrieval Code
#3HD-VILA
4
text-to-video Median Rank· 2021-11-19
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions Code
#4MMT-Pretrained
3.3
text-to-video Median Rank· Extra Data· 2020-07-21
Multi-modal Transformer for Video Retrieval Code
#5TACo
3
text-to-video Median Rank· Extra Data· 2021-08-23
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
#6DiffusionRet+QB-Norm
2
text-to-video Median Rank· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#7CenterCLIP (ViT-B/16)
2
text-to-video Median Rank· Extra Data· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval Code
#8DiffusionRet
2
text-to-video Median Rank· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#9HBI
2
text-to-video Median Rank· 2023-03-25
Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning Code
#10CLIP4Clip
2
text-to-video Median Rank· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#11CLIP-ViP
1
text-to-video Median Rank· Extra Data· 2022-09-14
CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment Code
#12HunYuan_tvr
1
text-to-video Median Rank· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#13DMAE (ViT-B/32)
1
text-to-video Median Rank· 2023-09-20
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning Code
#14CAMoE
1
text-to-video Median Rank· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code