Video Retrieval on DiDeMo

Metric: text-to-video Median Rank (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video Median Rank▼	Extra Data	Paper	Date↕	Code
1	Collaborative Experts	8.3	No	Use What You Have: Video Retrieval Using Represe...	2019-07-31	Code
2	PO Loss	8	No	Rudder: A Cross Lingual Video and Text Retrieval...	2021-03-09	Code
3	HD-VILA	4	No	Advancing High-Resolution Video-Language Represe...	2021-11-19	Code
4	ALPRO	3	Yes	Align and Prompt: Video-and-Language Pre-trainin...	2021-12-17	Code
5	FROZEN	3	Yes	Frozen in Time: A Joint Video and Image Encoder ...	2021-04-01	Code
6	DRL	2	Yes	Disentangled Representation Learning for Text-Vi...	2022-03-14	Code
7	DiffusionRet+QB-Norm	2	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
8	PAU	2	No	Prototype-based Aleatoric Uncertainty Quantifica...	2023-09-29	Code
9	HBI	2	No	Video-Text as Game Players: Hierarchical Banzhaf...	2023-03-25	Code
10	DiffusionRet	2	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
11	CAMoE	2	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
12	QB-Norm+CLIP4Clip	2	Yes	Cross Modal Retrieval with Querybank Normalisation	2021-12-23	Code
13	CLIP4Clip	2	Yes	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
14	CLIP-ViP	1	Yes	CLIP-ViP: Adapting Pre-trained Image-Text Model ...	2022-09-14	Code
15	STAN	1	Yes	Revisiting Temporal Modeling for CLIP-based Imag...	2023-01-26	Code
16	DMAE (ViT-B/32)	1	No	Dual-Modal Attention-Enhanced Text-Video Retriev...	2023-09-20	Code
17	HunYuan_tvr (huge)	1	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
18	HunYuan_tvr	1	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
19	Cap4Video	1	No	Cap4Video: What Can Auxiliary Captions Do for Te...	2022-12-31	Code
20	Clover	1	No	Clover: Towards A Unified Video-Language Alignme...	2022-07-16	Code
21	Aurora (ours, r=64)	1	No	-	-	-

#1Collaborative ExpertsSOTA
8.3
text-to-video Median Rank· 2019-07-31
Use What You Have: Video Retrieval Using Representations From Collaborative Experts Code
#2PO Loss
8
text-to-video Median Rank· 2021-03-09
Rudder: A Cross Lingual Video and Text Retrieval Dataset Code
#3HD-VILA
4
text-to-video Median Rank· 2021-11-19
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions Code
#4ALPRO
3
text-to-video Median Rank· Extra Data· 2021-12-17
Align and Prompt: Video-and-Language Pre-training with Entity Prompts Code
#5FROZEN
3
text-to-video Median Rank· Extra Data· 2021-04-01
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval Code
#6DRL
2
text-to-video Median Rank· Extra Data· 2022-03-14
Disentangled Representation Learning for Text-Video Retrieval Code
#7DiffusionRet+QB-Norm
2
text-to-video Median Rank· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#8PAU
2
text-to-video Median Rank· 2023-09-29
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval Code
#9HBI
2
text-to-video Median Rank· 2023-03-25
Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning Code
#10DiffusionRet
2
text-to-video Median Rank· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#11CAMoE
2
text-to-video Median Rank· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code
#12QB-Norm+CLIP4Clip
2
text-to-video Median Rank· Extra Data· 2021-12-23
Cross Modal Retrieval with Querybank Normalisation Code
#13CLIP4Clip
2
text-to-video Median Rank· Extra Data· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#14CLIP-ViP
1
text-to-video Median Rank· Extra Data· 2022-09-14
CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment Code
#15STAN
1
text-to-video Median Rank· Extra Data· 2023-01-26
Revisiting Temporal Modeling for CLIP-based Image-to-Video Knowledge Transferring Code
#16DMAE (ViT-B/32)
1
text-to-video Median Rank· 2023-09-20
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning Code
#17HunYuan_tvr (huge)
1
text-to-video Median Rank· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#18HunYuan_tvr
1
text-to-video Median Rank· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#19Cap4Video
1
text-to-video Median Rank· 2022-12-31
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?Code
#20Clover
1
text-to-video Median Rank· 2022-07-16
Clover: Towards A Unified Video-Language Alignment and Fusion Model Code
#21Aurora (ours, r=64)
1
text-to-video Median Rank
No paper