Video on LSMDC

Metric: text-to-video Median Rank (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	text-to-video Median Rank▼	Extra Data	Paper	Date↕	Code
1	CLIP	56.5	No	A Straightforward Framework For Video Retrieval ...	2021-02-24	Code
2	Large-Scale Discriminative Clustering	52	No	Learning from Video and Text via Large-Scale Dis...	2017-07-27	Code
3	CT-SAN	46	No	End-to-end Concept Word Detection for Video Capt...	2016-10-10	-
4	Text-Video Embedding	40	No	HowTo100M: Learning a Text-Video Embedding by Wa...	2019-06-07	Code
5	JSFusion	36	No	A Joint Sequence Fusion Model for Video Question...	2018-08-07	Code
6	MoEE	27	Yes	Learning a Text-Video Embedding from Incomplete ...	2018-04-07	Code
7	Collaborative Experts	25	No	Use What You Have: Video Retrieval Using Represe...	2019-07-31	Code
8	MMT	21	No	Multi-modal Transformer for Video Retrieval	2020-07-21	Code
9	FROZEN	20	Yes	Frozen in Time: A Joint Video and Image Encoder ...	2021-04-01	Code
10	MMT-Pretrained	19.3	Yes	Multi-modal Transformer for Video Retrieval	2020-07-21	Code
11	HD-VILA	15	No	Advancing High-Resolution Video-Language Represe...	2021-11-19	Code
12	MDMMT	12.3	Yes	MDMMT: Multidomain Multimodal Transformer for Vi...	2021-03-19	Code
13	QB-Norm+CLIP4Clip	11	Yes	Cross Modal Retrieval with Querybank Normalisation	2021-12-23	Code
14	X-Pool	8	Yes	X-Pool: Cross-Modal Language-Video Attention for...	2022-03-28	Code
15	Clover	8	No	Clover: Towards A Unified Video-Language Alignme...	2022-07-16	Code
16	DiffusionRet	8	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
17	CenterCLIP (ViT-B/16)	8	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
18	HunYuan_tvr	7	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
19	MDMMT-2	6.7	Yes	MDMMT-2: Multidomain Multimodal Transformer for ...	2022-03-14	-
20	STAN	6	Yes	Revisiting Temporal Modeling for CLIP-based Imag...	2023-01-26	Code
21	CLIP-ViP	5	Yes	CLIP-ViP: Adapting Pre-trained Image-Text Model ...	2022-09-14	Code
22	HunYuan_tvr (huge)	2	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-

#1CLIPSOTA
56.5
text-to-video Median Rank· 2021-02-24
A Straightforward Framework For Video Retrieval Using CLIP Code
#2Large-Scale Discriminative ClusteringSOTA
52
text-to-video Median Rank· 2017-07-27
Learning from Video and Text via Large-Scale Discriminative Clustering Code
#3CT-SANSOTA
46
text-to-video Median Rank· 2016-10-10
End-to-end Concept Word Detection for Video Captioning, Retrieval, and Question Answering
#4Text-Video Embedding
40
text-to-video Median Rank· 2019-06-07
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips Code
#5JSFusion
36
text-to-video Median Rank· 2018-08-07
A Joint Sequence Fusion Model for Video Question Answering and Retrieval Code
#6MoEE
27
text-to-video Median Rank· Extra Data· 2018-04-07
Learning a Text-Video Embedding from Incomplete and Heterogeneous Data Code
#7Collaborative Experts
25
text-to-video Median Rank· 2019-07-31
Use What You Have: Video Retrieval Using Representations From Collaborative Experts Code
#8MMT
21
text-to-video Median Rank· 2020-07-21
Multi-modal Transformer for Video Retrieval Code
#9FROZEN
20
text-to-video Median Rank· Extra Data· 2021-04-01
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval Code
#10MMT-Pretrained
19.3
text-to-video Median Rank· Extra Data· 2020-07-21
Multi-modal Transformer for Video Retrieval Code
#11HD-VILA
15
text-to-video Median Rank· 2021-11-19
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions Code
#12MDMMT
12.3
text-to-video Median Rank· Extra Data· 2021-03-19
MDMMT: Multidomain Multimodal Transformer for Video Retrieval Code
#13QB-Norm+CLIP4Clip
11
text-to-video Median Rank· Extra Data· 2021-12-23
Cross Modal Retrieval with Querybank Normalisation Code
#14X-Pool
8
text-to-video Median Rank· Extra Data· 2022-03-28
X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval Code
#15Clover
8
text-to-video Median Rank· 2022-07-16
Clover: Towards A Unified Video-Language Alignment and Fusion Model Code
#16DiffusionRet
8
text-to-video Median Rank· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#17CenterCLIP (ViT-B/16)
8
text-to-video Median Rank· Extra Data· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval Code
#18HunYuan_tvr
7
text-to-video Median Rank· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#19MDMMT-2
6.7
text-to-video Median Rank· Extra Data· 2022-03-14
MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization
#20STAN
6
text-to-video Median Rank· Extra Data· 2023-01-26
Revisiting Temporal Modeling for CLIP-based Image-to-Video Knowledge Transferring Code
#21CLIP-ViP
5
text-to-video Median Rank· Extra Data· 2022-09-14
CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment Code
#22HunYuan_tvr (huge)
2
text-to-video Median Rank· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations