Tasks
SotA
Datasets
Papers
Methods
Submit
About
SotA
/
Computer Vision
/
Video
/
LSMDC
Video on LSMDC
Metric: text-to-video Median Rank (higher is better)
Leaderboard
Dataset
Loading chart...
Results
Submit a result
Hide extra data
Export CSV
Sort:
text-to-video Median Rank (best first)
text-to-video Median Rank (worst first)
Date (newest first)
Date (oldest first)
Model name (A→Z)
#
Model
↕
text-to-video Median Rank
▼
Extra Data
Paper
Date
↕
Code
1
CLIP
56.5
No
A Straightforward Framework For Video Retrieval ...
2021-02-24
Code
2
Large-Scale Discriminative Clustering
52
No
Learning from Video and Text via Large-Scale Dis...
2017-07-27
Code
3
CT-SAN
46
No
End-to-end Concept Word Detection for Video Capt...
2016-10-10
-
4
Text-Video Embedding
40
No
HowTo100M: Learning a Text-Video Embedding by Wa...
2019-06-07
Code
5
JSFusion
36
No
A Joint Sequence Fusion Model for Video Question...
2018-08-07
Code
6
MoEE
27
Yes
Learning a Text-Video Embedding from Incomplete ...
2018-04-07
Code
7
Collaborative Experts
25
No
Use What You Have: Video Retrieval Using Represe...
2019-07-31
Code
8
MMT
21
No
Multi-modal Transformer for Video Retrieval
2020-07-21
Code
9
FROZEN
20
Yes
Frozen in Time: A Joint Video and Image Encoder ...
2021-04-01
Code
10
MMT-Pretrained
19.3
Yes
Multi-modal Transformer for Video Retrieval
2020-07-21
Code
11
HD-VILA
15
No
Advancing High-Resolution Video-Language Represe...
2021-11-19
Code
12
MDMMT
12.3
Yes
MDMMT: Multidomain Multimodal Transformer for Vi...
2021-03-19
Code
13
QB-Norm+CLIP4Clip
11
Yes
Cross Modal Retrieval with Querybank Normalisation
2021-12-23
Code
14
X-Pool
8
Yes
X-Pool: Cross-Modal Language-Video Attention for...
2022-03-28
Code
15
Clover
8
No
Clover: Towards A Unified Video-Language Alignme...
2022-07-16
Code
16
DiffusionRet
8
No
DiffusionRet: Generative Text-Video Retrieval wi...
2023-03-17
Code
17
CenterCLIP (ViT-B/16)
8
Yes
CenterCLIP: Token Clustering for Efficient Text-...
2022-05-02
Code
18
HunYuan_tvr
7
Yes
Tencent Text-Video Retrieval: Hierarchical Cross...
2022-04-07
-
19
MDMMT-2
6.7
Yes
MDMMT-2: Multidomain Multimodal Transformer for ...
2022-03-14
-
20
STAN
6
Yes
Revisiting Temporal Modeling for CLIP-based Imag...
2023-01-26
Code
21
CLIP-ViP
5
Yes
CLIP-ViP: Adapting Pre-trained Image-Text Model ...
2022-09-14
Code
22
HunYuan_tvr (huge)
2
Yes
Tencent Text-Video Retrieval: Hierarchical Cross...
2022-04-07
-
#1
CLIP
SOTA
56.5
text-to-video Median Rank
· 2021-02-24
A Straightforward Framework For Video Retrieval Using CLIP
Code
#2
Large-Scale Discriminative Clustering
SOTA
52
text-to-video Median Rank
· 2017-07-27
Learning from Video and Text via Large-Scale Discriminative Clustering
Code
#3
CT-SAN
SOTA
46
text-to-video Median Rank
· 2016-10-10
End-to-end Concept Word Detection for Video Captioning, Retrieval, and Question Answering
#4
Text-Video Embedding
40
text-to-video Median Rank
· 2019-06-07
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips
Code
#5
JSFusion
36
text-to-video Median Rank
· 2018-08-07
A Joint Sequence Fusion Model for Video Question Answering and Retrieval
Code
#6
MoEE
27
text-to-video Median Rank
· Extra Data
· 2018-04-07
Learning a Text-Video Embedding from Incomplete and Heterogeneous Data
Code
#7
Collaborative Experts
25
text-to-video Median Rank
· 2019-07-31
Use What You Have: Video Retrieval Using Representations From Collaborative Experts
Code
#8
MMT
21
text-to-video Median Rank
· 2020-07-21
Multi-modal Transformer for Video Retrieval
Code
#9
FROZEN
20
text-to-video Median Rank
· Extra Data
· 2021-04-01
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval
Code
#10
MMT-Pretrained
19.3
text-to-video Median Rank
· Extra Data
· 2020-07-21
Multi-modal Transformer for Video Retrieval
Code
#11
HD-VILA
15
text-to-video Median Rank
· 2021-11-19
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
Code
#12
MDMMT
12.3
text-to-video Median Rank
· Extra Data
· 2021-03-19
MDMMT: Multidomain Multimodal Transformer for Video Retrieval
Code
#13
QB-Norm+CLIP4Clip
11
text-to-video Median Rank
· Extra Data
· 2021-12-23
Cross Modal Retrieval with Querybank Normalisation
Code
#14
X-Pool
8
text-to-video Median Rank
· Extra Data
· 2022-03-28
X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval
Code
#15
Clover
8
text-to-video Median Rank
· 2022-07-16
Clover: Towards A Unified Video-Language Alignment and Fusion Model
Code
#16
DiffusionRet
8
text-to-video Median Rank
· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model
Code
#17
CenterCLIP (ViT-B/16)
8
text-to-video Median Rank
· Extra Data
· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval
Code
#18
HunYuan_tvr
7
text-to-video Median Rank
· Extra Data
· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#19
MDMMT-2
6.7
text-to-video Median Rank
· Extra Data
· 2022-03-14
MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization
#20
STAN
6
text-to-video Median Rank
· Extra Data
· 2023-01-26
Revisiting Temporal Modeling for CLIP-based Image-to-Video Knowledge Transferring
Code
#21
CLIP-ViP
5
text-to-video Median Rank
· Extra Data
· 2022-09-14
CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment
Code
#22
HunYuan_tvr (huge)
2
text-to-video Median Rank
· Extra Data
· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations