Video Retrieval on LSMDC

Metric: video-to-text R@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	video-to-text R@1▼	Extra Data	Paper	Date↕	Code
1	InternVideo2-6B	46.7	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
2	UMT-L (ViT-L/16)	41.4	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
3	vid-TLDR (UMT-L)	40.7	Yes	vid-TLDR: Training Free Token merging for Light-...	2024-03-20	Code
4	InternVideo	34.9	Yes	InternVideo: General Video Foundation Models via...	2022-12-06	Code
5	HunYuan_tvr (huge)	34.6	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
6	HunYuan_tvr	30.1	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
7	X-CLIP	26.9	No	X-CLIP: End-to-End Multi-grained Contrastive Lea...	2022-07-15	Code
8	EMCL-Net++	26.7	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
9	CenterCLIP (ViT-B/16)	24.5	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
10	DiffusionRet	23	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
11	X-Pool	22.7	Yes	X-Pool: Cross-Modal Language-Video Attention for...	2022-03-28	Code
12	EMCL-Net	22.2	No	Expectation-Maximization Contrastive Learning fo...	2022-11-21	Code
13	Ours	15.3	No	Video and Text Matching with Conditioned Embeddi...	2021-10-21	Code
14	CLIP	6.8	No	A Straightforward Framework For Video Retrieval ...	2021-02-24	Code

#1InternVideo2-6BSOTA
46.7
video-to-text R@1· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#2UMT-L (ViT-L/16)SOTA
41.4
video-to-text R@1· Extra Data· 2023-03-28
Unmasked Teacher: Towards Training-Efficient Video Foundation Models Code
#3vid-TLDR (UMT-L)
40.7
video-to-text R@1· Extra Data· 2024-03-20
vid-TLDR: Training Free Token merging for Light-weight Video Transformer Code
#4InternVideoSOTA
34.9
video-to-text R@1· Extra Data· 2022-12-06
InternVideo: General Video Foundation Models via Generative and Discriminative Learning Code
#5HunYuan_tvr (huge)SOTA
34.6
video-to-text R@1· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#6HunYuan_tvr
30.1
video-to-text R@1· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#7X-CLIP
26.9
video-to-text R@1· 2022-07-15
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval Code
#8EMCL-Net++
26.7
video-to-text R@1· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code
#9CenterCLIP (ViT-B/16)
24.5
video-to-text R@1· Extra Data· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval Code
#10DiffusionRet
23
video-to-text R@1· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#11X-PoolSOTA
22.7
video-to-text R@1· Extra Data· 2022-03-28
X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval Code
#12EMCL-Net
22.2
video-to-text R@1· 2022-11-21
Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations Code
#13OursSOTA
15.3
video-to-text R@1· 2021-10-21
Video and Text Matching with Conditioned Embeddings Code
#14CLIPSOTA
6.8
video-to-text R@1· 2021-02-24
A Straightforward Framework For Video Retrieval Using CLIP Code