Video Retrieval on MSVD

Metric: video-to-text R@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	video-to-text R@1▼	Extra Data	Paper	Date↕	Code
1	InternVideo2-6B	85.2	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
2	vid-TLDR (UMT-L)	82.7	Yes	vid-TLDR: Training Free Token merging for Light-...	2024-03-20	Code
3	InternVideo	76.3	Yes	InternVideo: General Video Foundation Models via...	2022-12-06	Code
4	HunYuan_tvr (huge)	73	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
5	Cap4Video	70	No	Cap4Video: What Can Auxiliary Captions Do for Te...	2022-12-31	Code
6	CAMoE	69.3	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
7	HunYuan_tvr	69.1	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
8	PAU	68.9	No	Prototype-based Aleatoric Uncertainty Quantifica...	2023-09-29	Code
9	CenterCLIP (ViT-B/16)	68.4	Yes	CenterCLIP: Token Clustering for Efficient Text-...	2022-05-02	Code
10	X-CLIP	66.8	No	X-CLIP: End-to-End Multi-grained Contrastive Lea...	2022-07-15	Code
11	X-Pool	66.4	Yes	X-Pool: Cross-Modal Language-Video Attention for...	2022-03-28	Code
12	CLIP4Clip	62	Yes	CLIP4Clip: An Empirical Study of CLIP for End to...	2021-04-18	Code
13	DiffusionRet	61.9	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
14	DiffusionRet+QB-Norm	60.3	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
15	CLIP	59.9	No	A Straightforward Framework For Video Retrieval ...	2021-02-24	Code

#1InternVideo2-6BSOTA
85.2
video-to-text R@1· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#2vid-TLDR (UMT-L)SOTA
82.7
video-to-text R@1· Extra Data· 2024-03-20
vid-TLDR: Training Free Token merging for Light-weight Video Transformer Code
#3InternVideoSOTA
76.3
video-to-text R@1· Extra Data· 2022-12-06
InternVideo: General Video Foundation Models via Generative and Discriminative Learning Code
#4HunYuan_tvr (huge)SOTA
73
video-to-text R@1· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#5Cap4Video
70
video-to-text R@1· 2022-12-31
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?Code
#6CAMoESOTA
69.3
video-to-text R@1· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code
#7HunYuan_tvr
69.1
video-to-text R@1· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#8PAU
68.9
video-to-text R@1· 2023-09-29
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval Code
#9CenterCLIP (ViT-B/16)
68.4
video-to-text R@1· Extra Data· 2022-05-02
CenterCLIP: Token Clustering for Efficient Text-Video Retrieval Code
#10X-CLIP
66.8
video-to-text R@1· 2022-07-15
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval Code
#11X-Pool
66.4
video-to-text R@1· Extra Data· 2022-03-28
X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrieval Code
#12CLIP4ClipSOTA
62
video-to-text R@1· Extra Data· 2021-04-18
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Code
#13DiffusionRet
61.9
video-to-text R@1· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#14DiffusionRet+QB-Norm
60.3
video-to-text R@1· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#15CLIPSOTA
59.9
video-to-text R@1· 2021-02-24
A Straightforward Framework For Video Retrieval Using CLIP Code