Video Retrieval on MSR-VTT

Metric: video-to-text R@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	video-to-text R@1▼	Extra Data	Paper	Date↕	Code
1	GRAM	64.8	Yes	Gramian Multimodal Representation Learning and A...	2024-12-16	Code
2	VideoCoCa (zero-shot)	64.7	Yes	VideoCoCa: Video-Text Modeling with Zero-Shot Tr...	2022-12-09	-
3	InternVideo2-6B	60.2	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
4	CAMoE	59.8	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
5	vid-TLDR (UMT-L)	58.7	Yes	vid-TLDR: Training Free Token merging for Light-...	2024-03-20	Code
6	UMT-L (ViT-L/16)	58.6	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
7	InternVideo	57.9	Yes	InternVideo: General Video Foundation Models via...	2022-12-06	Code
8	CLIP2Video	54.6	Yes	CLIP2Video: Mastering Video-Text Retrieval via I...	2021-06-21	Code
9	CoCa (zero-shot)	49.9	Yes	CoCa: Contrastive Captioners are Image-Text Foun...	2022-05-04	Code
10	CLIP	40.3	No	A Straightforward Framework For Video Retrieval ...	2021-02-24	Code
11	Ours	26.7	No	Video and Text Matching with Conditioned Embeddi...	2021-10-21	Code
12	Collaborative Experts	15.6	No	Use What You Have: Video Retrieval Using Represe...	2019-07-31	Code
13	JEMC	12.5	No	-	-	Code

#1GRAMSOTA
64.8
video-to-text R@1· Extra Data· 2024-12-16
Gramian Multimodal Representation Learning and Alignment Code
#2VideoCoCa (zero-shot)SOTA
64.7
video-to-text R@1· Extra Data· 2022-12-09
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners
#3InternVideo2-6B
60.2
video-to-text R@1· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#4CAMoESOTA
59.8
video-to-text R@1· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code
#5vid-TLDR (UMT-L)
58.7
video-to-text R@1· Extra Data· 2024-03-20
vid-TLDR: Training Free Token merging for Light-weight Video Transformer Code
#6UMT-L (ViT-L/16)
58.6
video-to-text R@1· Extra Data· 2023-03-28
Unmasked Teacher: Towards Training-Efficient Video Foundation Models Code
#7InternVideo
57.9
video-to-text R@1· Extra Data· 2022-12-06
InternVideo: General Video Foundation Models via Generative and Discriminative Learning Code
#8CLIP2VideoSOTA
54.6
video-to-text R@1· Extra Data· 2021-06-21
CLIP2Video: Mastering Video-Text Retrieval via Image CLIP Code
#9CoCa (zero-shot)
49.9
video-to-text R@1· Extra Data· 2022-05-04
CoCa: Contrastive Captioners are Image-Text Foundation Models Code
#10CLIPSOTA
40.3
video-to-text R@1· 2021-02-24
A Straightforward Framework For Video Retrieval Using CLIP Code
#11Ours
26.7
video-to-text R@1· 2021-10-21
Video and Text Matching with Conditioned Embeddings Code
#12Collaborative ExpertsSOTA
15.6
video-to-text R@1· 2019-07-31
Use What You Have: Video Retrieval Using Representations From Collaborative Experts Code
#13JEMC
12.5
video-to-text R@1
No paperCode