Video Retrieval on DiDeMo

Metric: video-to-text R@1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	video-to-text R@1▼	Extra Data	Paper	Date↕	Code
1	InternVideo2-6B	71.9	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
2	vid-TLDR (UMT-L)	68.5	Yes	vid-TLDR: Training Free Token merging for Light-...	2024-03-20	Code
3	UMT-L (ViT-L/16)	65.7	Yes	Unmasked Teacher: Towards Training-Efficient Vid...	2023-03-28	Code
4	GRAM	63.5	Yes	Gramian Multimodal Representation Learning and A...	2024-12-16	Code
5	InternVideo	59.1	Yes	InternVideo: General Video Foundation Models via...	2022-12-06	Code
6	HunYuan_tvr	54.8	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
7	HunYuan_tvr (huge)	54.1	Yes	Tencent Text-Video Retrieval: Hierarchical Cross...	2022-04-07	-
8	Cap4Video	51.2	No	Cap4Video: What Can Auxiliary Captions Do for Te...	2022-12-31	Code
9	DiffusionRet+QB-Norm	50.3	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
10	DRL	49.9	Yes	Disentangled Representation Learning for Text-Vi...	2022-03-14	Code
11	PAU	48.1	No	Prototype-based Aleatoric Uncertainty Quantifica...	2023-09-29	Code
12	X-CLIP	47.8	No	X-CLIP: End-to-End Multi-grained Contrastive Lea...	2022-07-15	Code
13	HBI	46.2	No	Video-Text as Game Players: Hierarchical Banzhaf...	2023-03-25	Code
14	DiffusionRet	46.2	No	DiffusionRet: Generative Text-Video Retrieval wi...	2023-03-17	Code
15	CAMoE	45.5	Yes	Improving Video-Text Retrieval by Multi-Stream C...	2021-09-09	Code
16	PO Loss	15	No	Rudder: A Cross Lingual Video and Text Retrieval...	2021-03-09	Code

#1InternVideo2-6BSOTA
71.9
video-to-text R@1· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#2vid-TLDR (UMT-L)SOTA
68.5
video-to-text R@1· Extra Data· 2024-03-20
vid-TLDR: Training Free Token merging for Light-weight Video Transformer Code
#3UMT-L (ViT-L/16)SOTA
65.7
video-to-text R@1· Extra Data· 2023-03-28
Unmasked Teacher: Towards Training-Efficient Video Foundation Models Code
#4GRAM
63.5
video-to-text R@1· Extra Data· 2024-12-16
Gramian Multimodal Representation Learning and Alignment Code
#5InternVideoSOTA
59.1
video-to-text R@1· Extra Data· 2022-12-06
InternVideo: General Video Foundation Models via Generative and Discriminative Learning Code
#6HunYuan_tvrSOTA
54.8
video-to-text R@1· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#7HunYuan_tvr (huge)
54.1
video-to-text R@1· Extra Data· 2022-04-07
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
#8Cap4Video
51.2
video-to-text R@1· 2022-12-31
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?Code
#9DiffusionRet+QB-Norm
50.3
video-to-text R@1· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#10DRLSOTA
49.9
video-to-text R@1· Extra Data· 2022-03-14
Disentangled Representation Learning for Text-Video Retrieval Code
#11PAU
48.1
video-to-text R@1· 2023-09-29
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval Code
#12X-CLIP
47.8
video-to-text R@1· 2022-07-15
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval Code
#13HBI
46.2
video-to-text R@1· 2023-03-25
Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning Code
#14DiffusionRet
46.2
video-to-text R@1· 2023-03-17
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model Code
#15CAMoESOTA
45.5
video-to-text R@1· Extra Data· 2021-09-09
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss Code
#16PO LossSOTA
15
video-to-text R@1· 2021-03-09
Rudder: A Cross Lingual Video and Text Retrieval Dataset Code