Video Captioning on YouCook2

Metric: CIDEr (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	CIDEr▼	Extra Data	Paper	Date↕	Code
1	HowToCaption	116.4	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
2	HiCM²	71.84	Yes	HiCM$^2$: Hierarchical Compact Memory Modeling f...	2024-12-19	Code
3	Vid2Seq (HowTo100M+VidChapters-7M PT)	67.2	Yes	-	-	-
4	Vid2Seq	47.1	Yes	Vid2Seq: Large-Scale Pretraining of a Visual Lan...	2023-02-27	Code
5	CM²	31.66	No	Do You Remember? Dense Video Captioning with Cro...	2024-04-11	Code
6	GVL	26.52	No	Learning Grounded Vision-Language Representation...	2023-03-11	Code
7	PDVC (TSN features, no SCST)	22.71	No	End-to-End Dense Video Captioning with Parallel ...	2021-08-17	Code
8	Vid2Seq (HowTo100M+VidChapters-7M PT)	13.3	Yes	-	-	-
9	VAST	1.99	Yes	VAST: A Vision-Audio-Subtitle-Text Omni-Modality...	2023-05-29	Code
10	UniVL + MELTR	1.9	No	MELTR: Meta Loss Transformer for Learning to Fin...	2023-03-23	Code
11	UniVL	1.81	Yes	UniVL: A Unified Video and Language Pre-Training...	2020-02-15	Code
12	VLM	1.3869	Yes	VLM: Task-agnostic Video-Language Model Pre-trai...	2021-05-20	Code
13	TextKG	1.33	No	Text with Knowledge Graph Augmented Transformer ...	2023-03-22	-
14	COSA	1.31	Yes	COSA: Concatenated Sample Pretrained Vision-Lang...	2023-06-15	Code
15	MA-LMM	1.31	No	MA-LMM: Memory-Augmented Large Multimodal Model ...	2024-04-08	Code
16	VideoCoCa	1.28	Yes	VideoCoCa: Video-Text Modeling with Zero-Shot Tr...	2022-12-09	-
17	E2vidD6-MASSvid-BiD	1.22	Yes	Multimodal Pretraining for Dense Video Captioning	2020-11-10	Code
18	OmniVL	1.16	No	OmniVL:One Foundation Model for Image-Language a...	2022-09-15	-
19	COOT	0.57	Yes	COOT: Cooperative Hierarchical Transformer for V...	2020-11-01	Code
20	VideoBERT + S3D	0.55	No	VideoBERT: A Joint Model for Video and Language ...	2019-04-03	Code
21	Zhou	0.38	No	End-to-End Dense Video Captioning with Masked Tr...	2018-04-03	Code