Video Captioning on YouCook2

Metric: ROUGE-L (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Hide extra data

Sort:

#	Model↕	ROUGE-L▼	Extra Data	Paper	Date↕	Code
1	UniVL + MELTR	47.04	No	MELTR: Meta Loss Transformer for Learning to Fin...	2023-03-23	Code
2	UniVL	46.52	Yes	UniVL: A Unified Video and Language Pre-Training...	2020-02-15	Code
3	VLM	41.51	Yes	VLM: Task-agnostic Video-Language Model Pre-trai...	2021-05-20	Code
4	TextKG	40.2	No	Text with Knowledge Graph Augmented Transformer ...	2023-03-22	-
5	E2vidD6-MASSvid-BiD	39.03	Yes	Multimodal Pretraining for Dense Video Captioning	2020-11-10	Code
6	E2vidD6-MASSalign-BiD	39.03	Yes	Multimodal Pretraining for Dense Video Captioning	2020-11-10	Code
7	COOT	37.94	Yes	COOT: Cooperative Hierarchical Transformer for V...	2020-11-01	Code
8	VideoCoCa	37.7	Yes	VideoCoCa: Video-Text Modeling with Zero-Shot Tr...	2022-12-09	-
9	HowToCaption	37.3	No	HowToCaption: Prompting LLMs to Transform Video ...	2023-10-07	Code
10	OmniVL	36.09	No	OmniVL:One Foundation Model for Image-Language a...	2022-09-15	-
11	VideoBERT + S3D	28.8	No	VideoBERT: A Joint Model for Video and Language ...	2019-04-03	Code
12	Zhou	27.44	No	End-to-End Dense Video Captioning with Masked Tr...	2018-04-03	Code

#1UniVL + MELTRSOTA
47.04
ROUGE-L· 2023-03-23
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models Code
#2UniVLSOTA
46.52
ROUGE-L· Extra Data· 2020-02-15
UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation Code
#3VLM
41.51
ROUGE-L· Extra Data· 2021-05-20
VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding Code
#4TextKG
40.2
ROUGE-L· 2023-03-22
Text with Knowledge Graph Augmented Transformer for Video Captioning
#5E2vidD6-MASSvid-BiD
39.03
ROUGE-L· Extra Data· 2020-11-10
Multimodal Pretraining for Dense Video Captioning Code
#6E2vidD6-MASSalign-BiD
39.03
ROUGE-L· Extra Data· 2020-11-10
Multimodal Pretraining for Dense Video Captioning Code
#7COOT
37.94
ROUGE-L· Extra Data· 2020-11-01
COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning Code
#8VideoCoCa
37.7
ROUGE-L· Extra Data· 2022-12-09
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners
#9HowToCaption
37.3
ROUGE-L· 2023-10-07
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale Code
#10OmniVL
36.09
ROUGE-L· 2022-09-15
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks
#11VideoBERT + S3DSOTA
28.8
ROUGE-L· 2019-04-03
VideoBERT: A Joint Model for Video and Language Representation Learning Code
#12ZhouSOTA
27.44
ROUGE-L· 2018-04-03
End-to-End Dense Video Captioning with Masked Transformer Code