Video-based Generative Performance Benchmarking on VideoInstruct

Metric: Correctness of Information (higher is better)

LeaderboardDataset

Loading chart...

Results

#	Model↕	Correctness of Information▼	Extra Data	Paper	Date↕	Code
1	PPLLaVA-7B-dpo	3.85	No	PPLLaVA: Varied Video Sequence Understanding Wit...	2024-11-04	Code
2	VLM-RLAIF	3.63	No	Tuning Large Multimodal Models for Videos using ...	2024-02-06	Code
3	PLLaVA-34B	3.6	No	PLLaVA : Parameter-free LLaVA Extension from Ima...	2024-04-25	Code
4	IG-VLM-GPT4v	3.4	No	An Image Grid Can Be Worth a Video: Zero-shot Vi...	2024-03-27	Code
5	VideoChat2_HD_mistral	3.4	No	MVBench: A Comprehensive Multi-modal Video Under...	2023-11-28	Code
6	PPLLaVA-7B	3.32	No	PPLLaVA: Varied Video Sequence Understanding Wit...	2024-11-04	Code
7	VideoGPT+	3.27	No	VideoGPT+: Integrating Image and Video Encoders ...	2024-06-13	Code
8	ST-LLM-7B	3.23	No	ST-LLM: Large Language Models Are Effective Temp...	2024-03-30	Code
9	CAT-7B	3.08	No	CAT: Enhancing Multimodal Large Language Model t...	2024-03-07	Code
10	LLaMA-VID-13B (2 Token)	3.07	No	LLaMA-VID: An Image is Worth 2 Tokens in Large L...	2023-11-28	Code
11	VideoChat2	3.02	No	MVBench: A Comprehensive Multi-modal Video Under...	2023-11-28	Code
12	LLaMA-VID-7B (2 Token)	2.96	No	LLaMA-VID: An Image is Worth 2 Tokens in Large L...	2023-11-28	Code
13	LITA-13B	2.94	No	LITA: Language Instructed Temporal-Localization ...	2024-03-27	Code
14	Chat-UniVi	2.89	No	Chat-UniVi: Unified Visual Representation Empowe...	2023-11-14	Code
15	VTimeLLM	2.78	No	VTimeLLM: Empower LLM to Grasp Video Moments	2023-11-30	Code
16	BT-Adapter	2.68	No	BT-Adapter: Video Conversation is Feasible Witho...	2023-09-27	Code
17	Video-ChatGPT	2.4	No	Video-ChatGPT: Towards Detailed Video Understand...	2023-06-08	Code
18	Video Chat	2.23	No	VideoChat: Chat-Centric Video Understanding	2023-05-10	Code
19	BT-Adapter (zero-shot)	2.16	No	BT-Adapter: Video Conversation is Feasible Witho...	2023-09-27	Code
20	LLaMA Adapter	2.03	No	LLaMA-Adapter V2: Parameter-Efficient Visual Ins...	2023-04-28	Code
21	Video LLaMA	1.96	No	Video-LLaMA: An Instruction-tuned Audio-Visual L...	2023-06-05	Code