Video Question Answering on Perception Test

Metric: Accuracy (Top-1) (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Accuracy (Top-1)▼	Extra Data	Paper	Date↕	Code
1	Oyrx (34B)	71.4	No	Oryx MLLM: On-Demand Spatial-Temporal Understand...	2024-09-19	Code
2	BIMBA-LLaVA-Qwen2-7B	68.51	No	BIMBA: Selective-Scan Compression for Long-Range...	2025-03-12	Code
3	InternVideo2 (8B)	63.4	No	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
4	VideoLLaMA2 (72B)	57.5	No	VideoLLaMA 2: Advancing Spatial-Temporal Modelin...	2024-06-11	Code
5	TraveLER	50.2	No	TraveLER: A Modular Multi-LMM Agent Framework fo...	2024-04-01	Code
6	Flamingo	0.46	No	Perception Test: A Diagnostic Benchmark for Mult...	2023-05-23	Code

#1Oyrx (34B)SOTA
71.4
Accuracy (Top-1)· 2024-09-19
Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolution Code
#2BIMBA-LLaVA-Qwen2-7B
68.51
Accuracy (Top-1)· 2025-03-12
BIMBA: Selective-Scan Compression for Long-Range Video Question Answering Code
#3InternVideo2 (8B)SOTA
63.4
Accuracy (Top-1)· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#4VideoLLaMA2 (72B)
57.5
Accuracy (Top-1)· 2024-06-11
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs Code
#5TraveLER
50.2
Accuracy (Top-1)· 2024-04-01
TraveLER: A Modular Multi-LMM Agent Framework for Video Question-Answering Code
#6FlamingoSOTA
0.46
Accuracy (Top-1)· 2023-05-23
Perception Test: A Diagnostic Benchmark for Multimodal Video Models Code