Visual Question Answering on SME

Metric: ACC (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	ACC▼	Extra Data	Paper	Date↕	Code
1	MEAgent	51.45	No	-	-	Code
2	GPT-4-1106-Vision-Preview	42.3	No	GPT-4 Technical Report	2023-03-15	Code
3	Gemini-1.5 Pro	40.88	No	Gemini 1.5: Unlocking multimodal understanding a...	2024-03-08	Code
4	Qwen-VL-Max	40.33	No	Qwen-VL: A Versatile Vision-Language Model for U...	2023-08-24	Code
5	GLM-4V	34.23	No	CogVLM: Visual Expert for Pretrained Language Mo...	2023-11-06	Code
6	VCIN	17.77	No	-	-	Code
7	REX	17.77	No	REX: Reasoning-aware and Grounded Explanation	2022-03-11	Code

#1MEAgent
51.45
ACC
No paperCode
#2GPT-4-1106-Vision-PreviewSOTA
42.3
ACC· 2023-03-15
GPT-4 Technical Report Code
#3Gemini-1.5 Pro
40.88
ACC· 2024-03-08
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context Code
#4Qwen-VL-Max
40.33
ACC· 2023-08-24
Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond Code
#5GLM-4V
34.23
ACC· 2023-11-06
CogVLM: Visual Expert for Pretrained Language Models Code
#6VCIN
17.77
ACC
No paperCode
#7REXSOTA
17.77
ACC· 2022-03-11
REX: Reasoning-aware and Grounded Explanation Code