Visual Question Answering (VQA) on SME

Metric: METEOR (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	METEOR▼	Extra Data	Paper	Date↕	Code
1	MEAgent	50.55	No	-	-	Code
2	GPT-4-1106-Vision-Preview	35.17	No	GPT-4 Technical Report	2023-03-15	Code
3	Gemini-1.5 Pro	34.61	No	Gemini 1.5: Unlocking multimodal understanding a...	2024-03-08	Code
4	Qwen-VL-Max	23.4	No	Qwen-VL: A Versatile Vision-Language Model for U...	2023-08-24	Code
5	VCIN	19.82	No	-	-	Code
6	GLM-4V	17.53	No	CogVLM: Visual Expert for Pretrained Language Mo...	2023-11-06	Code
7	REX	4.37	No	REX: Reasoning-aware and Grounded Explanation	2022-03-11	Code

#1MEAgent
50.55
METEOR
No paperCode
#2GPT-4-1106-Vision-PreviewSOTA
35.17
METEOR· 2023-03-15
GPT-4 Technical Report Code
#3Gemini-1.5 Pro
34.61
METEOR· 2024-03-08
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context Code
#4Qwen-VL-Max
23.4
METEOR· 2023-08-24
Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond Code
#5VCIN
19.82
METEOR
No paperCode
#6GLM-4V
17.53
METEOR· 2023-11-06
CogVLM: Visual Expert for Pretrained Language Models Code
#7REXSOTA
4.37
METEOR· 2022-03-11
REX: Reasoning-aware and Grounded Explanation Code