Visual Question Answering (VQA) on SME

Metric: CIDEr (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	CIDEr▼	Extra Data	Paper	Date↕	Code
1	MEAgent	510.44	No	-	-	Code
2	Gemini-1.5 Pro	276.14	No	Gemini 1.5: Unlocking multimodal understanding a...	2024-03-08	Code
3	GPT-4-1106-Vision-Preview	269.68	No	GPT-4 Technical Report	2023-03-15	Code
4	Qwen-VL-Max	201.47	No	Qwen-VL: A Versatile Vision-Language Model for U...	2023-08-24	Code
5	GLM-4V	127.37	No	CogVLM: Visual Expert for Pretrained Language Mo...	2023-11-06	Code
6	VCIN	4.28	No	-	-	Code
7	REX	0.89	No	REX: Reasoning-aware and Grounded Explanation	2022-03-11	Code

#1MEAgent
510.44
CIDEr
No paperCode
#2Gemini-1.5 ProSOTA
276.14
CIDEr· 2024-03-08
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context Code
#3GPT-4-1106-Vision-PreviewSOTA
269.68
CIDEr· 2023-03-15
GPT-4 Technical Report Code
#4Qwen-VL-Max
201.47
CIDEr· 2023-08-24
Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond Code
#5GLM-4V
127.37
CIDEr· 2023-11-06
CogVLM: Visual Expert for Pretrained Language Models Code
#6VCIN
4.28
CIDEr
No paperCode
#7REXSOTA
0.89
CIDEr· 2022-03-11
REX: Reasoning-aware and Grounded Explanation Code