Visual Question Answering (VQA) on IllusionVQA

Metric: Accuracy (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Accuracy▼	Extra Data	Paper	Date↕	Code
1	GPT4-Vision 4-shot	62.99	No	IllusionVQA: A Challenging Optical Illusion Data...	2024-03-23	Code
2	GPT4-Vision	58.85	No	IllusionVQA: A Challenging Optical Illusion Data...	2024-03-23	Code
3	Gemini-Pro 4-shot	52.87	No	IllusionVQA: A Challenging Optical Illusion Data...	2024-03-23	Code
4	Gemini-Pro	51.26	No	IllusionVQA: A Challenging Optical Illusion Data...	2024-03-23	Code
5	LLaVA-1.5-13B	40	No	IllusionVQA: A Challenging Optical Illusion Data...	2024-03-23	Code
6	CogVLM	38.16	No	IllusionVQA: A Challenging Optical Illusion Data...	2024-03-23	Code
7	InstructBLIP-13B	34.25	No	IllusionVQA: A Challenging Optical Illusion Data...	2024-03-23	Code

#1GPT4-Vision 4-shotSOTA
62.99
Accuracy· 2024-03-23
IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models Code
#2GPT4-Vision
58.85
Accuracy· 2024-03-23
IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models Code
#3Gemini-Pro 4-shot
52.87
Accuracy· 2024-03-23
IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models Code
#4Gemini-Pro
51.26
Accuracy· 2024-03-23
IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models Code
#5LLaVA-1.5-13B
40
Accuracy· 2024-03-23
IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models Code
#6CogVLM
38.16
Accuracy· 2024-03-23
IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models Code
#7InstructBLIP-13B
34.25
Accuracy· 2024-03-23
IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models Code