Metric: Accuracy (higher is better)
| # | Model↕ | Accuracy▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | GPT4-Vision 4-shot+CoT | 49.7 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 2 | GPT4-Vision 4-shot | 46 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 3 | Gemini-Pro | 43.5 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 4 | Gemini-Pro 4-shot | 41.8 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 5 | GPT4-Vision | 40 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 6 | Gemini-Pro 4-shot+CoT | 33.9 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 7 | CogVLM | 28 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 8 | LLaVA-1.5-13B | 24.8 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 9 | InstructBLIP-13B | 24.3 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |