Metric: Accuracy (higher is better)
| # | Model↕ | Accuracy▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | GPT4-Vision 4-shot | 62.99 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 2 | GPT4-Vision | 58.85 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 3 | Gemini-Pro 4-shot | 52.87 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 4 | Gemini-Pro | 51.26 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 5 | LLaVA-1.5-13B | 40 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 6 | CogVLM | 38.16 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |
| 7 | InstructBLIP-13B | 34.25 | No | IllusionVQA: A Challenging Optical Illusion Data... | 2024-03-23 | Code |