Visual Question Answering (VQA) on SME
Metric: SPICE (higher is better)
Metric: SPICE (higher is better)
| # | Model↕ | SPICE▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | MEAgent | 64.09 | No | - | - | Code |
| 2 | Gemini-1.5 Pro | 40.58 | No | Gemini 1.5: Unlocking multimodal understanding a... | 2024-03-08 | Code |
| 3 | GPT-4-1106-Vision-Preview | 37.67 | No | GPT-4 Technical Report | 2023-03-15 | Code |
| 4 | Qwen-VL-Max | 26.13 | No | Qwen-VL: A Versatile Vision-Language Model for U... | 2023-08-24 | Code |
| 5 | GLM-4V | 17.7 | No | CogVLM: Visual Expert for Pretrained Language Mo... | 2023-11-06 | Code |
| 6 | VCIN | 13.39 | No | - | - | Code |
| 7 | REX | 0 | No | - | - | Code |