Visual Question Answering (VQA) on SME
Metric: BLEU-4 (higher is better)
Metric: BLEU-4 (higher is better)
| # | Model↕ | BLEU-4▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | MEAgent | 67.91 | No | - | - | Code |
| 2 | GPT-4-1106-Vision-Preview | 45.51 | No | GPT-4 Technical Report | 2023-03-15 | Code |
| 3 | Gemini-1.5 Pro | 41.87 | No | Gemini 1.5: Unlocking multimodal understanding a... | 2024-03-08 | Code |
| 4 | Qwen-VL-Max | 24.3 | No | Qwen-VL: A Versatile Vision-Language Model for U... | 2023-08-24 | Code |
| 5 | GLM-4V | 14.45 | No | CogVLM: Visual Expert for Pretrained Language Mo... | 2023-11-06 | Code |
| 6 | VCIN | 9.17 | No | - | - | Code |
| 7 | REX | 0 | No | - | - | Code |