Visual Question Answering (VQA) on WHOOPS!
Metric: BEM (higher is better)
LeaderboardDataset
Loading chart...
Results
Submit a result| # | Model↕ | BEM▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | BLIP2 FlanT5-XXL (Fine-tuned) | 57 | Yes | Breaking Common Sense: WHOOPS! A Vision-and-Lang... | 2023-03-13 | - |
| 2 | BLIP2 FlanT5-XL (Fine-tuned) | 55 | Yes | Breaking Common Sense: WHOOPS! A Vision-and-Lang... | 2023-03-13 | - |
| 3 | BLIP2 FlanT5-XXL (Zero-shot) | 55 | No | Breaking Common Sense: WHOOPS! A Vision-and-Lang... | 2023-03-13 | - |
| 4 | BLIP Large | 39 | No | Breaking Common Sense: WHOOPS! A Vision-and-Lang... | 2023-03-13 | - |
| 5 | OFA Large | 38 | No | Breaking Common Sense: WHOOPS! A Vision-and-Lang... | 2023-03-13 | - |
| 6 | BLIP2 FlanT5-XXL (Text-only FT) | 24 | Yes | Breaking Common Sense: WHOOPS! A Vision-and-Lang... | 2023-03-13 | - |