Explanation Generation on WHOOPS!
Metric: Human (%) (higher is better)
Metric: Human (%) (higher is better)
| # | Model↕ | Human (%)▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | Ground-truth Caption -> GPT3 (Oracle) | 68 | No | Breaking Common Sense: WHOOPS! A Vision-and-Lang... | 2023-03-13 | - |
| 2 | Predicted Caption -> GPT3 | 33 | No | Breaking Common Sense: WHOOPS! A Vision-and-Lang... | 2023-03-13 | - |
| 3 | BLIP2 FlanT5-XXL (Fine-tuned) | 27 | Yes | Breaking Common Sense: WHOOPS! A Vision-and-Lang... | 2023-03-13 | - |
| 4 | BLIP2 FlanT5-XL (Fine-tuned) | 15 | Yes | Breaking Common Sense: WHOOPS! A Vision-and-Lang... | 2023-03-13 | - |
| 5 | BLIP2 FlanT5-XXL (Zero-shot) | 0 | No | - | - | - |