MCIC-COCO

A large-scale machine comprehension dataset (based on the COCO images and captions).

Source: Understanding Image and Text Simultaneously: a Dual Vision-Language Machine Comprehension Task