CxC

Crisscrossed Captions (CxC) contains 247,315 human-labeled annotations including positive and negative associations between image pairs, caption pairs and image-caption pairs.

Image source: Crisscrossed Captions: Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO