BLIP Large

Reported on 5 benchmarks across 3 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing5 results

Visual Question Answering (VQA)onWHOOPS!
BEM· 2023-03-13
39
best: 57 (BLIP2 FlanT5-XXL (Fine-tuned))
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images arXiv:2303.07274
Visual Question Answering (VQA)onWHOOPS!
Exact Match· 2023-03-13
6
best: 21 (BLIP2 FlanT5-XXL (Fine-tuned))
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images arXiv:2303.07274
Image CaptioningonWHOOPS!
BLEU-4· 2023-03-13
13
best: 42 (BLIP2 FlanT5-XXL (Fine-tuned))
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images arXiv:2303.07274
Image CaptioningonWHOOPS!
CIDEr· 2023-03-13
65
best: 177 (BLIP2 FlanT5-XXL (Fine-tuned))
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images arXiv:2303.07274
Image-to-Text RetrievalonWHOOPS!
Specificity· 2023-03-13
77
best: 94 (BLIP2 FlanT5-XXL (Text-only FT))
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images arXiv:2303.07274