Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/BLIP-2 ViT-G FlanT5 XL (zero-shot)

BLIP-2 ViT-G FlanT5 XL (zero-shot)

Reported on 14 benchmarks across 2 tasks · 1 paper · 8 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing14 results

Image Captioningonnocaps-val-out-domain
CIDEr· 2023-01-30
124.8
SOTA
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Image Captioningonnocaps-val-out-domain
SPICE· 2023-01-30
15.1
SOTA
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Image Captioningonnocaps-val-near-domain
CIDEr· 2023-01-30
120.2
SOTA
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Image Captioningonnocaps-val-near-domain
SPICE· 2023-01-30
15.9
SOTA
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Image Captioningonnocaps-val-overall
CIDEr· 2023-01-30
121.6
SOTA
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Image Captioningonnocaps-val-overall
SPICE· 2023-01-30
15.8
SOTA
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Image Captioningonnocaps-val-in-domain
CIDEr· 2023-01-30
123.7
SOTA
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Image Captioningonnocaps-val-in-domain
SPICE· 2023-01-30
16.3
SOTA
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Visual Question Answering (VQA)onOK-VQA
Accuracy· 2023-01-30
40.7
best: 66.8 (PaLI-X-VPD)
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Visual Question Answering (VQA)onVQA v2 val
Accuracy· 2023-01-30
63.1
best: 82.19 (BLIP-2 ViT-G OPT 6.7B (fine-tuned))
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Visual Question Answering (VQA)onGQA test-dev
Accuracy· 2023-01-30
44.2
best: 72.1 (CFR)
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Visual Question Answering (VQA)onVQA v2 test-dev
Accuracy· 2023-01-30
63
best: 84.3 (PaLI)
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Image CaptioningonCOCO Captions
BLEU-4· 2023-01-30
42.4
best: 46.5 (mPLUG)
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597
Image CaptioningonCOCO Captions
CIDER· 2023-01-30
144.5
best: 155.1 (mPLUG)
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models arXiv:2301.12597