Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Flamingo

Flamingo

Reported on 14 benchmarks across 3 tasks · 2 papers · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Miscellaneous12 results

Image Retrieval with Multi-Modal QueryonFlickr30k
Image-to-text R@1· 2022-04-29
89.3
best: 98.8 (X2-VLM (large))
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198
Image Retrieval with Multi-Modal QueryonFlickr30k
Image-to-text R@10· 2022-04-29
99.7
best: 100 (X2-VLM (large))
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198
Image Retrieval with Multi-Modal QueryonFlickr30k
Image-to-text R@5· 2022-04-29
98.8
best: 100 (X2-VLM (large))
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198
Image Retrieval with Multi-Modal QueryonFlickr30k
Text-to-image R@1· 2022-04-29
79.5
best: 93.3 (ERNIE-ViL 2.0)
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198
Image Retrieval with Multi-Modal QueryonFlickr30k
Text-to-image R@10· 2022-04-29
97.9
best: 99.8 (ERNIE-ViL 2.0)
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198
Image Retrieval with Multi-Modal QueryonFlickr30k
Text-to-image R@5· 2022-04-29
95.3
best: 99.5 (M2-Encoder)
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198
Image Retrieval with Multi-Modal QueryonCOCO 2014
Image-to-text R@1· 2022-04-29
65.9
best: 84.8 (BEiT-3)
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198
Image Retrieval with Multi-Modal QueryonCOCO 2014
Image-to-text R@10· 2022-04-29
92.9
best: 98.5 (X2-VLM (large))
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198
Image Retrieval with Multi-Modal QueryonCOCO 2014
Image-to-text R@5· 2022-04-29
87.3
best: 96.5 (X2-VLM (large))
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198
Image Retrieval with Multi-Modal QueryonCOCO 2014
Text-to-image R@1· 2022-04-29
48
best: 68 (VAST)
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198
Image Retrieval with Multi-Modal QueryonCOCO 2014
Text-to-image R@10· 2022-04-29
82.1
best: 92.8 (VAST)
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198
Image Retrieval with Multi-Modal QueryonCOCO 2014
Text-to-image R@5· 2022-04-29
73.3
best: 92.8 (BEiT-3)
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198

Reasoning1 result

Video Question AnsweringonPerception Test
Accuracy (Top-1)· 2023-05-23
0.46
best: 71.4 (Oyrx (34B))
SOTA
Perception Test: A Diagnostic Benchmark for Multimodal Video Models arXiv:2305.13786

Natural Language Processing1 result

Visual Question Answering (VQA)onMSRVTT-QA
Accuracy· uses extra data· 2022-04-29
0.474
best: 0.496 (VLAB)
SOTA
Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198