Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/IAIS

IAIS

Reported on 21 benchmarks across 4 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Miscellaneous12 results

Image Retrieval with Multi-Modal QueryonFlickr30k
Image-to-text R@1· uses extra data· 2021-05-28
88.3
best: 98.8 (X2-VLM (large))
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Image Retrieval with Multi-Modal QueryonFlickr30k
Image-to-text R@10· uses extra data· 2021-05-28
99.4
best: 100 (X2-VLM (large))
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Image Retrieval with Multi-Modal QueryonFlickr30k
Image-to-text R@5· uses extra data· 2021-05-28
98.4
best: 100 (X2-VLM (large))
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Image Retrieval with Multi-Modal QueryonFlickr30k
Text-to-image R@1· uses extra data· 2021-05-28
76.86
best: 93.3 (ERNIE-ViL 2.0)
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Image Retrieval with Multi-Modal QueryonFlickr30k
Text-to-image R@10· uses extra data· 2021-05-28
95.72
best: 99.8 (ERNIE-ViL 2.0)
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Image Retrieval with Multi-Modal QueryonFlickr30k
Text-to-image R@5· uses extra data· 2021-05-28
93.3
best: 99.5 (M2-Encoder)
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal Information RetrievalonFlickr30k
Image-to-text R@1· uses extra data· 2021-05-28
88.3
best: 98.8 (X2-VLM (large))
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal Information RetrievalonFlickr30k
Image-to-text R@10· uses extra data· 2021-05-28
99.4
best: 100 (X2-VLM (large))
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal Information RetrievalonFlickr30k
Image-to-text R@5· uses extra data· 2021-05-28
98.4
best: 100 (X2-VLM (large))
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal Information RetrievalonFlickr30k
Text-to-image R@1· uses extra data· 2021-05-28
76.86
best: 93.3 (ERNIE-ViL 2.0)
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal Information RetrievalonFlickr30k
Text-to-image R@10· uses extra data· 2021-05-28
95.72
best: 99.8 (ERNIE-ViL 2.0)
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal Information RetrievalonFlickr30k
Text-to-image R@5· uses extra data· 2021-05-28
93.3
best: 99.4 (ERNIE-ViL 2.0)
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868

Natural Language Processing9 results

Image-to-Text RetrievalonCOCO (Common Objects in Context)
Recall@1· 2021-05-28
67.78
best: 85.4 (BLIP-2 (ViT-G, fine-tuned))
SOTA
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Image-to-Text RetrievalonCOCO (Common Objects in Context)
Recall@5· 2021-05-28
89.7
best: 97 (BLIP-2 (ViT-G, fine-tuned))
SOTA
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal RetrievalonFlickr30k
Image-to-text R@1· uses extra data· 2021-05-28
88.3
best: 98.8 (X2-VLM (large))
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal RetrievalonFlickr30k
Image-to-text R@10· uses extra data· 2021-05-28
99.4
best: 100 (X2-VLM (large))
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal RetrievalonFlickr30k
Image-to-text R@5· uses extra data· 2021-05-28
98.4
best: 100 (X2-VLM (large))
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal RetrievalonFlickr30k
Text-to-image R@1· uses extra data· 2021-05-28
76.86
best: 93.3 (ERNIE-ViL 2.0)
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal RetrievalonFlickr30k
Text-to-image R@10· uses extra data· 2021-05-28
95.72
best: 99.8 (ERNIE-ViL 2.0)
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Cross-Modal RetrievalonFlickr30k
Text-to-image R@5· uses extra data· 2021-05-28
93.3
best: 99.4 (ERNIE-ViL 2.0)
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868
Image-to-Text RetrievalonCOCO (Common Objects in Context)
Recall@10· 2021-05-28
94.48
best: 99.8 (Oscar)
Learning Relation Alignment for Calibrated Cross-modal Retrieval arXiv:2105.13868