Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/GSMN

GSMN

Reported on 25 benchmarks across 5 tasks · 2 papers · 12 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Miscellaneous12 results

Cross-Modal Information RetrievalonFlickr30k
Text-to-image R@1· 2020-04-01
57.4
best: 93.3 (ERNIE-ViL 2.0)
SOTA
Graph Structured Network for Image-Text Matching arXiv:2004.00277
Cross-Modal Information RetrievalonFlickr30k
Text-to-image R@10· 2020-04-01
89
best: 99.8 (ERNIE-ViL 2.0)
SOTA
Graph Structured Network for Image-Text Matching arXiv:2004.00277
Cross-Modal Information RetrievalonFlickr30k
Text-to-image R@5· 2020-04-01
82.3
best: 99.4 (ERNIE-ViL 2.0)
SOTA
Graph Structured Network for Image-Text Matching arXiv:2004.00277
Image Retrieval with Multi-Modal QueryonFlickr30k
Image-to-text R@1· 2021-06-04
76.4
best: 98.8 (X2-VLM (large))
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Image Retrieval with Multi-Modal QueryonFlickr30k
Image-to-text R@10· 2021-06-04
97.3
best: 100 (X2-VLM (large))
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Image Retrieval with Multi-Modal QueryonFlickr30k
Image-to-text R@5· 2021-06-04
94.3
best: 100 (X2-VLM (large))
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Cross-Modal Information RetrievalonFlickr30k
Image-to-text R@1· 2021-06-04
76.4
best: 98.8 (X2-VLM (large))
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Cross-Modal Information RetrievalonFlickr30k
Image-to-text R@10· 2021-06-04
97.3
best: 100 (X2-VLM (large))
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Cross-Modal Information RetrievalonFlickr30k
Image-to-text R@5· 2021-06-04
94.3
best: 100 (X2-VLM (large))
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Image Retrieval with Multi-Modal QueryonFlickr30k
Text-to-image R@1· 2020-04-01
57.4
best: 93.3 (ERNIE-ViL 2.0)
Graph Structured Network for Image-Text Matching arXiv:2004.00277
Image Retrieval with Multi-Modal QueryonFlickr30k
Text-to-image R@10· 2020-04-01
89
best: 99.8 (ERNIE-ViL 2.0)
Graph Structured Network for Image-Text Matching arXiv:2004.00277
Image Retrieval with Multi-Modal QueryonFlickr30k
Text-to-image R@5· 2020-04-01
82.3
best: 99.5 (M2-Encoder)
Graph Structured Network for Image-Text Matching arXiv:2004.00277

Natural Language Processing10 results

Image-to-Text RetrievalonFlickr30k
Recall@1· 2021-06-04
76.4
best: 97.9 (InternVL-G-FT (finetuned, w/o ranking))
SOTA
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Image-to-Text RetrievalonFlickr30k
Recall@10· 2021-06-04
97.3
best: 100 (InternVL-G-FT (finetuned, w/o ranking))
SOTA
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Image-to-Text RetrievalonFlickr30k
Recall@5· 2021-06-04
94.3
best: 100 (InternVL-G-FT (finetuned, w/o ranking))
SOTA
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Image-to-Text RetrievalonFlickr30k
Recall@Sum· 2021-06-04
268
SOTA
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Cross-Modal RetrievalonFlickr30k
Text-to-image R@1· 2020-04-01
57.4
best: 93.3 (ERNIE-ViL 2.0)
SOTA
Graph Structured Network for Image-Text Matching arXiv:2004.00277
Cross-Modal RetrievalonFlickr30k
Text-to-image R@10· 2020-04-01
89
best: 99.8 (ERNIE-ViL 2.0)
SOTA
Graph Structured Network for Image-Text Matching arXiv:2004.00277
Cross-Modal RetrievalonFlickr30k
Text-to-image R@5· 2020-04-01
82.3
best: 99.4 (ERNIE-ViL 2.0)
SOTA
Graph Structured Network for Image-Text Matching arXiv:2004.00277
Cross-Modal RetrievalonFlickr30k
Image-to-text R@1· 2021-06-04
76.4
best: 98.8 (X2-VLM (large))
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Cross-Modal RetrievalonFlickr30k
Image-to-text R@10· 2021-06-04
97.3
best: 100 (X2-VLM (large))
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400
Cross-Modal RetrievalonFlickr30k
Image-to-text R@5· 2021-06-04
94.3
best: 100 (X2-VLM (large))
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400

Computer Vision3 results

Image RetrievalonFlickr30k
Recall@10· 2020-04-01
89
best: 98.9 (BLIP-2 ViT-G (zero-shot, 1K test set))
SOTA
Graph Structured Network for Image-Text Matching arXiv:2004.00277
Image RetrievalonFlickr30k
Recall@5· 2020-04-01
82.3
best: 98.1 (BLIP-2 ViT-G (zero-shot, 1K test set))
SOTA
Graph Structured Network for Image-Text Matching arXiv:2004.00277
Image RetrievalonFlickr30k
Recall@Sum· 2021-06-04
228.7
best: 231.7 (LGSGM)
A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval arXiv:2106.02400