TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Pearl

Pearl

Reported on 19 benchmarks across 4 tasks

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Miscellaneous12 results

  • Image Retrieval with Multi-Modal QueryonFlickr30k
    Image-to-text R@1
    75.3
    best: 98.8 (X2-VLM (large))
  • Image Retrieval with Multi-Modal QueryonFlickr30k
    Image-to-text R@10
    97.3
    best: 100 (X2-VLM (large))
  • Image Retrieval with Multi-Modal QueryonFlickr30k
    Image-to-text R@5
    93.4
    best: 100 (X2-VLM (large))
  • Image Retrieval with Multi-Modal QueryonFlickr30k
    Text-to-image R@1
    54.98
    best: 93.3 (ERNIE-ViL 2.0)
  • Image Retrieval with Multi-Modal QueryonFlickr30k
    Text-to-image R@10
    88.26
    best: 99.8 (ERNIE-ViL 2.0)
  • Image Retrieval with Multi-Modal QueryonFlickr30k
    Text-to-image R@5
    81.3
    best: 99.5 (M2-Encoder)
  • Cross-Modal Information RetrievalonFlickr30k
    Image-to-text R@1
    75.3
    best: 98.8 (X2-VLM (large))
  • Cross-Modal Information RetrievalonFlickr30k
    Image-to-text R@10
    97.3
    best: 100 (X2-VLM (large))
  • Cross-Modal Information RetrievalonFlickr30k
    Image-to-text R@5
    93.4
    best: 100 (X2-VLM (large))
  • Cross-Modal Information RetrievalonFlickr30k
    Text-to-image R@1
    54.98
    best: 93.3 (ERNIE-ViL 2.0)
  • Cross-Modal Information RetrievalonFlickr30k
    Text-to-image R@10
    88.26
    best: 99.8 (ERNIE-ViL 2.0)
  • Cross-Modal Information RetrievalonFlickr30k
    Text-to-image R@5
    81.3
    best: 99.4 (ERNIE-ViL 2.0)

Natural Language Processing7 results

  • Semantic Textual SimilarityonSTS Benchmark
    Spearman Correlation
    0.7981
    best: 0.931 (Mnet-Sim)
  • Cross-Modal RetrievalonFlickr30k
    Image-to-text R@1
    75.3
    best: 98.8 (X2-VLM (large))
  • Cross-Modal RetrievalonFlickr30k
    Image-to-text R@10
    97.3
    best: 100 (X2-VLM (large))
  • Cross-Modal RetrievalonFlickr30k
    Image-to-text R@5
    93.4
    best: 100 (X2-VLM (large))
  • Cross-Modal RetrievalonFlickr30k
    Text-to-image R@1
    54.98
    best: 93.3 (ERNIE-ViL 2.0)
  • Cross-Modal RetrievalonFlickr30k
    Text-to-image R@10
    88.26
    best: 99.8 (ERNIE-ViL 2.0)
  • Cross-Modal RetrievalonFlickr30k
    Text-to-image R@5
    81.3
    best: 99.4 (ERNIE-ViL 2.0)