TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/ClipCap (Transformer)

ClipCap (Transformer)

Reported on 15 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing15 results

  • Image Captioningonnocaps near-domain
    CIDEr· 2021-11-18
    66.82
    best: 125.51 (GIT2, Single Model)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps near-domain
    SPICE· 2021-11-18
    10.92
    best: 16.11 (GIT2, Single Model)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonConceptual Captions
    CIDEr· 2021-11-18
    71.82
    best: 87.26 (ClipCap (MLP + GPT2 tuning))
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonConceptual Captions
    ROUGE-L· 2021-11-18
    25.12
    best: 26.71 (ClipCap (MLP + GPT2 tuning))
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonConceptual Captions
    SPICE· 2021-11-18
    16.07
    best: 18.5 (ClipCap (MLP + GPT2 tuning))
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps entire
    CIDEr· 2021-11-18
    65.83
    best: 126.8 (Lyrics)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps entire
    SPICE· 2021-11-18
    10.86
    best: 15.94 (GIT, Single Model)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonCOCO Captions
    BLEU-4· 2021-11-18
    33.53
    best: 46.5 (mPLUG)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonCOCO Captions
    CIDER· 2021-11-18
    113.08
    best: 155.1 (mPLUG)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonCOCO Captions
    METEOR· 2021-11-18
    27.45
    best: 33.9 (CoCa)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonCOCO Captions
    SPICE· 2021-11-18
    21.05
    best: 27 (VAST)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps out-of-domain
    CIDEr· 2021-11-18
    49.14
    best: 126.67 (PaLI)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps out-of-domain
    SPICE· 2021-11-18
    9.57
    best: 15.7 (GIT, Single Model)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps in-domain
    CIDEr· 2021-11-18
    84.85
    best: 149.1 (PaLI)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps in-domain
    SPICE· 2021-11-18
    12.14
    best: 16.36 (GIT2, Single Model)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734