TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/ClipCap (MLP + GPT2 tuning)

ClipCap (MLP + GPT2 tuning)

Reported on 15 benchmarks across 1 task · 1 paper · 3 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing15 results

  • Image CaptioningonConceptual Captions
    CIDEr· 2021-11-18
    87.26
    SOTA
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonConceptual Captions
    ROUGE-L· 2021-11-18
    26.71
    SOTA
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonConceptual Captions
    SPICE· 2021-11-18
    18.5
    SOTA
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps near-domain
    CIDEr· 2021-11-18
    67.69
    best: 125.51 (GIT2, Single Model)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps near-domain
    SPICE· 2021-11-18
    11.26
    best: 16.11 (GIT2, Single Model)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps entire
    CIDEr· 2021-11-18
    65.7
    best: 126.8 (Lyrics)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps entire
    SPICE· 2021-11-18
    11.1
    best: 15.94 (GIT, Single Model)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonCOCO Captions
    BLEU-4· 2021-11-18
    32.15
    best: 46.5 (mPLUG)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonCOCO Captions
    CIDER· 2021-11-18
    108.35
    best: 155.1 (mPLUG)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonCOCO Captions
    METEOR· 2021-11-18
    27.1
    best: 33.9 (CoCa)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image CaptioningonCOCO Captions
    SPICE· 2021-11-18
    20.12
    best: 27 (VAST)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps out-of-domain
    CIDEr· 2021-11-18
    49.35
    best: 126.67 (PaLI)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps out-of-domain
    SPICE· 2021-11-18
    9.7
    best: 15.7 (GIT, Single Model)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps in-domain
    CIDEr· 2021-11-18
    79.73
    best: 149.1 (PaLI)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734
  • Image Captioningonnocaps in-domain
    SPICE· 2021-11-18
    12.2
    best: 16.36 (GIT2, Single Model)
    ClipCap: CLIP Prefix for Image CaptioningarXiv:2111.09734