TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/CLIP-ViP

CLIP-ViP

Reported on 32 benchmarks across 2 tasks · 1 paper · 10 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision32 results

  • VideoonActivityNet
    text-to-video R@1· uses extra data· 2022-09-14
    61.4
    best: 74.1 (InternVideo2-6B)
    SOTA
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonActivityNet
    text-to-video R@5· uses extra data· 2022-09-14
    85.7
    best: 90.9 (VAST)
    SOTA
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonDiDeMo
    text-to-video R@1· uses extra data· 2022-09-14
    55.3
    best: 74.2 (InternVideo2-6B)
    SOTA
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonDiDeMo
    text-to-video R@10· uses extra data· 2022-09-14
    89.3
    best: 94.2 (vid-TLDR (UMT-L))
    SOTA
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonDiDeMo
    text-to-video R@5· uses extra data· 2022-09-14
    82
    best: 91.2 (vid-TLDR (UMT-L))
    SOTA
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonActivityNet
    text-to-video R@1· uses extra data· 2022-09-14
    61.4
    best: 74.1 (InternVideo2-6B)
    SOTA
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonActivityNet
    text-to-video R@5· uses extra data· 2022-09-14
    85.7
    best: 90.9 (VAST)
    SOTA
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonDiDeMo
    text-to-video R@1· uses extra data· 2022-09-14
    55.3
    best: 74.2 (InternVideo2-6B)
    SOTA
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonDiDeMo
    text-to-video R@10· uses extra data· 2022-09-14
    89.3
    best: 94.2 (vid-TLDR (UMT-L))
    SOTA
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonDiDeMo
    text-to-video R@5· uses extra data· 2022-09-14
    82
    best: 91.2 (vid-TLDR (UMT-L))
    SOTA
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonMSR-VTT-1kA
    text-to-video Median Rank· uses extra data· 2022-09-14
    1
    best: 13 (JSFusion)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonMSR-VTT-1kA
    text-to-video R@1· uses extra data· 2022-09-14
    57.7
    best: 62.9 (HunYuan_tvr (huge))
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonMSR-VTT-1kA
    text-to-video R@10· uses extra data· 2022-09-14
    88.2
    best: 90.8 (HunYuan_tvr (huge))
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonMSR-VTT-1kA
    text-to-video R@5· uses extra data· 2022-09-14
    80.5
    best: 84.5 (HunYuan_tvr (huge))
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonActivityNet
    text-to-video Median Rank· uses extra data· 2022-09-14
    1
    best: 6 (Collaborative Experts)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonActivityNet
    text-to-video R@10· uses extra data· 2022-09-14
    92.6
    best: 96.1 (GRAM)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonDiDeMo
    text-to-video Median Rank· uses extra data· 2022-09-14
    1
    best: 8.3 (Collaborative Experts)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonLSMDC
    text-to-video Median Rank· uses extra data· 2022-09-14
    5
    best: 56.5 (CLIP)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonLSMDC
    text-to-video R@1· uses extra data· 2022-09-14
    30.7
    best: 46.4 (InternVideo2-6B)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonLSMDC
    text-to-video R@10· uses extra data· 2022-09-14
    60.6
    best: 92.8 (HunYuan_tvr (huge))
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • VideoonLSMDC
    text-to-video R@5· uses extra data· 2022-09-14
    51.4
    best: 80.1 (HunYuan_tvr (huge))
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonMSR-VTT-1kA
    text-to-video Median Rank· uses extra data· 2022-09-14
    1
    best: 13 (JSFusion)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonMSR-VTT-1kA
    text-to-video R@1· uses extra data· 2022-09-14
    57.7
    best: 62.9 (HunYuan_tvr (huge))
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonMSR-VTT-1kA
    text-to-video R@10· uses extra data· 2022-09-14
    88.2
    best: 90.8 (HunYuan_tvr (huge))
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonMSR-VTT-1kA
    text-to-video R@5· uses extra data· 2022-09-14
    80.5
    best: 84.5 (HunYuan_tvr (huge))
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonActivityNet
    text-to-video Median Rank· uses extra data· 2022-09-14
    1
    best: 6 (Collaborative Experts)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonActivityNet
    text-to-video R@10· uses extra data· 2022-09-14
    92.6
    best: 96.1 (GRAM)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonDiDeMo
    text-to-video Median Rank· uses extra data· 2022-09-14
    1
    best: 8.3 (Collaborative Experts)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonLSMDC
    text-to-video Median Rank· uses extra data· 2022-09-14
    5
    best: 56.5 (CLIP)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonLSMDC
    text-to-video R@1· uses extra data· 2022-09-14
    30.7
    best: 46.4 (InternVideo2-6B)
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonLSMDC
    text-to-video R@10· uses extra data· 2022-09-14
    60.6
    best: 92.8 (HunYuan_tvr (huge))
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430
  • Video RetrievalonLSMDC
    text-to-video R@5· uses extra data· 2022-09-14
    51.4
    best: 80.1 (HunYuan_tvr (huge))
    CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation AlignmentarXiv:2209.06430