TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/LanguageBind(ViT-L/14)

LanguageBind(ViT-L/14)

Reported on 29 benchmarks across 1 task · 1 paper · 6 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision29 results

  • Zero-Shot Video RetrievalonMSR-VTT
    video-to-text R@10· uses extra data· 2023-10-03
    77.8
    best: 84.1 (InternVideo2-6B)
    SOTA
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSVD
    text-to-video R@1· uses extra data· 2023-10-03
    54.1
    best: 59.3 (InternVideo2-6B)
    SOTA
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSVD
    text-to-video R@10· uses extra data· 2023-10-03
    88.1
    best: 89.6 (InternVideo2-6B)
    SOTA
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSVD
    text-to-video R@5· uses extra data· 2023-10-03
    81.1
    best: 84.4 (InternVideo2-6B)
    SOTA
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSVD
    video-to-text R@10· uses extra data· 2023-10-03
    97.9
    SOTA
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSVD
    video-to-text R@5· uses extra data· 2023-10-03
    91.8
    best: 94.3 (InternVideo2-1B)
    SOTA
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSR-VTT
    text-to-video Median Rank· uses extra data· 2023-10-03
    2
    best: 66 (MMT)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSR-VTT
    text-to-video R@1· uses extra data· 2023-10-03
    42.8
    best: 55.9 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSR-VTT
    text-to-video R@10· uses extra data· 2023-10-03
    76
    best: 85.1 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSR-VTT
    text-to-video R@5· uses extra data· 2023-10-03
    67.5
    best: 78.3 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSR-VTT
    video-to-text Median Rank· uses extra data· 2023-10-03
    3
    best: 12 (LaT)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSR-VTT
    video-to-text R@1· uses extra data· 2023-10-03
    38.3
    best: 53.7 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSR-VTT
    video-to-text R@5· uses extra data· 2023-10-03
    65.8
    best: 77.5 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSVD
    text-to-video Median Rank· uses extra data· 2023-10-03
    1
    best: 2 (HowToCaption)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSVD
    video-to-text Median Rank· uses extra data· 2023-10-03
    1
    best: 3 (LaT)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonMSVD
    video-to-text R@1· uses extra data· 2023-10-03
    69.7
    best: 83.3 (InternVideo2-1B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonDiDeMo
    text-to-video Median Rank· uses extra data· 2023-10-03
    2
    best: 7 (LaT)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonDiDeMo
    text-to-video R@1· uses extra data· 2023-10-03
    39.7
    best: 57.9 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonDiDeMo
    text-to-video R@10· uses extra data· 2023-10-03
    73.8
    best: 85.1 (InternVideo2-1B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonDiDeMo
    text-to-video R@5· uses extra data· 2023-10-03
    65.5
    best: 80 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonDiDeMo
    video-to-text R@1· uses extra data· 2023-10-03
    38.4
    best: 57.1 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonDiDeMo
    video-to-text R@10· uses extra data· 2023-10-03
    77.9
    best: 85 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonDiDeMo
    video-to-text R@5· uses extra data· 2023-10-03
    66.6
    best: 79.9 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonActivityNet
    text-to-video R@1· uses extra data· 2023-10-03
    38.4
    best: 63.2 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonActivityNet
    text-to-video R@10· uses extra data· 2023-10-03
    77.9
    best: 92.5 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonActivityNet
    text-to-video R@5· uses extra data· 2023-10-03
    66.6
    best: 85.6 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonActivityNet
    video-to-text R@1· uses extra data· 2023-10-03
    35.7
    best: 56.5 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonActivityNet
    video-to-text R@10· uses extra data· 2023-10-03
    77.8
    best: 90.3 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852
  • Zero-Shot Video RetrievalonActivityNet
    video-to-text R@5· uses extra data· 2023-10-03
    65.8
    best: 82.8 (InternVideo2-6B)
    LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic AlignmentarXiv:2310.01852