Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/HD-VILA

HD-VILA

Reported on 36 benchmarks across 3 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision36 results

VideoonMSR-VTT
text-to-video MedianR· 2021-11-19
3
SOTA
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonMSR-VTT
text-to-video MedianR· 2021-11-19
3
SOTA
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonActivityNet
text-to-video Median Rank· 2021-11-19
4
best: 6 (Collaborative Experts)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonActivityNet
text-to-video R@1· 2021-11-19
28.5
best: 74.1 (InternVideo2-6B)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonActivityNet
text-to-video R@5· 2021-11-19
57.4
best: 90.9 (VAST)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonActivityNet
text-to-video R@50· 2021-11-19
94
best: 98.2 (CLIP4Clip)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonDiDeMo
text-to-video Median Rank· 2021-11-19
4
best: 8.3 (Collaborative Experts)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonDiDeMo
text-to-video R@1· 2021-11-19
28.8
best: 74.2 (InternVideo2-6B)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonDiDeMo
text-to-video R@10· 2021-11-19
69.1
best: 94.2 (vid-TLDR (UMT-L))
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonDiDeMo
text-to-video R@5· 2021-11-19
57.4
best: 91.2 (vid-TLDR (UMT-L))
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonMSR-VTT
text-to-video R@1· 2021-11-19
35.6
best: 64 (GRAM)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonMSR-VTT
text-to-video R@10· 2021-11-19
78
best: 89.6 (VAST)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonMSR-VTT
text-to-video R@5· 2021-11-19
65.3
best: 84.3 (VAST)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonLSMDC
text-to-video Median Rank· 2021-11-19
15
best: 56.5 (CLIP)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonLSMDC
text-to-video R@1· 2021-11-19
17.4
best: 46.4 (InternVideo2-6B)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonLSMDC
text-to-video R@10· 2021-11-19
44.1
best: 92.8 (HunYuan_tvr (huge))
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
VideoonLSMDC
text-to-video R@5· 2021-11-19
34.1
best: 80.1 (HunYuan_tvr (huge))
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonActivityNet
text-to-video Median Rank· 2021-11-19
4
best: 6 (Collaborative Experts)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonActivityNet
text-to-video R@1· 2021-11-19
28.5
best: 74.1 (InternVideo2-6B)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonActivityNet
text-to-video R@5· 2021-11-19
57.4
best: 90.9 (VAST)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonActivityNet
text-to-video R@50· 2021-11-19
94
best: 98.2 (CLIP4Clip)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonDiDeMo
text-to-video Median Rank· 2021-11-19
4
best: 8.3 (Collaborative Experts)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonDiDeMo
text-to-video R@1· 2021-11-19
28.8
best: 74.2 (InternVideo2-6B)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonDiDeMo
text-to-video R@10· 2021-11-19
69.1
best: 94.2 (vid-TLDR (UMT-L))
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonDiDeMo
text-to-video R@5· 2021-11-19
57.4
best: 91.2 (vid-TLDR (UMT-L))
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonMSR-VTT
text-to-video R@1· 2021-11-19
35.6
best: 64 (GRAM)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonMSR-VTT
text-to-video R@10· 2021-11-19
78
best: 89.6 (VAST)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonMSR-VTT
text-to-video R@5· 2021-11-19
65.3
best: 84.3 (VAST)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonLSMDC
text-to-video Median Rank· 2021-11-19
15
best: 56.5 (CLIP)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonLSMDC
text-to-video R@1· 2021-11-19
17.4
best: 46.4 (InternVideo2-6B)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonLSMDC
text-to-video R@10· 2021-11-19
44.1
best: 92.8 (HunYuan_tvr (huge))
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Video RetrievalonLSMDC
text-to-video R@5· 2021-11-19
34.1
best: 80.1 (HunYuan_tvr (huge))
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Zero-Shot Video RetrievalonMSR-VTT
text-to-video Median Rank· 2021-11-19
15
best: 66 (MMT)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Zero-Shot Video RetrievalonMSR-VTT
text-to-video R@1· 2021-11-19
14.6
best: 55.9 (InternVideo2-6B)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Zero-Shot Video RetrievalonMSR-VTT
text-to-video R@10· 2021-11-19
44.1
best: 85.1 (InternVideo2-6B)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337
Zero-Shot Video RetrievalonMSR-VTT
text-to-video R@5· 2021-11-19
34.4
best: 78.3 (InternVideo2-6B)
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions arXiv:2111.10337