Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/HunYuan_tvr (huge)

HunYuan_tvr (huge)

Reported on 80 benchmarks across 2 tasks · 1 paper · 38 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision80 results

VideoonMSR-VTT-1kA
text-to-video R@1· uses extra data· 2022-04-07
62.9
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSR-VTT-1kA
text-to-video R@10· uses extra data· 2022-04-07
90.8
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSR-VTT-1kA
text-to-video R@5· uses extra data· 2022-04-07
84.5
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSR-VTT-1kA
video-to-text R@1· uses extra data· 2022-04-07
64.8
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSR-VTT-1kA
video-to-text R@10· uses extra data· 2022-04-07
91.1
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSR-VTT-1kA
video-to-text R@5· uses extra data· 2022-04-07
84.9
best: 783 (PIDRo)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonDiDeMo
text-to-video R@1· uses extra data· 2022-04-07
52.7
best: 74.2 (InternVideo2-6B)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonLSMDC
text-to-video R@1· uses extra data· 2022-04-07
40.4
best: 46.4 (InternVideo2-6B)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonLSMDC
text-to-video R@10· uses extra data· 2022-04-07
92.8
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonLSMDC
text-to-video R@5· uses extra data· 2022-04-07
80.1
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonLSMDC
video-to-text R@1· uses extra data· 2022-04-07
34.6
best: 46.7 (InternVideo2-6B)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonLSMDC
video-to-text R@10· uses extra data· 2022-04-07
91.8
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonLSMDC
video-to-text R@5· uses extra data· 2022-04-07
71.8
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSVD
text-to-video R@1· uses extra data· 2022-04-07
59
best: 61.4 (InternVideo2-6B)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSVD
text-to-video R@10· uses extra data· 2022-04-07
90.3
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSVD
video-to-text Mean Rank· uses extra data· 2022-04-07
7.6
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSVD
video-to-text R@1· uses extra data· 2022-04-07
73
best: 85.2 (InternVideo2-6B)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSVD
video-to-text R@10· uses extra data· 2022-04-07
96.6
best: 97.1 (PAU)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSVD
video-to-text R@5· uses extra data· 2022-04-07
94.5
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSR-VTT-1kA
text-to-video R@1· uses extra data· 2022-04-07
62.9
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSR-VTT-1kA
text-to-video R@10· uses extra data· 2022-04-07
90.8
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSR-VTT-1kA
text-to-video R@5· uses extra data· 2022-04-07
84.5
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSR-VTT-1kA
video-to-text R@1· uses extra data· 2022-04-07
64.8
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSR-VTT-1kA
video-to-text R@10· uses extra data· 2022-04-07
91.1
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSR-VTT-1kA
video-to-text R@5· uses extra data· 2022-04-07
84.9
best: 783 (PIDRo)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonDiDeMo
text-to-video R@1· uses extra data· 2022-04-07
52.7
best: 74.2 (InternVideo2-6B)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonLSMDC
text-to-video R@1· uses extra data· 2022-04-07
40.4
best: 46.4 (InternVideo2-6B)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonLSMDC
text-to-video R@10· uses extra data· 2022-04-07
92.8
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonLSMDC
text-to-video R@5· uses extra data· 2022-04-07
80.1
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonLSMDC
video-to-text R@1· uses extra data· 2022-04-07
34.6
best: 46.7 (InternVideo2-6B)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonLSMDC
video-to-text R@10· uses extra data· 2022-04-07
91.8
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonLSMDC
video-to-text R@5· uses extra data· 2022-04-07
71.8
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSVD
text-to-video R@1· uses extra data· 2022-04-07
59
best: 61.4 (InternVideo2-6B)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSVD
text-to-video R@10· uses extra data· 2022-04-07
90.3
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSVD
video-to-text Mean Rank· uses extra data· 2022-04-07
7.6
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSVD
video-to-text R@1· uses extra data· 2022-04-07
73
best: 85.2 (InternVideo2-6B)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSVD
video-to-text R@10· uses extra data· 2022-04-07
96.6
best: 97.1 (PAU)
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSVD
video-to-text R@5· uses extra data· 2022-04-07
94.5
SOTA
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSR-VTT-1kA
text-to-video Mean Rank· uses extra data· 2022-04-07
9.3
best: 28.2 (Collaborative Experts)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSR-VTT-1kA
text-to-video Median Rank· uses extra data· 2022-04-07
1
best: 13 (JSFusion)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSR-VTT-1kA
video-to-text Mean Rank· uses extra data· 2022-04-07
5.5
best: 10.2 (CenterCLIP (ViT-B/16))
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSR-VTT-1kA
video-to-text Median Rank· uses extra data· 2022-04-07
1
best: 5 (CLIP)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonDiDeMo
text-to-video Mean Rank· uses extra data· 2022-04-07
13.7
best: 43.7 (Collaborative Experts)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonDiDeMo
text-to-video Median Rank· uses extra data· 2022-04-07
1
best: 8.3 (Collaborative Experts)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonDiDeMo
text-to-video R@10· uses extra data· 2022-04-07
85.2
best: 94.2 (vid-TLDR (UMT-L))
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonDiDeMo
text-to-video R@5· uses extra data· 2022-04-07
77.8
best: 91.2 (vid-TLDR (UMT-L))
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonDiDeMo
video-to-text Mean Rank· uses extra data· 2022-04-07
9.1
best: 39.6 (PO Loss)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonDiDeMo
video-to-text Median Rank· uses extra data· 2022-04-07
1
best: 8 (PO Loss)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonDiDeMo
video-to-text R@1· uses extra data· 2022-04-07
54.1
best: 71.9 (InternVideo2-6B)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonDiDeMo
video-to-text R@10· uses extra data· 2022-04-07
86.8
best: 93.8 (vid-TLDR (UMT-L))
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonDiDeMo
video-to-text R@5· uses extra data· 2022-04-07
78.3
best: 89.8 (vid-TLDR (UMT-L))
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonLSMDC
text-to-video Mean Rank· uses extra data· 2022-04-07
3.9
best: 58 (CLIP4Clip)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonLSMDC
text-to-video Median Rank· uses extra data· 2022-04-07
2
best: 56.5 (CLIP)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonLSMDC
video-to-text Mean Rank· uses extra data· 2022-04-07
4.3
best: 48.9 (HunYuan_tvr)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonLSMDC
video-to-text Median Rank· uses extra data· 2022-04-07
2
best: 73 (CLIP)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSVD
text-to-video Mean Rank· uses extra data· 2022-04-07
7.6
best: 23.1 (Collaborative Experts)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSVD
text-to-video Median Rank· uses extra data· 2022-04-07
1
best: 6 (SSML)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSVD
text-to-video R@5· uses extra data· 2022-04-07
84
best: 87.6 (CAMoE)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
VideoonMSVD
video-to-text Median Rank· uses extra data· 2022-04-07
1
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSR-VTT-1kA
text-to-video Mean Rank· uses extra data· 2022-04-07
9.3
best: 28.2 (Collaborative Experts)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSR-VTT-1kA
text-to-video Median Rank· uses extra data· 2022-04-07
1
best: 13 (JSFusion)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSR-VTT-1kA
video-to-text Mean Rank· uses extra data· 2022-04-07
5.5
best: 10.2 (CenterCLIP (ViT-B/16))
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSR-VTT-1kA
video-to-text Median Rank· uses extra data· 2022-04-07
1
best: 5 (CLIP)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonDiDeMo
text-to-video Mean Rank· uses extra data· 2022-04-07
13.7
best: 43.7 (Collaborative Experts)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonDiDeMo
text-to-video Median Rank· uses extra data· 2022-04-07
1
best: 8.3 (Collaborative Experts)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonDiDeMo
text-to-video R@10· uses extra data· 2022-04-07
85.2
best: 94.2 (vid-TLDR (UMT-L))
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonDiDeMo
text-to-video R@5· uses extra data· 2022-04-07
77.8
best: 91.2 (vid-TLDR (UMT-L))
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonDiDeMo
video-to-text Mean Rank· uses extra data· 2022-04-07
9.1
best: 39.6 (PO Loss)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonDiDeMo
video-to-text Median Rank· uses extra data· 2022-04-07
1
best: 8 (PO Loss)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonDiDeMo
video-to-text R@1· uses extra data· 2022-04-07
54.1
best: 71.9 (InternVideo2-6B)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonDiDeMo
video-to-text R@10· uses extra data· 2022-04-07
86.8
best: 93.8 (vid-TLDR (UMT-L))
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonDiDeMo
video-to-text R@5· uses extra data· 2022-04-07
78.3
best: 89.8 (vid-TLDR (UMT-L))
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonLSMDC
text-to-video Mean Rank· uses extra data· 2022-04-07
3.9
best: 58 (CLIP4Clip)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonLSMDC
text-to-video Median Rank· uses extra data· 2022-04-07
2
best: 56.5 (CLIP)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonLSMDC
video-to-text Mean Rank· uses extra data· 2022-04-07
4.3
best: 48.9 (HunYuan_tvr)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonLSMDC
video-to-text Median Rank· uses extra data· 2022-04-07
2
best: 73 (CLIP)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSVD
text-to-video Mean Rank· uses extra data· 2022-04-07
7.6
best: 23.1 (Collaborative Experts)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSVD
text-to-video Median Rank· uses extra data· 2022-04-07
1
best: 6 (SSML)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSVD
text-to-video R@5· uses extra data· 2022-04-07
84
best: 87.6 (CAMoE)
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382
Video RetrievalonMSVD
video-to-text Median Rank· uses extra data· 2022-04-07
1
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations arXiv:2204.03382