Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/VATT-Large

VATT-Large

Reported on 6 benchmarks across 1 task · 1 paper · 3 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision6 results

VideoonMiT
Top 1 Accuracy· uses extra data· 2021-04-22
41.1
best: 53.1 (OmniVec2)
SOTA
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178
VideoonMiT
Top 5 Accuracy· uses extra data· 2021-04-22
67.7
best: 78.2 (UMT-L (ViT-L/16))
SOTA
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178
VideoonKinetics-600
Top-5 Accuracy· uses extra data· 2021-04-22
96.6
best: 98.9 (TubeVit-H)
SOTA
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178
VideoonKinetics-400
Acc@1· 2021-04-22
82.1
best: 93.6 (OmniVec2)
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178
VideoonKinetics-400
Acc@5· 2021-04-22
95.5
best: 98.9 (TubeViT-H (ImageNet-1k))
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178
VideoonKinetics-600
Top-1 Accuracy· uses extra data· 2021-04-22
83.6
best: 91.9 (InternVideo2-6B)
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178