Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/VATT-Base

VATT-Base

Reported on 6 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Audio3 results

Audio ClassificationonAudioSet
AUC· uses extra data· 2021-04-22
0.971
best: 0.981 (PSLA (Ensemble))
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178
Audio ClassificationonAudioSet
Test mAP· uses extra data· 2021-04-22
0.394
best: 0.558 (OmniVec2)
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178
Audio ClassificationonAudioSet
d-prime· uses extra data· 2021-04-22
2.895
best: 2.936 (PSLA (Ensemble))
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178

Methodology3 results

ClassificationonAudioSet
AUC· uses extra data· 2021-04-22
0.971
best: 0.981 (PSLA (Ensemble))
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178
ClassificationonAudioSet
Test mAP· uses extra data· 2021-04-22
0.394
best: 0.558 (OmniVec2)
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178
ClassificationonAudioSet
d-prime· uses extra data· 2021-04-22
2.895
best: 2.936 (PSLA (Ensemble))
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text arXiv:2104.11178