Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/VIOLET + MELTR

VIOLET + MELTR

Reported on 17 benchmarks across 3 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision16 results

VideoonMSR-VTT-1kA
text-to-video Median Rank· 2023-03-23
3
best: 13 (JSFusion)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
VideoonMSR-VTT-1kA
text-to-video R@1· 2023-03-23
35.5
best: 62.9 (HunYuan_tvr (huge))
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
VideoonMSR-VTT-1kA
text-to-video R@10· 2023-03-23
78.4
best: 90.8 (HunYuan_tvr (huge))
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
VideoonMSR-VTT-1kA
text-to-video R@5· 2023-03-23
67.2
best: 84.5 (HunYuan_tvr (huge))
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
VideoonMSR-VTT
text-to-video Median Rank· 2023-03-23
3
best: 55 (C+LSTM+SA+FC7)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
VideoonMSR-VTT
text-to-video R@1· 2023-03-23
33.6
best: 64 (GRAM)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
VideoonMSR-VTT
text-to-video R@10· 2023-03-23
77.8
best: 89.6 (VAST)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
VideoonMSR-VTT
text-to-video R@5· 2023-03-23
63.7
best: 84.3 (VAST)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
Video RetrievalonMSR-VTT-1kA
text-to-video Median Rank· 2023-03-23
3
best: 13 (JSFusion)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
Video RetrievalonMSR-VTT-1kA
text-to-video R@1· 2023-03-23
35.5
best: 62.9 (HunYuan_tvr (huge))
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
Video RetrievalonMSR-VTT-1kA
text-to-video R@10· 2023-03-23
78.4
best: 90.8 (HunYuan_tvr (huge))
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
Video RetrievalonMSR-VTT-1kA
text-to-video R@5· 2023-03-23
67.2
best: 84.5 (HunYuan_tvr (huge))
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
Video RetrievalonMSR-VTT
text-to-video Median Rank· 2023-03-23
3
best: 55 (C+LSTM+SA+FC7)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
Video RetrievalonMSR-VTT
text-to-video R@1· 2023-03-23
33.6
best: 64 (GRAM)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
Video RetrievalonMSR-VTT
text-to-video R@10· 2023-03-23
77.8
best: 89.6 (VAST)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009
Video RetrievalonMSR-VTT
text-to-video R@5· 2023-03-23
63.7
best: 84.3 (VAST)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009

Natural Language Processing1 result

Visual Question Answering (VQA)onMSVD-QA
Accuracy· uses extra data· 2023-03-23
0.517
best: 0.61 (VLAB)
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models arXiv:2303.13009