Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/MVU (13B)

MVU (13B)

Reported on 8 benchmarks across 2 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

Question AnsweringonEgoSchema (subset)
Inference Speed (s)· 2024-03-25
2.42
SOTA
Understanding Long Videos with Multimodal Language Models arXiv:2403.16998
Question AnsweringonNExT-QA
Accuracy· 2024-03-25
55.2
best: 79.6 (VideoMultiAgent (GPT-4o))
Understanding Long Videos with Multimodal Language Models arXiv:2403.16998
Question AnsweringonEgoSchema (fullset)
Accuracy· 2024-03-25
37.6
best: 71.14 (BIMBA-LLaVA-Qwen2-7B)
Understanding Long Videos with Multimodal Language Models arXiv:2403.16998
Question AnsweringonEgoSchema (subset)
Accuracy· 2024-03-25
60.3
best: 68.6 (Tarsier (34B))
Understanding Long Videos with Multimodal Language Models arXiv:2403.16998

Reasoning4 results

Video Question AnsweringonEgoSchema (subset)
Inference Speed (s)· 2024-03-25
2.42
SOTA
Understanding Long Videos with Multimodal Language Models arXiv:2403.16998
Video Question AnsweringonNExT-QA
Accuracy· 2024-03-25
55.2
best: 85.5 (LinVT-Qwen2-VL (7B))
Understanding Long Videos with Multimodal Language Models arXiv:2403.16998
Video Question AnsweringonEgoSchema (fullset)
Accuracy· 2024-03-25
37.6
best: 71.14 (BIMBA-LLaVA-Qwen2-7B)
Understanding Long Videos with Multimodal Language Models arXiv:2403.16998
Video Question AnsweringonEgoSchema (subset)
Accuracy· 2024-03-25
60.3
best: 68.6 (Tarsier (34B))
Understanding Long Videos with Multimodal Language Models arXiv:2403.16998