TraveLER

Reported on 3 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Reasoning2 results

Video Question AnsweringonPerception Test
Accuracy (Top-1)· 2024-04-01
50.2
best: 71.4 (Oyrx (34B))
TraveLER: A Modular Multi-LMM Agent Framework for Video Question-Answering arXiv:2404.01476
Video Question AnsweringonEgoSchema (fullset)
Accuracy· 2024-04-01
53.3
best: 71.14 (BIMBA-LLaVA-Qwen2-7B)
TraveLER: A Modular Multi-LMM Agent Framework for Video Question-Answering arXiv:2404.01476

Natural Language Processing1 result

Question AnsweringonEgoSchema (fullset)
Accuracy· 2024-04-01
53.3
best: 71.14 (BIMBA-LLaVA-Qwen2-7B)
TraveLER: A Modular Multi-LMM Agent Framework for Video Question-Answering arXiv:2404.01476