TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Elysium

Elysium

Reported on 22 benchmarks across 4 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing8 results

  • Question AnsweringonMSRVTT-QA
    Accuracy· 2024-03-25
    67.5
    best: 72.4 (Flash-VStream)
    SOTA
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Question AnsweringonMSVD-QA
    Accuracy· 2024-03-25
    75.8
    best: 80.3 (Tarsier (34B))
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Question AnsweringonMSVD-QA
    Confidence Score· 2024-03-25
    3.7
    best: 2.5 (Video LLaMA-7B)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Question AnsweringonTGIF-QA
    Accuracy· 2024-03-25
    66.6
    best: 82.5 (Tarsier (34B))
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Question AnsweringonTGIF-QA
    Confidence Score· 2024-03-25
    3.6
    best: 2.3 (Video Chat-7B)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Question AnsweringonMSRVTT-QA
    Confidence Score· 2024-03-25
    3.2
    best: 1.8 (Video LLaMA-7B)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Question AnsweringonActivityNet-QA
    Accuracy· 2024-03-25
    43.4
    best: 61.6 (Tarsier (34B))
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Question AnsweringonActivityNet-QA
    Confidence Score· 2024-03-25
    2.9
    best: 1.1 (Video LLaMA)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558

Reasoning8 results

  • Video Question AnsweringonMSRVTT-QA
    Accuracy· 2024-03-25
    67.5
    best: 72.4 (Flash-VStream)
    SOTA
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Video Question AnsweringonMSVD-QA
    Accuracy· 2024-03-25
    75.8
    best: 80.3 (Tarsier (34B))
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Video Question AnsweringonMSVD-QA
    Confidence Score· 2024-03-25
    3.7
    best: 2.5 (Video LLaMA-7B)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Video Question AnsweringonTGIF-QA
    Accuracy· 2024-03-25
    66.6
    best: 82.5 (Tarsier (34B))
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Video Question AnsweringonTGIF-QA
    Confidence Score· 2024-03-25
    3.6
    best: 2.3 (Video Chat-7B)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Video Question AnsweringonMSRVTT-QA
    Confidence Score· 2024-03-25
    3.2
    best: 1.8 (Video LLaMA-7B)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Video Question AnsweringonActivityNet-QA
    Accuracy· 2024-03-25
    43.4
    best: 61.6 (Tarsier (34B))
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Video Question AnsweringonActivityNet-QA
    Confidence Score· 2024-03-25
    2.9
    best: 1.1 (Video LLaMA)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558

Computer Vision6 results

  • Object TrackingonLaSOT
    AUC· 2024-03-25
    56.1
    best: 77.4 (SPMTrack-G)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Object TrackingonLaSOT
    Normalized Precision· 2024-03-25
    61
    best: 86.6 (SPMTrack-G)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Object TrackingonLaSOT
    Precision· 2024-03-25
    50.1
    best: 85 (SPMTrack-G)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Visual Object TrackingonLaSOT
    AUC· 2024-03-25
    56.1
    best: 77.4 (SPMTrack-G)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Visual Object TrackingonLaSOT
    Normalized Precision· 2024-03-25
    61
    best: 86.6 (SPMTrack-G)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558
  • Visual Object TrackingonLaSOT
    Precision· 2024-03-25
    50.1
    best: 85 (SPMTrack-G)
    Elysium: Exploring Object-level Perception in Videos via MLLMarXiv:2403.16558