TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Video LLaMA-7B

Video LLaMA-7B

Reported on 8 benchmarks across 2 tasks · 1 paper · 4 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

  • Question AnsweringonMSVD-QA
    Confidence Score· 2023-06-05
    2.5
    SOTA
    Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingarXiv:2306.02858
  • Question AnsweringonMSRVTT-QA
    Confidence Score· 2023-06-05
    1.8
    SOTA
    Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingarXiv:2306.02858
  • Question AnsweringonMSVD-QA
    Accuracy· 2023-06-05
    51.6
    best: 80.3 (Tarsier (34B))
    Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingarXiv:2306.02858
  • Question AnsweringonMSRVTT-QA
    Accuracy· 2023-06-05
    29.6
    best: 72.4 (Flash-VStream)
    Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingarXiv:2306.02858

Reasoning4 results

  • Video Question AnsweringonMSVD-QA
    Confidence Score· 2023-06-05
    2.5
    SOTA
    Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingarXiv:2306.02858
  • Video Question AnsweringonMSRVTT-QA
    Confidence Score· 2023-06-05
    1.8
    SOTA
    Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingarXiv:2306.02858
  • Video Question AnsweringonMSVD-QA
    Accuracy· 2023-06-05
    51.6
    best: 80.3 (Tarsier (34B))
    Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingarXiv:2306.02858
  • Video Question AnsweringonMSRVTT-QA
    Accuracy· 2023-06-05
    29.6
    best: 72.4 (Flash-VStream)
    Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingarXiv:2306.02858