TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Lyra-Pro

Lyra-Pro

Reported on 8 benchmarks across 2 tasks · 1 paper · 6 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing8 results

  • Visual Question Answering (VQA)onMM-Vet
    Acc· 2024-12-12
    71.4
    SOTA
    Lyra: An Efficient and Speech-Centric Framework for Omni-CognitionarXiv:2412.09501
  • Visual Question Answering (VQA)onMME
    Acc· 2024-12-12
    2485
    SOTA
    Lyra: An Efficient and Speech-Centric Framework for Omni-CognitionarXiv:2412.09501
  • Visual Question Answering (VQA)onEgoSchema
    Acc· 2024-12-12
    75.8
    SOTA
    Lyra: An Efficient and Speech-Centric Framework for Omni-CognitionarXiv:2412.09501
  • Visual Question Answering (VQA)onVideo MME
    Acc· 2024-12-12
    69.9
    SOTA
    Lyra: An Efficient and Speech-Centric Framework for Omni-CognitionarXiv:2412.09501
  • Visual Question Answering (VQA)onTextVQA
    Acc· 2024-12-12
    83.5
    SOTA
    Lyra: An Efficient and Speech-Centric Framework for Omni-CognitionarXiv:2412.09501
  • Visual Question Answering (VQA)onMVBench
    Acc· 2024-12-12
    72.3
    SOTA
    Lyra: An Efficient and Speech-Centric Framework for Omni-CognitionarXiv:2412.09501
  • Visual Question Answering (VQA)onMM-Vet
    GPT-4 score· 2024-12-12
    71.4
    best: 74.24 (MMCTAgent (GPT-4 + GPT-4V))
    Lyra: An Efficient and Speech-Centric Framework for Omni-CognitionarXiv:2412.09501
  • Visual Question AnsweringonMM-Vet
    GPT-4 score· 2024-12-12
    71.4
    best: 74.24 (MMCTAgent (GPT-4 + GPT-4V))
    Lyra: An Efficient and Speech-Centric Framework for Omni-CognitionarXiv:2412.09501