TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/ScanQA

ScanQA

Reported on 8 benchmarks across 2 tasks · 2 papers · 7 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing8 results

  • Visual Question Answering (VQA)onSQA3D
    Exact Match· 2021-12-20
    47.2
    best: 60.1 (LLaVA-3D)
    SOTA
    ScanQA: 3D Question Answering for Spatial Scene UnderstandingarXiv:2112.10482
  • Visual Question Answering (VQA)onScanQA Test w/ objects
    BLEU-1· 2021-12-20
    31.56
    best: 39.73 (NaviLLM)
    SOTA
    ScanQA: 3D Question Answering for Spatial Scene UnderstandingarXiv:2112.10482
  • Visual Question Answering (VQA)onScanQA Test w/ objects
    BLEU-4· 2021-12-20
    12.04
    best: 24.06 (BridgeQA)
    SOTA
    ScanQA: 3D Question Answering for Spatial Scene UnderstandingarXiv:2112.10482
  • Visual Question Answering (VQA)onScanQA Test w/ objects
    CIDEr· 2021-12-20
    67.29
    best: 103.1 (LLaVA-3D)
    SOTA
    ScanQA: 3D Question Answering for Spatial Scene UnderstandingarXiv:2112.10482
  • Visual Question Answering (VQA)onScanQA Test w/ objects
    Exact Match· 2021-12-20
    23.45
    best: 31.29 (BridgeQA)
    SOTA
    ScanQA: 3D Question Answering for Spatial Scene UnderstandingarXiv:2112.10482
  • Visual Question Answering (VQA)onScanQA Test w/ objects
    METEOR· 2021-12-20
    13.55
    best: 20.8 (LLaVA-3D)
    SOTA
    ScanQA: 3D Question Answering for Spatial Scene UnderstandingarXiv:2112.10482
  • Visual Question Answering (VQA)onScanQA Test w/ objects
    ROUGE· 2021-12-20
    34.34
    best: 49.6 (LLaVA-3D)
    SOTA
    ScanQA: 3D Question Answering for Spatial Scene UnderstandingarXiv:2112.10482
  • Question AnsweringonSQA3D
    AnswerExactMatch (Question Answering)· 2022-10-14
    46.58
    best: 43.42 (MCAN)
    SQA3D: Situated Question Answering in 3D ScenesarXiv:2210.07474