3D-LLM (flamingo)

Reported on 6 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing6 results

Visual Question Answering (VQA)onScanQA Test w/ objects
BLEU-1· 2023-07-24
32.6
best: 39.73 (NaviLLM)
3D-LLM: Injecting the 3D World into Large Language Models arXiv:2307.12981
Visual Question Answering (VQA)onScanQA Test w/ objects
BLEU-4· 2023-07-24
8.4
best: 24.06 (BridgeQA)
3D-LLM: Injecting the 3D World into Large Language Models arXiv:2307.12981
Visual Question Answering (VQA)onScanQA Test w/ objects
CIDEr· 2023-07-24
65.6
best: 103.1 (LLaVA-3D)
3D-LLM: Injecting the 3D World into Large Language Models arXiv:2307.12981
Visual Question Answering (VQA)onScanQA Test w/ objects
Exact Match· 2023-07-24
23.2
best: 31.29 (BridgeQA)
3D-LLM: Injecting the 3D World into Large Language Models arXiv:2307.12981
Visual Question Answering (VQA)onScanQA Test w/ objects
METEOR· 2023-07-24
13.5
best: 20.8 (LLaVA-3D)
3D-LLM: Injecting the 3D World into Large Language Models arXiv:2307.12981
Visual Question Answering (VQA)onScanQA Test w/ objects
ROUGE· 2023-07-24
34.8
best: 49.6 (LLaVA-3D)
3D-LLM: Injecting the 3D World into Large Language Models arXiv:2307.12981