VWTest1

Reported on 7 benchmarks across 1 task

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing7 results

Visual Question Answering (VQA)onVizWiz 2020 VQA
number
14.09
best: 27.37 (Katya)
Visual Question Answering (VQA)onVizWiz 2020 VQA
other
17.57
best: 42.3 (HSSLab)
Visual Question Answering (VQA)onVizWiz 2020 VQA
overall
34.13
best: 73.3 (PaLI)
Visual Question Answering (VQA)onVizWiz 2020 VQA
unanswerable
78.2
best: 7.13 (BERT-RG)
Visual Question Answering (VQA)onVizWiz 2020 VQA
yes/no
25.31
best: 80.52 (Katya)
Visual Question Answering (VQA)onVizWiz 2020 Answerability
average_precision
26.84
best: 84.13 (CLIP-Ensemble)
Visual Question Answering (VQA)onVizWiz 2020 Answerability
f1_score
42.32
best: 67.26 (VT-Transformer (MUL))