full_nsp_mlm_ft_joint_results_submit_predict.json

Reported on 7 benchmarks across 1 task

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing7 results

Visual Question Answering (VQA)onGQA Test2019
Accuracy
60.02
best: 89.3 (human)
Visual Question Answering (VQA)onGQA Test2019
Binary
76.37
best: 91.2 (human)
Visual Question Answering (VQA)onGQA Test2019
Consistency
90.05
best: 98.4 (human)
Visual Question Answering (VQA)onGQA Test2019
Distribution
5.63
best: 93.08 (GlobalPrior)
Visual Question Answering (VQA)onGQA Test2019
Open
45.59
best: 87.4 (human)
Visual Question Answering (VQA)onGQA Test2019
Plausibility
84.34
best: 97.2 (human)
Visual Question Answering (VQA)onGQA Test2019
Validity
96.29
best: 98.9 (human)