MatCha4096 + LaMenDa

Reported on 8 benchmarks across 3 tasks

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing8 results

Visual Question Answering (VQA)onPlotQA-D1
1:1 Accuracy
93.94
Visual Question Answering (VQA)onPlotQA-D2
1:1 Accuracy
91.84
Visual Question Answering (VQA)onPlotQA-D2
1:1 Accuracy
91.84
Visual Question Answering (VQA)onPlotQA-D1
1:1 Accuracy
93.94
Visual Question Answering (VQA)onPlotQA
1:1 Accuracy
92.89
Visual Question Answering (VQA)onChartQA
1:1 Accuracy· uses extra data
72.64
best: 81.3 (ChartPaLI-5B + PaLM 2-S)
Visual Question AnsweringonPlotQA-D2
1:1 Accuracy
91.84
Visual Question AnsweringonPlotQA-D1
1:1 Accuracy
93.94

Computer Code2 results

Chart Question AnsweringonPlotQA
1:1 Accuracy
92.89
Chart Question AnsweringonChartQA
1:1 Accuracy· uses extra data
72.64
best: 81.3 (ChartPaLI-5B + PaLM 2-S)