PaLI-X (Single-task FT)

Reported on 5 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

Visual Question Answering (VQA)onDocVQA test
ANLS· uses extra data· 2023-05-29
0.8
best: 0.9436 (Human)
PaLI-X: On Scaling up a Multilingual Vision and Language Model arXiv:2305.18565
Visual Question Answering (VQA)onOK-VQA
Accuracy· 2023-05-29
66.1
best: 66.8 (PaLI-X-VPD)
PaLI-X: On Scaling up a Multilingual Vision and Language Model arXiv:2305.18565
Visual Question Answering (VQA)onInfographicVQA
ANLS· uses extra data· 2023-05-29
49.2
best: 80.3 (Gemini Ultra (pixel only))
PaLI-X: On Scaling up a Multilingual Vision and Language Model arXiv:2305.18565
Visual Question Answering (VQA)onChartQA
1:1 Accuracy· uses extra data· 2023-05-29
70.9
best: 81.3 (ChartPaLI-5B + PaLM 2-S)
PaLI-X: On Scaling up a Multilingual Vision and Language Model arXiv:2305.18565

Computer Code1 result

Chart Question AnsweringonChartQA
1:1 Accuracy· uses extra data· 2023-05-29
70.9
best: 81.3 (ChartPaLI-5B + PaLM 2-S)
PaLI-X: On Scaling up a Multilingual Vision and Language Model arXiv:2305.18565