SMoLA-PaLI-X Generalist Model

Reported on 3 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Visual Question Answering (VQA)onAI2D
EM· uses extra data· 2023-12-01
81.4
best: 82.5 (SMoLA-PaLI-X Specialist Model)
Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts arXiv:2312.00968
Visual Question Answering (VQA)onChartQA
1:1 Accuracy· uses extra data· 2023-12-01
73.8
best: 81.3 (ChartPaLI-5B + PaLM 2-S)
Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts arXiv:2312.00968

Computer Code1 result

Chart Question AnsweringonChartQA
1:1 Accuracy· uses extra data· 2023-12-01
73.8
best: 81.3 (ChartPaLI-5B + PaLM 2-S)
Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts arXiv:2312.00968