Pythia
Reported on 5 benchmarks across 2 tasks · 1 paper · 2 SOTA
Note: results are matched by exact model name. Different papers may use the same name for different model variants.
Miscellaneous3 results
- CER (%)47best: 18.3 (Ancient historian and Ithaca)
- Top 1 (%)32.6best: 71.7 (Ancient historian and Ithaca)
- Top 20 (%)53.9best: 78.3 (Ancient historian and Ithaca)
Natural Language Processing2 results
- DA VQA Score· 2018-07-26SOTA21.9best: 70.55 (SMoLA-PaLI-X Specialist Model)
- MC Accuracy· 2018-07-26SOTA40.1best: 83.75 (SMoLA-PaLI-X Specialist Model)