UnifiedQA 11B (fine-tuned)

Reported on 2 benchmarks across 1 task · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Common Sense ReasoningonWinoGrande
Accuracy· 2020-05-02
89.4
best: 96.1 (ST-MoE-32B 269B (fine-tuned))
SOTA
UnifiedQA: Crossing Format Boundaries With a Single QA System arXiv:2005.00700
Common Sense ReasoningonCommonsenseQA
Accuracy· uses extra data· 2020-05-02
79.1
best: 92.54 (GPT-4o (HPT))
SOTA
UnifiedQA: Crossing Format Boundaries With a Single QA System arXiv:2005.00700