Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/MT5 Large

MT5 Large

Reported on 12 benchmarks across 5 tasks · 1 paper · 11 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing12 results

Reading ComprehensiononMuSeRC
Average F1· 2020-10-22
0.844
best: 0.941 (Golden Transformer)
SOTA
mT5: A massively multilingual pre-trained text-to-text transformer arXiv:2010.11934
Reading ComprehensiononMuSeRC
EM · 2020-10-22
0.543
best: 0.819 (Golden Transformer)
SOTA
mT5: A massively multilingual pre-trained text-to-text transformer arXiv:2010.11934
Question AnsweringonDaNetQA
Accuracy· 2020-10-22
0.657
best: 0.917 (Golden Transformer)
SOTA
mT5: A massively multilingual pre-trained text-to-text transformer arXiv:2010.11934
Common Sense ReasoningonRWSD
Accuracy· 2020-10-22
0.669
best: 0.84 (Human Benchmark)
SOTA
mT5: A massively multilingual pre-trained text-to-text transformer arXiv:2010.11934
Common Sense ReasoningonPARus
Accuracy· 2020-10-22
0.504
best: 0.982 (Human Benchmark)
SOTA
mT5: A massively multilingual pre-trained text-to-text transformer arXiv:2010.11934
Common Sense ReasoningonRuCoS
Average F1· 2020-10-22
0.57
best: 0.93 (Human Benchmark)
SOTA
mT5: A massively multilingual pre-trained text-to-text transformer arXiv:2010.11934
Common Sense ReasoningonRuCoS
EM · 2020-10-22
0.562
best: 0.924 (Golden Transformer)
SOTA
mT5: A massively multilingual pre-trained text-to-text transformer arXiv:2010.11934
Natural Language InferenceonRCB
Accuracy· 2020-10-22
0.454
best: 0.702 (Human Benchmark)
SOTA
mT5: A massively multilingual pre-trained text-to-text transformer arXiv:2010.11934
Natural Language InferenceonRCB
Average F1· 2020-10-22
0.366
best: 0.68 (Human Benchmark)
SOTA
mT5: A massively multilingual pre-trained text-to-text transformer arXiv:2010.11934
Natural Language InferenceonLiDiRus
MCC· 2020-10-22
0.061
best: 0.626 (Human Benchmark)
SOTA
mT5: A massively multilingual pre-trained text-to-text transformer arXiv:2010.11934
Natural Language InferenceonTERRa
Accuracy· 2020-10-22
0.561
best: 0.92 (Human Benchmark)
SOTA
mT5: A massively multilingual pre-trained text-to-text transformer arXiv:2010.11934
Word Sense DisambiguationonRUSSE
Accuracy
0.633
best: 0.805 (Human Benchmark)