BERT-Large 340M

Reported on 2 benchmarks across 2 tasks · 2 papers · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Sentence CompletiononHellaSwag
Accuracy· 2019-05-19
47.3
best: 96.1 (CompassMTL 567M with Tailor)
SOTA
HellaSwag: Can a Machine Really Finish Your Sentence?arXiv:1905.07830
Question AnsweringonPIQA
Accuracy· 2018-10-11
66.7
best: 90.1 (Unicorn 11B (fine-tuned))
SOTA
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding arXiv:1810.04805