BERT (large)

Reported on 2 benchmarks across 2 tasks · 2 papers · 1 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Question AnsweringonMRQA
Average F1· 2018-10-11
78.5
best: 81 (LinkBERT (large))
SOTA
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding arXiv:1810.04805
Bias DetectiononStereoSet
ICAT Score· 2020-04-20
69.89
best: 72.97 (GPT-2 (small))
StereoSet: Measuring stereotypical bias in pretrained language models arXiv:2004.09456