BERT-Base (single model)

Reported on 4 benchmarks across 2 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

Common Sense ReasoningonReCoRD
EM· 2018-10-11
54.04
best: 95.9 (Turing NLR v5 XXL 5.4B (fine-tuned))
SOTA
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding arXiv:1810.04805
Common Sense ReasoningonReCoRD
F1· 2018-10-11
56.065
best: 96.4 (Turing NLR v5 XXL 5.4B (fine-tuned))
SOTA
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding arXiv:1810.04805
Question AnsweringonSQuAD2.0
EM
73.099
best: 90.939 (IE-Net (ensemble))
Question AnsweringonSQuAD2.0
F1
76.236
best: 93.214 (IE-Net (ensemble))