LinkBERT (large)

Natural Language Processing5 results

• Question AnsweringonMRQA

  Average F1· 2022-03-29

  81

  SOTA
  LinkBERT: Pretraining Language Models with Document LinksarXiv:2203.15827
• Question AnsweringonNewsQA

  F1· uses extra data· 2022-03-29

  72.6

  best: 94.01 (Riple/Saanvi-v0.5-DeepAnalysis)
  LinkBERT: Pretraining Language Models with Document LinksarXiv:2203.15827
• Question AnsweringonSQuAD1.1

  EM· 2022-03-29

  87.45

  best: 90.622 ({ANNA} (single model))
  LinkBERT: Pretraining Language Models with Document LinksarXiv:2203.15827
• Question AnsweringonSQuAD1.1

  F1· 2022-03-29

  92.7

  best: 95.719 ({ANNA} (single model))
  LinkBERT: Pretraining Language Models with Document LinksarXiv:2203.15827
• Question AnsweringonTriviaQA

  F1· 2022-03-29

  78.2

  best: 83.6 (SpanBERT)
  LinkBERT: Pretraining Language Models with Document LinksarXiv:2203.15827