TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/LUKE (single model)

LUKE (single model)

Reported on 6 benchmarks across 2 tasks · 1 paper · 1 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing10 results

  • Question AnsweringonSQuAD1.1
    EM· uses extra data· 2020-10-02
    90.202
    best: 90.622 ({ANNA} (single model))
    SOTA
    LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionarXiv:2010.01057
  • Question AnsweringonSQuAD1.1
    F1· uses extra data· 2020-10-02
    95.379
    best: 95.719 ({ANNA} (single model))
    LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionarXiv:2010.01057
  • Question AnsweringonSQuAD1.1
    EM· 2020-10-02
    90.202
    best: 90.622 ({ANNA} (single model))
    LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionarXiv:2010.01057
  • Question AnsweringonSQuAD1.1
    F1· 2020-10-02
    95.379
    best: 95.719 ({ANNA} (single model))
    LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionarXiv:2010.01057
  • Question AnsweringonSQuAD2.0
    EM· 2020-10-02
    87.429
    best: 90.939 (IE-Net (ensemble))
    LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionarXiv:2010.01057
  • Question AnsweringonSQuAD2.0
    F1· 2020-10-02
    90.163
    best: 93.214 (IE-Net (ensemble))
    LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionarXiv:2010.01057
  • Question AnsweringonSQuAD2.0
    EM· 2020-10-02
    87.429
    best: 90.939 (IE-Net (ensemble))
    LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionarXiv:2010.01057
  • Question AnsweringonSQuAD2.0
    F1· 2020-10-02
    90.163
    best: 93.214 (IE-Net (ensemble))
    LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionarXiv:2010.01057
  • Common Sense ReasoningonReCoRD
    EM
    90.64
    best: 95.9 (Turing NLR v5 XXL 5.4B (fine-tuned))
  • Common Sense ReasoningonReCoRD
    F1
    91.209
    best: 96.4 (Turing NLR v5 XXL 5.4B (fine-tuned))