TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/BiDAF

BiDAF

Reported on 15 benchmarks across 3 tasks · 3 papers · 8 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing15 results

  • Question AnsweringonWikiHop
    Test· 2017-10-17
    42.9
    best: 82.3 (BigBird-etc)
    SOTA
    Constructing Datasets for Multi-hop Reading Comprehension Across DocumentsarXiv:1710.06481
  • Reading ComprehensiononAdversarialQA
    Overall: F1· uses extra data· 2016-11-05
    28.5
    best: 64.4 (RoBERTa-Large)
    SOTA
    Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603
  • Question AnsweringonNarrativeQA
    BLEU-1· 2016-11-05
    33.45
    best: 54.11 (Masque (NarrativeQA + MS MARCO))
    SOTA
    Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603
  • Question AnsweringonNarrativeQA
    BLEU-4· 2016-11-05
    15.69
    best: 30.43 (Masque (NarrativeQA + MS MARCO))
    SOTA
    Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603
  • Question AnsweringonNarrativeQA
    METEOR· 2016-11-05
    15.68
    best: 26.13 (Masque (NarrativeQA + MS MARCO))
    SOTA
    Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603
  • Question AnsweringonNarrativeQA
    Rouge-L· 2016-11-05
    36.74
    best: 59.87 (Masque (NarrativeQA + MS MARCO))
    SOTA
    Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603
  • Question AnsweringonQuasar
    F1 (Quasar-T)· 2016-11-05
    28.5
    best: 49.6 (Evidence Aggregation via R^3 Re-Ranking)
    SOTA
    Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603
  • Open-Domain Question AnsweringonQuasar
    F1 (Quasar-T)· 2016-11-05
    28.5
    best: 49.6 (Evidence Aggregation via R^3 Re-Ranking)
    SOTA
    Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603
  • Reading ComprehensiononAdversarialQA
    D(BERT): F1· uses extra data· 2020-02-02
    30.2
    best: 65.5 (RoBERTa-Large)
    Beat the AI: Investigating Adversarial Human Annotation for Reading ComprehensionarXiv:2002.00293
  • Reading ComprehensiononAdversarialQA
    D(BiDAF): F1· uses extra data· 2020-02-02
    28.6
    best: 74.1 (RoBERTa-Large)
    Beat the AI: Investigating Adversarial Human Annotation for Reading ComprehensionarXiv:2002.00293
  • Reading ComprehensiononAdversarialQA
    D(RoBERTa): F1· uses extra data· 2020-02-02
    26.7
    best: 54.4 (BERT-Large)
    Beat the AI: Investigating Adversarial Human Annotation for Reading ComprehensionarXiv:2002.00293
  • Question AnsweringonCNN / Daily Mail
    CNN· 2016-11-05
    76.9
    best: 78.6 (GA+MAGE (32))
    Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603
  • Question AnsweringonCNN / Daily Mail
    Daily Mail· 2016-11-05
    79.6
    best: 80.9 (GA Reader)
    Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603
  • Question AnsweringonQuasar
    EM (Quasar-T)· 2016-11-05
    25.9
    best: 42.3 (Evidence Aggregation via R^3 Re-Ranking)
    Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603
  • Open-Domain Question AnsweringonQuasar
    EM (Quasar-T)· 2016-11-05
    25.9
    best: 42.3 (Evidence Aggregation via R^3 Re-Ranking)
    Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603