TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/BigBird

BigBird

Reported on 11 benchmarks across 6 tasks · 2 papers · 6 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing8 results

  • Text ClassificationonHyperpartisan
    Accuracy· 2020-07-28
    92.2
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text ClassificationonArxiv HEP-TH citation graph
    Accuracy· 2020-07-28
    92.31
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text ClassificationonPatents
    Accuracy· 2020-07-28
    69.3
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Natural Language UnderstandingonLexGLUE
    CaseHOLD· 2021-10-03
    70.4
    best: 75.6 (CaseLaw-BERT)
    LexGLUE: A Benchmark Dataset for Legal Language Understanding in EnglisharXiv:2110.00976
  • Natural Language InferenceonMultiNLI
    Matched· 2020-07-28
    87.5
    best: 92.6 (Turing NLR v5 XXL 5.4B (fine-tuned))
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Semantic Textual SimilarityonMRPC
    F1· 2020-07-28
    91.5
    best: 92.5 (T5-3B)
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Semantic Textual SimilarityonSTS Benchmark
    Spearman Correlation· 2020-07-28
    0.878
    best: 0.931 (Mnet-Sim)
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Sentiment AnalysisonSST-2 Binary classification
    Accuracy· 2020-07-28
    94.6
    best: 97.5 (T5-11B)
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062

Methodology3 results

  • ClassificationonHyperpartisan
    Accuracy· 2020-07-28
    92.2
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • ClassificationonArxiv HEP-TH citation graph
    Accuracy· 2020-07-28
    92.31
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • ClassificationonPatents
    Accuracy· 2020-07-28
    69.3
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062