TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/BigBird-Pegasus

BigBird-Pegasus

Reported on 21 benchmarks across 2 tasks · 1 paper · 14 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Knowledge Base15 results

  • Text SummarizationonBigPatent
    ROUGE-1· 2020-07-28
    60.64
    best: 76.87 (LongT5)
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonBigPatent
    ROUGE-2· 2020-07-28
    42.46
    best: 66.06 (LongT5)
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonBigPatent
    ROUGE-L· 2020-07-28
    50.01
    best: 70.76 (LongT5)
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonarXiv
    ROUGE-1· 2020-07-28
    46.63
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonarXiv
    ROUGE-2· 2020-07-28
    19.02
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonarXiv
    ROUGE-L· 2020-07-28
    41.77
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonPubmed
    ROUGE-2· uses extra data· 2020-07-28
    20.65
    best: 24.76 (LongT5)
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonBBC XSum
    ROUGE-1· 2020-07-28
    47.12
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonBBC XSum
    ROUGE-2· 2020-07-28
    24.05
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonBBC XSum
    ROUGE-L· 2020-07-28
    38.8
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonPubmed
    ROUGE-1· uses extra data· 2020-07-28
    46.32
    best: 51.05 (Top Down Transformer (AdaPool) (464M))
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonPubmed
    ROUGE-L· uses extra data· 2020-07-28
    42.33
    best: 46.67 (LongT5)
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonCNN / Daily Mail
    ROUGE-1· 2020-07-28
    43.84
    best: 48.18 (Scrambled code + broken (alter))
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonCNN / Daily Mail
    ROUGE-2· 2020-07-28
    21.11
    best: 24.02 (Pegasus)
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Text SummarizationonCNN / Daily Mail
    ROUGE-L· 2020-07-28
    40.74
    best: 45.35 (Scrambled code + broken (alter))
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062

Natural Language Processing6 results

  • Document SummarizationonBBC XSum
    ROUGE-1· 2020-07-28
    47.12
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Document SummarizationonBBC XSum
    ROUGE-2· 2020-07-28
    24.05
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Document SummarizationonBBC XSum
    ROUGE-L· 2020-07-28
    38.8
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Document SummarizationonCNN / Daily Mail
    ROUGE-L· 2020-07-28
    40.74
    best: 45.35 (Scrambled code + broken (alter))
    SOTA
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Document SummarizationonCNN / Daily Mail
    ROUGE-1· 2020-07-28
    43.84
    best: 48.18 (Scrambled code + broken (alter))
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062
  • Document SummarizationonCNN / Daily Mail
    ROUGE-2· 2020-07-28
    21.11
    best: 22.55 (PEGASUS + SummaReranker)
    Big Bird: Transformers for Longer SequencesarXiv:2007.14062