TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/LongT5

LongT5

Reported on 21 benchmarks across 3 tasks · 1 paper · 10 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Knowledge Base15 results

  • Text SummarizationonBigPatent
    ROUGE-1· 2021-12-15
    76.87
    SOTA
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonBigPatent
    ROUGE-2· 2021-12-15
    66.06
    SOTA
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonBigPatent
    ROUGE-L· 2021-12-15
    70.76
    SOTA
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonArxiv HEP-TH citation graph
    ROUGE-2· 2021-12-15
    21.92
    best: 21.93 (Top Down Transformer (AdaPool) (464M))
    SOTA
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonArxiv HEP-TH citation graph
    ROUGE-L· 2021-12-15
    44.27
    best: 45.61 (Top Down Transformer (AdaPool) (464M))
    SOTA
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonPubmed
    ROUGE-1· 2021-12-15
    50.23
    best: 51.05 (Top Down Transformer (AdaPool) (464M))
    SOTA
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonPubmed
    ROUGE-2· 2021-12-15
    24.76
    SOTA
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonPubmed
    ROUGE-L· 2021-12-15
    46.67
    SOTA
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonMulti-News
    ROUGE-SU4· 2021-12-15
    24.94
    SOTA
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonArxiv HEP-TH citation graph
    ROUGE-1· 2021-12-15
    48.35
    best: 50.95 (Top Down Transformer (AdaPool) (464M))
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonCNN / Daily Mail
    ROUGE-1· 2021-12-15
    43.94
    best: 48.18 (Scrambled code + broken (alter))
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonCNN / Daily Mail
    ROUGE-2· 2021-12-15
    21.4
    best: 24.02 (Pegasus)
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonCNN / Daily Mail
    ROUGE-L· 2021-12-15
    41.28
    best: 45.35 (Scrambled code + broken (alter))
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonMulti-News
    ROUGE-1· 2021-12-15
    48.17
    best: 49.9 (PRIMER)
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text SummarizationonMulti-News
    ROUGE-2· 2021-12-15
    19.43
    best: 21.1 (PRIMER)
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916

Adversarial3 results

  • Text GenerationonMulti-News
    ROUGE-SU4· 2021-12-15
    24.94
    SOTA
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text GenerationonMulti-News
    ROUGE-1· 2021-12-15
    48.17
    best: 49.9 (PRIMER)
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Text GenerationonMulti-News
    ROUGE-2· 2021-12-15
    19.43
    best: 21.1 (PRIMER)
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916

Natural Language Processing3 results

  • Abstractive Text SummarizationonCNN / Daily Mail
    ROUGE-1· 2021-12-15
    43.94
    best: 48.18 (Scrambled code + broken (alter))
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Abstractive Text SummarizationonCNN / Daily Mail
    ROUGE-2· 2021-12-15
    21.4
    best: 24.02 (Pegasus)
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916
  • Abstractive Text SummarizationonCNN / Daily Mail
    ROUGE-L· 2021-12-15
    41.28
    best: 45.35 (Scrambled code + broken (alter))
    LongT5: Efficient Text-To-Text Transformer for Long SequencesarXiv:2112.07916