TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/MUPPET BART Large

MUPPET BART Large

Reported on 12 benchmarks across 2 tasks · 1 paper · 4 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Knowledge Base9 results

  • Text SummarizationonReddit TIFU
    ROUGE-2· uses extra data· 2021-01-26
    11.25
    SOTA
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038
  • Text SummarizationonReddit TIFU
    ROUGE-L· uses extra data· 2021-01-26
    24.92
    best: 25.51 (PEGASUS 2B + SLiC)
    SOTA
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038
  • Text SummarizationonCNN / Daily Mail
    ROUGE-1· 2021-01-26
    44.45
    best: 48.18 (Scrambled code + broken (alter))
    SOTA
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038
  • Text SummarizationonReddit TIFU
    ROUGE-1· uses extra data· 2021-01-26
    30.3
    best: 32.03 (PEGASUS 2B + SLiC)
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038
  • Text SummarizationonGigaWord
    ROUGE-1· uses extra data· 2021-01-26
    40.4
    best: 60.12 (OpenAI/o3-mini)
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038
  • Text SummarizationonGigaWord
    ROUGE-2· uses extra data· 2021-01-26
    20.54
    best: 54.22 (OpenAI/o3-mini)
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038
  • Text SummarizationonGigaWord
    ROUGE-L· uses extra data· 2021-01-26
    36.21
    best: 60.29 (Riple/Saanvi-v0.1)
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038
  • Text SummarizationonCNN / Daily Mail
    ROUGE-2· 2021-01-26
    21.25
    best: 24.02 (Pegasus)
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038
  • Text SummarizationonCNN / Daily Mail
    ROUGE-L· 2021-01-26
    41.4
    best: 45.35 (Scrambled code + broken (alter))
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038

Natural Language Processing3 results

  • Abstractive Text SummarizationonCNN / Daily Mail
    ROUGE-1· 2021-01-26
    44.45
    best: 48.18 (Scrambled code + broken (alter))
    SOTA
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038
  • Abstractive Text SummarizationonCNN / Daily Mail
    ROUGE-2· 2021-01-26
    21.25
    best: 24.02 (Pegasus)
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038
  • Abstractive Text SummarizationonCNN / Daily Mail
    ROUGE-L· 2021-01-26
    41.4
    best: 45.35 (Scrambled code + broken (alter))
    Muppet: Massive Multi-task Representations with Pre-FinetuningarXiv:2101.11038