TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Seq2Seq

Seq2Seq

Reported on 66 benchmarks across 12 tasks · 3 papers · 58 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing44 results

  • Data-to-Text GenerationonLSMDC-E
    BLEU-1· 2015-08-17
    14.21
    best: 18.52 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonLSMDC-E
    BLEU-2· 2015-08-17
    4.56
    best: 5.99 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonLSMDC-E
    BLEU-3· 2015-08-17
    1.7
    best: 2.51 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonLSMDC-E
    BLEU-4· 2015-08-17
    0.7
    best: 1.13 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonLSMDC-E
    CIDEr· 2015-08-17
    8.69
    best: 12.41 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonLSMDC-E
    METEOR· 2015-08-17
    11.01
    best: 12.87 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonLSMDC-E
    ROUGE-L· 2015-08-17
    19.69
    best: 20.99 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonVIST-E
    BLEU-1· 2015-08-17
    13.96
    best: 22.87 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonVIST-E
    BLEU-2· 2015-08-17
    5.57
    best: 8.68 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonVIST-E
    BLEU-3· 2015-08-17
    2.94
    best: 4.38 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonVIST-E
    BLEU-4· 2015-08-17
    1.69
    best: 2.61 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonVIST-E
    CIDEr· 2015-08-17
    12.04
    best: 25.41 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonVIST-E
    METEOR· 2015-08-17
    4.54
    best: 15.55 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Data-to-Text GenerationonVIST-E
    ROUGE-L· 2015-08-17
    16.84
    best: 23.61 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonLSMDC-E
    BLEU-1· 2015-08-17
    14.21
    best: 18.52 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonLSMDC-E
    BLEU-2· 2015-08-17
    4.56
    best: 5.99 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonLSMDC-E
    BLEU-3· 2015-08-17
    1.7
    best: 2.51 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonLSMDC-E
    BLEU-4· 2015-08-17
    0.7
    best: 1.13 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonLSMDC-E
    CIDEr· 2015-08-17
    8.69
    best: 12.41 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonLSMDC-E
    METEOR· 2015-08-17
    11.01
    best: 12.87 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonLSMDC-E
    ROUGE-L· 2015-08-17
    19.69
    best: 20.99 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonVIST-E
    BLEU-1· 2015-08-17
    13.96
    best: 22.87 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonVIST-E
    BLEU-2· 2015-08-17
    5.57
    best: 8.68 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonVIST-E
    BLEU-3· 2015-08-17
    2.94
    best: 4.38 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonVIST-E
    BLEU-4· 2015-08-17
    1.69
    best: 2.61 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonVIST-E
    CIDEr· 2015-08-17
    12.04
    best: 25.41 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonVIST-E
    METEOR· 2015-08-17
    4.54
    best: 15.55 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Visual StorytellingonVIST-E
    ROUGE-L· 2015-08-17
    16.84
    best: 23.61 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonLSMDC-E
    BLEU-1· 2015-08-17
    14.21
    best: 18.52 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonLSMDC-E
    BLEU-2· 2015-08-17
    4.56
    best: 5.99 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonLSMDC-E
    BLEU-3· 2015-08-17
    1.7
    best: 2.51 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonLSMDC-E
    BLEU-4· 2015-08-17
    0.7
    best: 1.13 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonLSMDC-E
    CIDEr· 2015-08-17
    8.69
    best: 12.41 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonLSMDC-E
    METEOR· 2015-08-17
    11.01
    best: 12.87 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonLSMDC-E
    ROUGE-L· 2015-08-17
    19.69
    best: 20.99 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonVIST-E
    BLEU-1· 2015-08-17
    13.96
    best: 22.87 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonVIST-E
    BLEU-2· 2015-08-17
    5.57
    best: 8.68 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonVIST-E
    BLEU-3· 2015-08-17
    2.94
    best: 4.38 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonVIST-E
    BLEU-4· 2015-08-17
    1.69
    best: 2.61 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonVIST-E
    CIDEr· 2015-08-17
    12.04
    best: 25.41 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonVIST-E
    METEOR· 2015-08-17
    4.54
    best: 15.55 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Story GenerationonVIST-E
    ROUGE-L· 2015-08-17
    16.84
    best: 23.61 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Action ParsingonJerichoWorld
    Set accuracy
    18.1
    best: 23.22 (Worldformer)
  • Inductive knowledge graph completiononJerichoWorld
    Set accuracy
    14.29
    best: 39.15 (Worldformer)

Adversarial14 results

  • Text GenerationonLSMDC-E
    BLEU-1· 2015-08-17
    14.21
    best: 18.52 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonLSMDC-E
    BLEU-2· 2015-08-17
    4.56
    best: 5.99 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonLSMDC-E
    BLEU-3· 2015-08-17
    1.7
    best: 2.51 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonLSMDC-E
    BLEU-4· 2015-08-17
    0.7
    best: 1.13 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonLSMDC-E
    CIDEr· 2015-08-17
    8.69
    best: 12.41 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonLSMDC-E
    METEOR· 2015-08-17
    11.01
    best: 12.87 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonLSMDC-E
    ROUGE-L· 2015-08-17
    19.69
    best: 20.99 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonVIST-E
    BLEU-1· 2015-08-17
    13.96
    best: 22.87 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonVIST-E
    BLEU-2· 2015-08-17
    5.57
    best: 8.68 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonVIST-E
    BLEU-3· 2015-08-17
    2.94
    best: 4.38 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonVIST-E
    BLEU-4· 2015-08-17
    1.69
    best: 2.61 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonVIST-E
    CIDEr· 2015-08-17
    12.04
    best: 25.41 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonVIST-E
    METEOR· 2015-08-17
    4.54
    best: 15.55 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025
  • Text GenerationonVIST-E
    ROUGE-L· 2015-08-17
    16.84
    best: 23.61 (MMT)
    SOTA
    Effective Approaches to Attention-based Neural Machine TranslationarXiv:1508.04025

Knowledge Base5 results

  • Text SummarizationonX-Sum
    ROUGE-1· 2018-08-27
    28.42
    best: 50.3 (Selfmem)
    Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme SummarizationarXiv:1808.08745
  • Text SummarizationonX-Sum
    ROUGE-2· 2018-08-27
    8.77
    best: 26.7 (Selfmem)
    Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme SummarizationarXiv:1808.08745
  • Text SummarizationonX-Sum
    ROUGE-3· 2018-08-27
    22.48
    best: 41.6 (Selfmem)
    Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme SummarizationarXiv:1808.08745
  • Knowledge GraphsonJerichoWorld
    Set accuracy
    14.29
    best: 39.15 (Worldformer)
  • Knowledge Graph CompletiononJerichoWorld
    Set accuracy
    14.29
    best: 39.15 (Worldformer)

Methodology2 results

  • 3DonBEAT
    FID· 2018-10-28
    261.3
    best: 122.8 (CaMN)
    SOTA
    Robots Learning to Say `No': Prohibition and Rejective Mechanisms in Acquisition of Linguistic NegationarXiv:1810.11804
  • Large Language ModelonJerichoWorld
    Set accuracy
    14.29
    best: 39.15 (Worldformer)

Robots1 result

  • 3D Shape GenerationonBEAT
    FID· 2018-10-28
    261.3
    best: 122.8 (CaMN)
    SOTA
    Robots Learning to Say `No': Prohibition and Rejective Mechanisms in Acquisition of Linguistic NegationarXiv:1810.11804