TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Adversarial/Text Generation

Text Generation

305 benchmarks5335 papers

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

  • The survey: Text generation models in deep learning
  • Modern Methods for Text Generation

<span style="color:grey; opacity: 0.6">( Image credit: Adversarial Ranking for Language Generation )</span>

Benchmarks

Text Generation on VIST

METEORCIDErBLEU-4ROUGE-LBLEU-3BLEU-1BLEU-2SPICEBLEURTMLTD

Text Generation on WebNLG

BLEUMETEORFactSpotterNumber of parameters (M)BLEU-4ROUGE-L

Text Generation on DART

METEORBLEUFactSpotterBERTBLEURTMoverTER

Text Generation on WebNLG 2.0 (Unconstrained)

ROUGEBLEUMETEOR

Text Generation on E2E NLG Challenge

BLEUROUGE-LMETEORNISTCIDErNumber of parameters (M)

Text Generation on WebNLG 2.0 (Constrained)

BLEUMETEORROUGEFactSpotter

Text Generation on CodeSearchNet - Java

Smoothed BLEU-4

Text Generation on CodeSearchNet - JavaScript

Smoothed BLEU-4

Text Generation on CodeSearchNet - Php

Smoothed BLEU-4

Text Generation on EventNarrative

BLEUMETEORROUGEBertScoreCIDErChrF++

Text Generation on WebNLG Full

BLEU

Text Generation on Yelp Review Dataset (Small)

G-Score (BLEU, Accuracy)

Text Generation on CodeSearchNet

Smoothed BLEU-4

Text Generation on CodeSearchNet - Go

Smoothed BLEU-4

Text Generation on CodeSearchNet - Python

Smoothed BLEU-4

Text Generation on CodeSearchNet - Ruby

Smoothed BLEU-4

Text Generation on RotoWire

BLEU Content Ordering Content Selection (F1)

Text Generation on AGENDA

BLEU

Text Generation on COCO Captions

BLEU-2BLEU-3BLEU-4BLEU-5

Text Generation on Multi-News

ROUGE-1ROUGE-2ROUGE-SU4ROUGE-L

Text Generation on RotoWire (Relation Generation)

countPrecision

Text Generation on VIST-E

BLEU-1BLEU-2BLEU-3BLEU-4CIDErMETEORROUGE-L

Text Generation on XAlign

BLEU4METEOR

Text Generation on EMNLP2017 WMT

BLEU-2BLEU-3BLEU-4BLEU-5NLLgen

Text Generation on GenWiki (Fine)

BLEUMETEORROUGE-LCIDEr

Text Generation on GenWiki (Full)

BLEUMETEORROUGE-LCIDEr

Text Generation on MULTIWOZ 2.1

BLEU

Text Generation on PathQuestion

BLEUMETEORROUGE

Text Generation on Persona-Chat

Avg F1BLEU-1CIDrMETEORROUGE-L

Text Generation on ReDial

Distinct-3Distinct-4Distinct-2Perplexity

Text Generation on ToTTo

BLEUPARENTMETEOR

Text Generation on WebEdit

ADDBLEUDELETEExact MatchF1KEEPPrecisionRecallSARI

Text Generation on WebQuestions

BLEUMETEORROUGE

Text Generation on Cleaned E2E NLG Challenge

METEOR (Validation set)BLEU (Test set)

Text Generation on E2E

METEORBLEUCIDErNISTROUGE-L

Text Generation on LSMDC-E

BLEU-1BLEU-2BLEU-3BLEU-4CIDErMETEORROUGE-L

Text Generation on MLB Dataset

BLEU

Text Generation on MLB Dataset (Content Ordering)

DLD

Text Generation on MLB Dataset (Relation Generation)

Precisioncount

Text Generation on OpenViDial 2.0

BLEUDis-1Dis-2Dis-3Dis-4

Text Generation on ROCStories

BLEU-1Perplexity

Text Generation on RotoWire (Content Ordering)

BLEUDLD

Text Generation on WebNLG (All)

BLEUMETEORchrF++TER

Text Generation on WebNLG (Seen)

BLEUMETEORchrF++TER

Text Generation on WebNLG (Unseen)

BLEUMETEORchrF++TER

Text Generation on WikiBio

BLEUROUGEPARENT

Text Generation on WikiGraphs

Test perplexityrBLEU (Test)rBLEU (Valid)rBLEU(w/title)(Test)rBLEU(w/title)(Valid)

Text Generation on Wikipedia Person and Animal Dataset

BLEUROUGEMETEOR

Text Generation on Chinese Poems

BLEU-2

Text Generation on Czech Restaurant NLG

BLEU scoreMETEORCIDERNIST

Text Generation on Czech restaurant information

METEOR

Text Generation on MLB Dataset (Content Selection)

PrecisionRecall

Text Generation on OpenWebText

eval_loss

Text Generation on SciQ

Accuracy

Text Generation on Yahoo Questions

NLLKLPerplexity

Text Generation on CommonGen

CIDErMETEORBLEU-4SPICE

Text Generation on DPCSpell-Bangla-SEC-Corpus

Exact Match Accuracy

Text Generation on FusedChat

Slot AccuracyJoint SAInformInform_mctSuccessSuccess_mctBLEUPPLSensiblenessSpecificitySSA

Text Generation on Harry Potter Dialogue Dataset

mauve

Text Generation on PGDataset

BLEU-1BLEU-2BLEU-3BLEU-4BertScoreROUGE-1ROUGE-2ROUGE-L

Text Generation on Paralex

iBLEUBLEU

Text Generation on Quora Question Pairs

iBLEUBLEU

Text Generation on SR11Deep

BLEU

Text Generation on ViGGO

BLEU

Text Generation on WebNLG en

METEOR

Text Generation on WebNLG ru

METEOR

Text Generation on YTSeg

BARTScore

Text Generation on ACL Title and Abstract Dataset

METEORROUGE-L

Text Generation on ADGEN

BLEU-4

Text Generation on AMR3.0

Bleu

Text Generation on Amazon-5

1 in 10 R@2

Text Generation on CMU-DoG

F1MeteorROUGE-1Rouge-L

Text Generation on CMU-SE

BLEU-3

Text Generation on CNN/Daily Mail

ROUGE-L

Text Generation on CSL

ROUGE-L

Text Generation on DUC 2004

ROUGE-1

Text Generation on DailyDialog

BLEU-1BLEU-2BLEU-3BLEU-4

Text Generation on ENT-DESC

BLEU

Text Generation on Fandom dev

BLEUPerplexityROUGE-1ROUGE-2ROUGE-L

Text Generation on Fandom test

BLEUPerplexityROUGE-1ROUGE-2ROUGE-L

Text Generation on GYAFC

BLEU

Text Generation on GenWiki

BLEU

Text Generation on HarmfulQA

ASR

Text Generation on LCSTS

ROUGE-L

Text Generation on LDC2016E25

BLEU

Text Generation on MSCOCO

BLEUiBLEU

Text Generation on MS^2

BertScoreF1

Text Generation on One Billion Word

JS-4

Text Generation on PG-19

Perplexity

Text Generation on RACE

BLEU-1BLEU-2BLEU-3BLEU-4ROUGE-L

Text Generation on Reddit (multi-ref)

interest (human)relevance (human)

Text Generation on RotoEdit

ADDBLEUDELETEExact MatchF1KEEPPrecisionRecallSARI

Text Generation on TVMegaSite dev

BLEUPerplexityROUGE-1ROUGE-2ROUGE-L

Text Generation on TVMegaSite test

BLEUPerplexityROUGE-1ROUGE-2ROUGE-L

Text Generation on Twitter Dialogue (Noun)

F1PrecisionRecall

Text Generation on Ubuntu Dialogue (Activity)

F1PrecisionRecall

Text Generation on Ubuntu Dialogue (Entity)

F1PrecisionRecall

Text Generation on VG graph-text

BLEU

Text Generation on WCEP

ROUGE-1ROUGE-2ROUGE-L

Text Generation on WebNLG v2.1

BLEU

Text Generation on WikiOFGraph

BLEU

Text Generation on WritingPrompts

BLEU-1BLEU-2Distinct-4

Text Generation on Yelp Review Dataset (Large)

G-Score (BLEU, Accuracy)BLEU

Text Generation on map2seq

SNT

Text Generation on review

1-of-100 Accuracy

Text Generation on 2017 Robotic Instrument Segmentation Challenge

10 way 5~10 shot

Text Generation on Lipogram-e

Ignored Constraint Error Rate

Text Generation on Rotowire (Content Selection)

PrecisionRecall

Text Generation on Twitter Dialogue (Tense)

Accuracy

Text Generation on Ubuntu Dialogue (Cmd)

Accuracy

Text Generation on Ubuntu Dialogue (Tense)

Accuracy