Dialogue on PG-19

Metric: Perplexity (lower is better)

LeaderboardDataset
Loading chart...
#ModelPerplexityExtra DataPaperDateCode
1∞-former (Sticky memories + initialized GPT-2 Small)32.48Yes$\infty$-former: Infinite Memory Transformer2021-09-01Code