PG-19

A new open-vocabulary language modelling benchmark derived from books.

Source: Compressive Transformers for Long-Range Sequence Modelling