Mogrifier LSTM

Reported on 5 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Medical5 results

Language ModellingonPenn Treebank (Character Level)
Bit per Character (BPC)· 2019-09-04
1.12
best: 1.38 (Bipartite Flow)
Mogrifier LSTM arXiv:1909.01792
Language ModellingonHutter Prize
Bit per Character (BPC)· 2019-09-04
1.122
best: 1.31 (RHN - depth 5 [zilly2016recurrent])
Mogrifier LSTM arXiv:1909.01792
Language ModellingonWikiText-2
Test perplexity· 2019-09-04
55.1
best: 8.21 (SparseGPT (175B, 50% Sparsity))
Mogrifier LSTM arXiv:1909.01792
Language ModellingonWikiText-2
Validation perplexity· 2019-09-04
57.3
best: 15.69 (GPT-2 (fine-tuned))
Mogrifier LSTM arXiv:1909.01792
Language Modellingonenwik8
Bit per Character (BPC)· 2019-09-04
1.146
best: 1.67 (LSTM (7 layers))
Mogrifier LSTM arXiv:1909.01792