R-Transformer

Reported on 3 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Medical2 results

Language ModellingonPenn Treebank (Word Level)
Test perplexity· 2019-07-12
84.38
best: 20.5 (GPT-3 (Zero-Shot))
R-Transformer: Recurrent Neural Network Enhanced Transformer arXiv:1907.05572
Language ModellingonPenn Treebank (Character Level)
Bit per Character (BPC)· 2019-07-12
1.24
best: 1.38 (Bipartite Flow)
R-Transformer: Recurrent Neural Network Enhanced Transformer arXiv:1907.05572

Music1 result

Music ModelingonNottingham
NLL· 2019-07-12
2.37
best: 4.05 (RNN)
R-Transformer: Recurrent Neural Network Enhanced Transformer arXiv:1907.05572