Recurrent highway networks

Reported on 2 benchmarks across 1 task · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Medical2 results

Language ModellingonPenn Treebank (Word Level)
Test perplexity· 2016-07-12
65.4
best: 20.5 (GPT-3 (Zero-Shot))
SOTA
Recurrent Highway Networks arXiv:1607.03474
Language ModellingonPenn Treebank (Word Level)
Validation perplexity· 2016-07-12
67.9
best: 36.1 (BERT-Large-CAS)
SOTA
Recurrent Highway Networks arXiv:1607.03474