18-layer Transformer-XL

Reported on 1 benchmark across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Medical1 result

Language ModellingonHutter Prize
Bit per Character (BPC)· uses extra data· 2019-01-09
1.03
best: 1.31 (RHN - depth 5 [zilly2016recurrent])
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context arXiv:1901.02860