H-Transformer-1D Nr=16 (Base)

Reported on 1 benchmark across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Medical1 result

Language ModellingonOne Billion Word
Validation perplexity· 2021-07-25
23.95
best: 20.25 (H-Transformer-1D Nr=16 (Large))
H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences arXiv:2107.11906