Longformer (30 layers, h=512)
Reported on 1 benchmark across 1 task · 1 paper
Note: results are matched by exact model name. Different papers may use the same name for different model variants.
Medical1 result
- Bit per Character (BPC)· 2020-04-100.99best: 1.67 (LSTM (7 layers))