GPT-2 (48 layers, h=1600)
Reported on 1 benchmark across 1 task
Note: results are matched by exact model name. Different papers may use the same name for different model variants.
Medical1 result
- Bit per Character (BPC)· uses extra data0.93best: 1.67 (LSTM (7 layers))