Rfa-Gate-Gaussian-Stateful (Big)

Reported on 2 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Medical2 results

Language ModellingonWikiText-103
Test perplexity· 2021-03-03
23.5
best: 2.4 (RETRO (7.5B))
Random Feature Attention arXiv:2103.02143
Language ModellingonWikiText-103
Validation perplexity· 2021-03-03
22
best: 13.11 (Ensemble of All)
Random Feature Attention arXiv:2103.02143