Language Modelling on LRA
Metric: Pathfinder (higher is better)
Metric: Pathfinder (higher is better)
| # | Model↕ | Pathfinder▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | S5 | 95.33 | No | Simplified State Space Layers for Sequence Model... | 2022-08-09 | Code |
| 2 | S4 | 94.2 | No | How to Train Your HiPPO: State Space Models with... | 2022-06-24 | Code |
| 3 | Converter | 88.43 | No | Converting Transformers into DGNNs Form | 2025-02-01 | Code |
| 4 | Performer | 77.05 | No | Long Range Arena: A Benchmark for Efficient Tran... | 2020-11-08 | Code |
| 5 | Linear Trans. | 75.3 | No | Long Range Arena: A Benchmark for Efficient Tran... | 2020-11-08 | Code |
| 6 | Sparse Trans. | 71.71 | No | Long Range Arena: A Benchmark for Efficient Tran... | 2020-11-08 | Code |
| 7 | Transformer | 71.4 | No | Long Range Arena: A Benchmark for Efficient Tran... | 2020-11-08 | Code |