Language Modelling on SCROLLS
Metric: Qspr (higher is better)
Metric: Qspr (higher is better)
| # | Model↕ | Qspr▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | CoLT5 XL | 53.9 | No | CoLT5: Faster Long-Range Transformers with Condi... | 2023-03-17 | - |
| 2 | LongT5 XL | 53.1 | No | LongT5: Efficient Text-To-Text Transformer for L... | 2021-12-15 | Code |
| 3 | LongT5 Large | 52.3 | No | LongT5: Efficient Text-To-Text Transformer for L... | 2021-12-15 | Code |
| 4 | BART-LS | 48.7 | No | Adapting Pretrained Text-to-Text Models for Long... | 2022-09-21 | Code |
| 5 | BART-large SLED | 46.9 | No | Efficient Long-Text Understanding with Short-Tex... | 2022-08-01 | Code |
| 6 | LongT5 Base | 46.6 | No | LongT5: Efficient Text-To-Text Transformer for L... | 2021-12-15 | Code |
| 7 | UL2 | 37.6 | No | UL2: Unifying Language Learning Paradigms | 2022-05-10 | Code |
| 8 | LED Base | 26.6 | No | SCROLLS: Standardized CompaRison Over Long Langu... | 2022-01-10 | Code |
| 9 | BART Base | 26.3 | No | SCROLLS: Standardized CompaRison Over Long Langu... | 2022-01-10 | Code |
| 10 | Naive | 3.4 | No | SCROLLS: Standardized CompaRison Over Long Langu... | 2022-01-10 | Code |