Natural Language Understanding on STREUSLE
Metric: Role F1 (Preps) (higher is better)
Metric: Role F1 (Preps) (higher is better)
| # | Model↕ | Role F1 (Preps)▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | BERT (pred POS/lemmas) | 72.4 | No | Lexical Semantic Recognition | 2020-04-30 | Code |
| 2 | BERT (gold POS/lemmas) | 72.4 | No | Lexical Semantic Recognition | 2020-04-30 | Code |
| 3 | BERT (none) | 71.9 | No | Lexical Semantic Recognition | 2020-04-30 | Code |
| 4 | BiLSTM + MLP (gold syntax) | 62.2 | No | Comprehensive Supersense Disambiguation of Engli... | 2018-05-13 | Code |
| 5 | SVM (feature-rich, gold syntax) | 62.2 | No | Comprehensive Supersense Disambiguation of Engli... | 2018-05-13 | Code |
| 6 | SVM (feature-rich, auto syntax) | 58.2 | No | Comprehensive Supersense Disambiguation of Engli... | 2018-05-13 | Code |
| 7 | BiLSTM + MLP (auto syntax) | 56.3 | No | Comprehensive Supersense Disambiguation of Engli... | 2018-05-13 | Code |