Natural Language Understanding on STREUSLE
Metric: Function F1 (Preps) (higher is better)
Metric: Function F1 (Preps) (higher is better)
| # | Model↕ | Function F1 (Preps)▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | BERT (pred POS/lemmas) | 82.8 | No | Lexical Semantic Recognition | 2020-04-30 | Code |
| 2 | BERT (gold POS/lemmas) | 81.7 | No | Lexical Semantic Recognition | 2020-04-30 | Code |
| 3 | BERT (none) | 81 | No | Lexical Semantic Recognition | 2020-04-30 | Code |
| 4 | BiLSTM + MLP (gold syntax) | 73.4 | No | Comprehensive Supersense Disambiguation of Engli... | 2018-05-13 | Code |
| 5 | SVM (feature-rich, gold syntax) | 71 | No | Comprehensive Supersense Disambiguation of Engli... | 2018-05-13 | Code |
| 6 | SVM (feature-rich, auto syntax) | 66.7 | No | Comprehensive Supersense Disambiguation of Engli... | 2018-05-13 | Code |
| 7 | BiLSTM + MLP (auto syntax) | 66.7 | No | Comprehensive Supersense Disambiguation of Engli... | 2018-05-13 | Code |