TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Natural Language Processing/Natural Language Understanding/STREUSLE

Natural Language Understanding on STREUSLE

Metric: Full F1 (Preps) (higher is better)

LeaderboardDataset
Loading chart...

Results

Submit a result
#Model↕Full F1 (Preps)▼Extra DataPaperDate↕Code
1RoBERTa + Linear78.2No---
2BERT (pred POS/lemmas)71.6NoLexical Semantic Recognition2020-04-30Code
3BERT (gold POS/lemmas)71.4NoLexical Semantic Recognition2020-04-30Code
4BERT (none)70.9NoLexical Semantic Recognition2020-04-30Code
5GloVe (gold POS/lemmas)61NoLexical Semantic Recognition2020-04-30Code
6SVM (feature-rich, gold syntax)59.5NoComprehensive Supersense Disambiguation of Engli...2018-05-13Code
7BiLSTM + MLP (gold syntax)58.9NoComprehensive Supersense Disambiguation of Engli...2018-05-13Code
8GloVe (none)58.1NoLexical Semantic Recognition2020-04-30Code
9GloVe (pred POS/lemmas)58NoLexical Semantic Recognition2020-04-30Code
10SVM (feature-rich, auto syntax)55.7NoComprehensive Supersense Disambiguation of Engli...2018-05-13Code
11BiLSTM + MLP (auto syntax)53.6NoComprehensive Supersense Disambiguation of Engli...2018-05-13Code