Semantic Role Labeling on CoNLL 2005

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	LISA	98.4	No	Linguistically-Informed Self-Attention for Seman...	2018-04-23	Code
2	DeepSRL	96.4	No	-	-	Code
3	MRC-SRL	90	No	An MRC Framework for Semantic Role Labeling	2021-09-14	Code
4	SRL-MM + XLNet	89.8	No	-	-	Code
5	CRF2o + RoBERTa	89.54	No	Semantic Role Labeling as Dependency Parsing: Ex...	2021-10-13	Code
6	HeSyFu	89.04	No	-	-	Code
7	CRF2o + BERT	89.03	No	Semantic Role Labeling as Dependency Parsing: Ex...	2021-10-13	Code
8	Mohammadshahi and Henderson (2021)	88.93	Yes	Syntax-Aware Graph-to-Graph Transformer for Sema...	2021-04-15	-
9	BiLSTM-Span (Ensemble, predicates given)	88.5	No	A Span Selection Model for Semantic Role Labeling	2018-10-04	Code
10	CRF2o	87.87	No	Semantic Role Labeling as Dependency Parsing: Ex...	2021-10-13	Code
11	Li et al. (2019) (Ensemble)	87.7	No	Dependency or Span, End-to-End Uniform Semantic ...	2019-01-16	Code
12	BiLSTM-Span	87.6	No	A Span Selection Model for Semantic Role Labeling	2018-10-04	Code
13	LISA + ELMo	86.9	No	Linguistically-Informed Self-Attention for Seman...	2018-04-23	Code
14	Li et al. (2019) + ELMo	86.3	Yes	Dependency or Span, End-to-End Uniform Semantic ...	2019-01-16	Code
15	LISA	86.04	No	Linguistically-Informed Self-Attention for Seman...	2018-04-23	Code
16	He et al. (2018) + ELMo	86	Yes	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code
17	He et al. 2018 + ELMo	86	No	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code
18	He et al. (2018)	86	No	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code
19	LISA	84.99	No	Linguistically-Informed Self-Attention for Seman...	2018-04-23	Code
20	Li et al. (2019)	83	No	Dependency or Span, End-to-End Uniform Semantic ...	2019-01-16	Code
21	He et al. (2018)	82.5	No	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code
22	He et al. 2018	82.5	No	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code