Semantic Role Labeling on CoNLL 2005

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	LISA	98.4	No	Linguistically-Informed Self-Attention for Seman...	2018-04-23	Code
2	DeepSRL	96.4	No	-	-	Code
3	MRC-SRL	90	No	An MRC Framework for Semantic Role Labeling	2021-09-14	Code
4	SRL-MM + XLNet	89.8	No	-	-	Code
5	CRF2o + RoBERTa	89.54	No	Semantic Role Labeling as Dependency Parsing: Ex...	2021-10-13	Code
6	HeSyFu	89.04	No	-	-	Code
7	CRF2o + BERT	89.03	No	Semantic Role Labeling as Dependency Parsing: Ex...	2021-10-13	Code
8	Mohammadshahi and Henderson (2021)	88.93	Yes	Syntax-Aware Graph-to-Graph Transformer for Sema...	2021-04-15	-
9	BiLSTM-Span (Ensemble, predicates given)	88.5	No	A Span Selection Model for Semantic Role Labeling	2018-10-04	Code
10	CRF2o	87.87	No	Semantic Role Labeling as Dependency Parsing: Ex...	2021-10-13	Code
11	Li et al. (2019) (Ensemble)	87.7	No	Dependency or Span, End-to-End Uniform Semantic ...	2019-01-16	Code
12	BiLSTM-Span	87.6	No	A Span Selection Model for Semantic Role Labeling	2018-10-04	Code
13	LISA + ELMo	86.9	No	Linguistically-Informed Self-Attention for Seman...	2018-04-23	Code
14	Li et al. (2019) + ELMo	86.3	Yes	Dependency or Span, End-to-End Uniform Semantic ...	2019-01-16	Code
15	LISA	86.04	No	Linguistically-Informed Self-Attention for Seman...	2018-04-23	Code
16	He et al. (2018) + ELMo	86	Yes	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code
17	He et al. 2018 + ELMo	86	No	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code
18	He et al. (2018)	86	No	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code
19	LISA	84.99	No	Linguistically-Informed Self-Attention for Seman...	2018-04-23	Code
20	Li et al. (2019)	83	No	Dependency or Span, End-to-End Uniform Semantic ...	2019-01-16	Code
21	He et al. (2018)	82.5	No	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code
22	He et al. 2018	82.5	No	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code

#1LISASOTA
98.4
F1· 2018-04-23
Linguistically-Informed Self-Attention for Semantic Role Labeling Code
#2DeepSRL
96.4
F1
No paperCode
#3MRC-SRL
90
F1· 2021-09-14
An MRC Framework for Semantic Role Labeling Code
#4SRL-MM + XLNet
89.8
F1
No paperCode
#5CRF2o + RoBERTa
89.54
F1· 2021-10-13
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments Code
#6HeSyFu
89.04
F1
No paperCode
#7CRF2o + BERT
89.03
F1· 2021-10-13
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments Code
#8Mohammadshahi and Henderson (2021)
88.93
F1· Extra Data· 2021-04-15
Syntax-Aware Graph-to-Graph Transformer for Semantic Role Labelling
#9BiLSTM-Span (Ensemble, predicates given)
88.5
F1· 2018-10-04
A Span Selection Model for Semantic Role Labeling Code
#10CRF2o
87.87
F1· 2021-10-13
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments Code
#11Li et al. (2019) (Ensemble)
87.7
F1· 2019-01-16
Dependency or Span, End-to-End Uniform Semantic Role Labeling Code
#12BiLSTM-Span
87.6
F1· 2018-10-04
A Span Selection Model for Semantic Role Labeling Code
#13LISA + ELMo
86.9
F1· 2018-04-23
Linguistically-Informed Self-Attention for Semantic Role Labeling Code
#14Li et al. (2019) + ELMo
86.3
F1· Extra Data· 2019-01-16
Dependency or Span, End-to-End Uniform Semantic Role Labeling Code
#15LISA
86.04
F1· 2018-04-23
Linguistically-Informed Self-Attention for Semantic Role Labeling Code
#16He et al. (2018) + ELMo
86
F1· Extra Data· 2018-05-12
Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling Code
#17He et al. 2018 + ELMo
86
F1· 2018-05-12
Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling Code
#18He et al. (2018)
86
F1· 2018-05-12
Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling Code
#19LISA
84.99
F1· 2018-04-23
Linguistically-Informed Self-Attention for Semantic Role Labeling Code
#20Li et al. (2019)
83
F1· 2019-01-16
Dependency or Span, End-to-End Uniform Semantic Role Labeling Code
#21He et al. (2018)
82.5
F1· 2018-05-12
Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling Code
#22He et al. 2018
82.5
F1· 2018-05-12
Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling Code