Semantic Role Labeling on OntoNotes

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	HeSyFu	88.59	No	-	-	Code
2	CRF2o + RoBERTa	88.32	No	Semantic Role Labeling as Dependency Parsing: Ex...	2021-10-13	Code
3	MRC-SRL	88.3	No	An MRC Framework for Semantic Role Labeling	2021-09-14	Code
4	ReCAT(pretrained on wikitext103)	88	No	Augmenting Transformers with Recursively Compose...	2023-09-28	Code
5	SRL-MM + XLNet	87.67	No	-	-	Code
6	CRF2o + BERT	87.66	No	Semantic Role Labeling as Dependency Parsing: Ex...	2021-10-13	Code
7	RoBERTa+RegCCRF	87.51	No	Constraining Linear-chain CRFs to Regular Langua...	2021-06-14	Code
8	RoBERTa+CRF	87.27	No	Constraining Linear-chain CRFs to Regular Langua...	2021-06-14	Code
9	BiLSTM-Span (Ensemble)	87	No	A Span Selection Model for Semantic Role Labeling	2018-10-04	Code
10	BiLSTM-Span	86.2	No	A Span Selection Model for Semantic Role Labeling	2018-10-04	Code
11	Li et al.	86	No	Dependency or Span, End-to-End Uniform Semantic ...	2019-01-16	Code
12	He et al.,	85.5	No	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code
13	He et al., 2017 + ELMo	84.6	No	Deep contextualized word representations	2018-02-15	Code
14	CRF2o	83.66	No	Semantic Role Labeling as Dependency Parsing: Ex...	2021-10-13	Code
15	Tan et al.	82.7	No	Deep Semantic Role Labeling with Self-Attention	2017-12-05	Code
16	He et al.	82.1	No	Jointly Predicting Predicates and Arguments in N...	2018-05-12	Code
17	He et al.	81.7	No	-	-	Code

#1HeSyFu
88.59
F1
No paperCode
#2CRF2o + RoBERTaSOTA
88.32
F1· 2021-10-13
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments Code
#3MRC-SRLSOTA
88.3
F1· 2021-09-14
An MRC Framework for Semantic Role Labeling Code
#4ReCAT(pretrained on wikitext103)
88
F1· 2023-09-28
Augmenting Transformers with Recursively Composed Multi-grained Representations Code
#5SRL-MM + XLNet
87.67
F1
No paperCode
#6CRF2o + BERT
87.66
F1· 2021-10-13
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments Code
#7RoBERTa+RegCCRFSOTA
87.51
F1· 2021-06-14
Constraining Linear-chain CRFs to Regular Languages Code
#8RoBERTa+CRF
87.27
F1· 2021-06-14
Constraining Linear-chain CRFs to Regular Languages Code
#9BiLSTM-Span (Ensemble)SOTA
87
F1· 2018-10-04
A Span Selection Model for Semantic Role Labeling Code
#10BiLSTM-Span
86.2
F1· 2018-10-04
A Span Selection Model for Semantic Role Labeling Code
#11Li et al.
86
F1· 2019-01-16
Dependency or Span, End-to-End Uniform Semantic Role Labeling Code
#12He et al.,SOTA
85.5
F1· 2018-05-12
Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling Code
#13He et al., 2017 + ELMoSOTA
84.6
F1· 2018-02-15
Deep contextualized word representations Code
#14CRF2o
83.66
F1· 2021-10-13
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments Code
#15Tan et al.SOTA
82.7
F1· 2017-12-05
Deep Semantic Role Labeling with Self-Attention Code
#16He et al.
82.1
F1· 2018-05-12
Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling Code
#17He et al.
81.7
F1
No paperCode