Relation Extraction on Adverse Drug Events (ADE) Corpus

Metric: RE+ Macro F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	RE+ Macro F1▼	Extra Data	Paper	Date↕	Code
1	PFN (ALBERT XXL, average aggregation)	83.9	No	An Information Extraction Study: Take In Mind th...	2023-03-27	Code
2	Deeper	83.74	No	Deeper Task-Specificity Improves Joint Entity an...	2020-02-15	Code
3	PFN (ALBERT XXL, no aggregation)	83.2	No	A Partition Filter Network for Joint Entity and ...	2021-08-27	Code
4	SpERT.PL (without overlap and BioBERT)	82.39	No	-	-	Code
5	REBEL (including overlapping entities)	82.2	Yes	-	-	Code
6	SpERT.PL (with overlap and BioBERT)	82.03	No	-	-	Code
7	CMAN	81.14	No	-	-	-
8	Table-Sequence	80.1	No	Two are Better than One: Joint Entity and Relati...	2020-10-08	Code
9	CLDR + CLNER	79.97	No	Imposing Relation Structure in Language-Model Em...	2021-09-02	Code
10	SpERT (without overlap)	79.24	No	Span-based Joint Entity and Relation Extraction ...	2019-09-17	Code
11	SpERT (with overlap)	78.84	No	Span-based Joint Entity and Relation Extraction ...	2019-09-17	Code
12	Relation-Metric	77.19	No	Neural Metric Learning for Fast End-to-End Relat...	2019-05-17	-
13	multi-head + AT	75.52	No	Adversarial training for multi-context joint ent...	2018-08-21	Code
14	multi-head	74.58	No	Joint entity recognition and relation extraction...	2018-04-20	Code

#1PFN (ALBERT XXL, average aggregation)SOTA
83.9
RE+ Macro F1· 2023-03-27
An Information Extraction Study: Take In Mind the Tokenization!Code
#2DeeperSOTA
83.74
RE+ Macro F1· 2020-02-15
Deeper Task-Specificity Improves Joint Entity and Relation Extraction Code
#3PFN (ALBERT XXL, no aggregation)
83.2
RE+ Macro F1· 2021-08-27
A Partition Filter Network for Joint Entity and Relation Extraction Code
#4SpERT.PL (without overlap and BioBERT)
82.39
RE+ Macro F1
No paperCode
#5REBEL (including overlapping entities)
82.2
RE+ Macro F1· Extra Data
No paperCode
#6SpERT.PL (with overlap and BioBERT)
82.03
RE+ Macro F1
No paperCode
#7CMAN
81.14
RE+ Macro F1
No paper
#8Table-Sequence
80.1
RE+ Macro F1· 2020-10-08
Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders Code
#9CLDR + CLNER
79.97
RE+ Macro F1· 2021-09-02
Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning Code
#10SpERT (without overlap)SOTA
79.24
RE+ Macro F1· 2019-09-17
Span-based Joint Entity and Relation Extraction with Transformer Pre-training Code
#11SpERT (with overlap)
78.84
RE+ Macro F1· 2019-09-17
Span-based Joint Entity and Relation Extraction with Transformer Pre-training Code
#12Relation-MetricSOTA
77.19
RE+ Macro F1· 2019-05-17
Neural Metric Learning for Fast End-to-End Relation Extraction
#13multi-head + ATSOTA
75.52
RE+ Macro F1· 2018-08-21
Adversarial training for multi-context joint entity and relation extraction Code
#14multi-headSOTA
74.58
RE+ Macro F1· 2018-04-20
Joint entity recognition and relation extraction as a multi-head selection problem Code