Relation Extraction on Adverse Drug Events (ADE) Corpus

Metric: NER Macro F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	NER Macro F1▼	Extra Data	Paper	Date↕	Code
1	PFN (ALBERT XXL, average aggregation)	91.5	No	An Information Extraction Study: Take In Mind th...	2023-03-27	Code
2	PFN (ALBERT XXL, no aggregation)	91.3	No	A Partition Filter Network for Joint Entity and ...	2021-08-27	Code
3	SpERT.PL (with overlap and BioBERT)	91.17	No	-	-	Code
4	SpERT.PL (without overlap and BioBERT)	91.14	No	-	-	Code
5	Table-Sequence	89.7	No	Two are Better than One: Joint Entity and Relati...	2020-10-08	Code
6	Deeper	89.48	No	Deeper Task-Specificity Improves Joint Entity an...	2020-02-15	Code
7	CMAN	89.4	No	-	-	-
8	SpERT (with overlap)	89.28	No	Span-based Joint Entity and Relation Extraction ...	2019-09-17	Code
9	SpERT (without overlap)	89.25	No	Span-based Joint Entity and Relation Extraction ...	2019-09-17	Code
10	CLDR + CLNER	88.3	No	Imposing Relation Structure in Language-Model Em...	2021-09-02	Code
11	Relation-Metric	87.02	No	Neural Metric Learning for Fast End-to-End Relat...	2019-05-17	-
12	multi-head + AT	86.73	No	Adversarial training for multi-context joint ent...	2018-08-21	Code
13	multi-head	86.4	No	Joint entity recognition and relation extraction...	2018-04-20	Code

#1PFN (ALBERT XXL, average aggregation)SOTA
91.5
NER Macro F1· 2023-03-27
An Information Extraction Study: Take In Mind the Tokenization!Code
#2PFN (ALBERT XXL, no aggregation)SOTA
91.3
NER Macro F1· 2021-08-27
A Partition Filter Network for Joint Entity and Relation Extraction Code
#3SpERT.PL (with overlap and BioBERT)
91.17
NER Macro F1
No paperCode
#4SpERT.PL (without overlap and BioBERT)
91.14
NER Macro F1
No paperCode
#5Table-SequenceSOTA
89.7
NER Macro F1· 2020-10-08
Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders Code
#6DeeperSOTA
89.48
NER Macro F1· 2020-02-15
Deeper Task-Specificity Improves Joint Entity and Relation Extraction Code
#7CMAN
89.4
NER Macro F1
No paper
#8SpERT (with overlap)SOTA
89.28
NER Macro F1· 2019-09-17
Span-based Joint Entity and Relation Extraction with Transformer Pre-training Code
#9SpERT (without overlap)
89.25
NER Macro F1· 2019-09-17
Span-based Joint Entity and Relation Extraction with Transformer Pre-training Code
#10CLDR + CLNER
88.3
NER Macro F1· 2021-09-02
Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning Code
#11Relation-MetricSOTA
87.02
NER Macro F1· 2019-05-17
Neural Metric Learning for Fast End-to-End Relation Extraction
#12multi-head + ATSOTA
86.73
NER Macro F1· 2018-08-21
Adversarial training for multi-context joint entity and relation extraction Code
#13multi-headSOTA
86.4
NER Macro F1· 2018-04-20
Joint entity recognition and relation extraction as a multi-head selection problem Code