Relation Extraction on SemEval-2010 Task-8

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	SP	91.9	No	Relation Classification as Two-way Span-Prediction	2020-10-09	-
2	RIFRE	91.3	No	-	-	Code
3	REDN	91	No	Downstream Model Design of Pre-trained Language ...	2020-04-08	Code
4	SPOT	90.6	No	SPOT: Knowledge-Enhanced Language Representation...	2022-08-20	-
5	KLG	90.5	No	Reviewing Labels: Label Graph Network with Top-k...	2022-12-29	-
6	RELA	90.4	No	Sequence Generation with Label Augmentation for ...	2022-12-29	Code
7	Skeleton-Aware BERT	90.36	No	Enhancing Relation Extraction Using Syntactic In...	2019-12-04	Code
8	KnowPrompt	90.3	No	KnowPrompt: Knowledge-aware Prompt-tuning with S...	2021-04-15	Code
9	LUKE	90.3	No	SPOT: Knowledge-Enhanced Language Representation...	2022-08-20	-
10	EPGNN	90.2	No	-	-	-
11	RE-DMP + XLNet	89.9	No	-	-	Code
12	A-GCN + BERT	89.85	No	-	-	Code
13	BERTEM+MTB	89.5	No	Matching the Blanks: Distributional Similarity f...	2019-06-07	Code
14	BERT	89.4	No	SPOT: Knowledge-Enhanced Language Representation...	2022-08-20	-
15	R-BERT	89.25	No	Enriching Pre-trained Language Model with Entity...	2019-05-20	Code
16	CorefBERT	89.2	No	SPOT: Knowledge-Enhanced Language Representation...	2022-08-20	-
17	KnowBert-W+W	89.1	No	Knowledge Enhanced Contextual Word Representations	2019-09-09	Code
18	KnowBERT	89.1	No	SPOT: Knowledge-Enhanced Language Representation...	2022-08-20	-
19	Entity-Aware BERT	89	No	Extracting Multiple-Relations in One-Pass with P...	2019-02-04	Code
20	SpanBERT	88.8	No	SPOT: Knowledge-Enhanced Language Representation...	2022-08-20	-
21	RoBERTa	88.7	No	SPOT: Knowledge-Enhanced Language Representation...	2022-08-20	-
22	Att-Pooling-CNN	88	No	-	-	-
23	SpanRel	87.4	No	Generalizing Natural Language Analysis through S...	2019-11-10	Code
24	TRE	87.1	No	Improving Relation Extraction by Pre-trained Lan...	2019-06-07	Code
25	Entity Attention Bi-LSTM	85.2	No	Semantic Relation Classification via Bidirection...	2019-01-23	Code
26	Attention CNN	84.3	No	-	-	Code
27	CR-CNN	84.1	No	Classifying Relations by Ranking with Convolutio...	2015-04-24	Code
28	Attention Bi-LSTM	84	No	-	-	Code
29	CNN	82.7	No	-	-	Code
30	Bi-LSTM	82.7	No	-	-	-

#1SPSOTA
91.9
F1· 2020-10-09
Relation Classification as Two-way Span-Prediction
#2RIFRE
91.3
F1
No paperCode
#3REDNSOTA
91
F1· 2020-04-08
Downstream Model Design of Pre-trained Language Model for Relation Extraction Task Code
#4SPOT
90.6
F1· 2022-08-20
SPOT: Knowledge-Enhanced Language Representations for Information Extraction
#5KLG
90.5
F1· 2022-12-29
Reviewing Labels: Label Graph Network with Top-k Prediction Set for Relation Extraction
#6RELA
90.4
F1· 2022-12-29
Sequence Generation with Label Augmentation for Relation Extraction Code
#7Skeleton-Aware BERTSOTA
90.36
F1· 2019-12-04
Enhancing Relation Extraction Using Syntactic Indicators and Sentential Contexts Code
#8KnowPrompt
90.3
F1· 2021-04-15
KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction Code
#9LUKE
90.3
F1· 2022-08-20
SPOT: Knowledge-Enhanced Language Representations for Information Extraction
#10EPGNN
90.2
F1
No paper
#11RE-DMP + XLNet
89.9
F1
No paperCode
#12A-GCN + BERT
89.85
F1
No paperCode
#13BERTEM+MTBSOTA
89.5
F1· 2019-06-07
Matching the Blanks: Distributional Similarity for Relation Learning Code
#14BERT
89.4
F1· 2022-08-20
SPOT: Knowledge-Enhanced Language Representations for Information Extraction
#15R-BERTSOTA
89.25
F1· 2019-05-20
Enriching Pre-trained Language Model with Entity Information for Relation Classification Code
#16CorefBERT
89.2
F1· 2022-08-20
SPOT: Knowledge-Enhanced Language Representations for Information Extraction
#17KnowBert-W+W
89.1
F1· 2019-09-09
Knowledge Enhanced Contextual Word Representations Code
#18KnowBERT
89.1
F1· 2022-08-20
SPOT: Knowledge-Enhanced Language Representations for Information Extraction
#19Entity-Aware BERTSOTA
89
F1· 2019-02-04
Extracting Multiple-Relations in One-Pass with Pre-Trained Transformers Code
#20SpanBERT
88.8
F1· 2022-08-20
SPOT: Knowledge-Enhanced Language Representations for Information Extraction
#21RoBERTa
88.7
F1· 2022-08-20
SPOT: Knowledge-Enhanced Language Representations for Information Extraction
#22Att-Pooling-CNN
88
F1
No paper
#23SpanRel
87.4
F1· 2019-11-10
Generalizing Natural Language Analysis through Span-relation Representations Code
#24TRE
87.1
F1· 2019-06-07
Improving Relation Extraction by Pre-trained Language Representations Code
#25Entity Attention Bi-LSTMSOTA
85.2
F1· 2019-01-23
Semantic Relation Classification via Bidirectional LSTM Networks with Entity-aware Attention using Latent Entity Typing Code
#26Attention CNN
84.3
F1
No paperCode
#27CR-CNNSOTA
84.1
F1· 2015-04-24
Classifying Relations by Ranking with Convolutional Neural Networks Code
#28Attention Bi-LSTM
84
F1
No paperCode
#29CNN
82.7
F1
No paperCode
#30Bi-LSTM
82.7
F1
No paper