Relation Extraction on TACRED

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	RAG4RE	86.6	No	Retrieval-Augmented Generation-based Relation Ex...	2024-04-20	Code
2	DeepStruct multi-task w/ finetune	76.8	No	DeepStruct: Pretraining of Language Models for S...	2022-05-21	Code
3	DeepStruct multi-task w/ finetune	76.8	No	DeepStruct: Pretraining of Language Models for S...	2022-05-21	Code
4	DeepEx (zero-shot top-10)	76.4	No	Zero-Shot Information Extraction as a Unified Te...	2021-09-23	Code
5	UNiST (LARGE)	75.5	No	Unified Semantic Typing with Meaningful Label In...	2022-05-04	Code
6	RE-MC	75.4	Yes	-	-	Code
7	GenPT (T5)	75.3	No	Generative Prompt Tuning for Relation Classifica...	2022-10-22	Code
8	RECENT+SpanBERT	75.2	No	Relation Classification with Entity Type Restric...	2021-05-18	-
9	SuRE (PEGASUS-large)	75.1	No	Summarization as Indirect Supervision for Relati...	2022-05-19	Code
10	EXOBRAIN	75	No	Improving Sentence-Level Relation Extraction thr...	2021-07-20	-
11	DeepStruct multi-task	74.9	No	DeepStruct: Pretraining of Language Models for S...	2022-05-21	Code
12	Relation Reduction	74.8	No	Relation Classification as Two-way Span-Prediction	2020-10-09	-
13	RoBERTa-large-typed-marker	74.6	No	An Improved Baseline for Sentence-level Relation...	2021-02-02	Code
14	NLI_DeBERTa	73.9	No	Label Verbalization and Entailment for Effective...	2021-09-08	Code
15	Noise-robust Co-regularization + BERT-large	73	No	Learning from Noisy Labels for Entity-Centric In...	2021-04-17	Code
16	LUKE 483M	72.7	No	LUKE: Deep Contextualized Entity Representations...	2020-10-02	Code
17	DeNERT-KG	72.4	Yes	-	-	-
18	K-ADAPTER (F+L)	72.04	Yes	K-Adapter: Infusing Knowledge into Pre-Trained M...	2020-02-05	Code
19	K-Adapter	72	No	K-Adapter: Infusing Knowledge into Pre-Trained M...	2020-02-05	Code
20	TANL	71.9	No	Structured Prediction as Translation between Aug...	2021-01-14	Code
21	TANL	71.9	No	Structured Prediction as Translation between Aug...	2021-01-14	Code
22	KEPLER	71.7	Yes	KEPLER: A Unified Model for Knowledge Embedding ...	2019-11-13	Code
23	KEPLER	71.7	No	KEPLER: A Unified Model for Knowledge Embedding ...	2019-11-13	Code
24	BERTEM+MTB	71.5	Yes	Matching the Blanks: Distributional Similarity f...	2019-06-07	Code
25	KnowBert-W+W	71.5	Yes	Knowledge Enhanced Contextual Word Representations	2019-09-09	Code
26	DG-SpanBERT-large	71.5	No	Efficient long-distance relation extraction with...	2020-04-07	-
27	MTB Baldini Soares et al. (2019)	71.5	No	Matching the Blanks: Distributional Similarity f...	2019-06-07	Code
28	KnowBERT	71.5	No	Knowledge Enhanced Contextual Word Representations	2019-09-09	Code
29	RoBERTa	71.3	No	K-Adapter: Infusing Knowledge into Pre-Trained M...	2020-02-05	Code
30	RELA	71.2	No	Sequence Generation with Label Augmentation for ...	2022-12-29	Code
31	NLI_RoBERTa	71	No	Label Verbalization and Entailment for Effective...	2021-09-08	Code
32	SpanBERT-large	70.8	No	SpanBERT: Improving Pre-training by Representing...	2019-07-24	Code
33	SpanBERT	70.8	No	SpanBERT: Improving Pre-training by Representing...	2019-07-24	Code
34	GDPNet	70.5	No	GDPNet: Refining Latent Multi-View Graph for Rel...	2020-12-12	Code
35	Contrastive Pre-training	69.5	No	Learning from Context or Names? An Empirical Stu...	2020-10-05	Code
36	R-BERT	69.4	No	Enriching Pre-trained Language Model with Entity...	2019-05-20	Code
37	C-GCN + PA-LSTM	68.2	No	Graph Convolution over Pruned Dependency Trees I...	2018-09-26	Code
38	C-AGGCN	68.2	No	Attention Guided Graph Convolutional Networks fo...	2019-06-18	Code
39	ERNIE	68	No	ERNIE: Enhanced Language Representation with Inf...	2019-05-17	Code
40	ERNIE	67.97	No	ERNIE: Enhanced Language Representation with Inf...	2019-05-17	Code
41	BERT-LSTM-base	67.8	No	Simple BERT Models for Relation Extraction and S...	2019-04-10	Code
42	SA-LSTM+D	67.6	No	-	-	Code
43	TRE	67.4	No	Improving Relation Extraction by Pre-trained Lan...	2019-06-07	Code
44	Alt et al. (2019)	67.4	No	Improving Relation Extraction by Pre-trained Lan...	2019-06-07	Code
45	GCN + PA-LSTM	67.1	No	Graph Convolution over Pruned Dependency Trees I...	2018-09-26	Code
46	C-SGC	67	No	Simplifying Graph Convolutional Networks	2019-02-19	Code
47	C-GCN	66.4	No	Graph Convolution over Pruned Dependency Trees I...	2018-09-26	Code
48	C-GCN	66.4	No	Graph Convolution over Pruned Dependency Trees I...	2018-09-26	Code
49	BERT	66	No	ERNIE: Enhanced Language Representation with Inf...	2019-05-17	Code
50	PA-LSTM	65.1	No	-	-	Code
51	AGGCN	65.1	No	Attention Guided Graph Convolutional Networks fo...	2019-06-18	Code
52	GCN	64	No	Graph Convolution over Pruned Dependency Trees I...	2018-09-26	Code
53	TANL (multi-task)	61.9	No	Structured Prediction as Translation between Aug...	2021-01-14	Code
54	LLM-QA4RE (XXLarge)	52.2	No	Aligning Instruction Tasks Unlocks Large Languag...	2023-05-18	Code
55	DeepEx (zero-shot top-1)	49.2	No	Zero-Shot Information Extraction as a Unified Te...	2021-09-23	Code
56	Deepstruct zero-shot	36.1	No	DeepStruct: Pretraining of Language Models for S...	2022-05-21	Code

#1RAG4RESOTA
86.6
F1· 2024-04-20
Retrieval-Augmented Generation-based Relation Extraction Code
#2DeepStruct multi-task w/ finetuneSOTA
76.8
F1· 2022-05-21
DeepStruct: Pretraining of Language Models for Structure Prediction Code
#3DeepStruct multi-task w/ finetune
76.8
F1· 2022-05-21
DeepStruct: Pretraining of Language Models for Structure Prediction Code
#4DeepEx (zero-shot top-10)SOTA
76.4
F1· 2021-09-23
Zero-Shot Information Extraction as a Unified Text-to-Triple Translation Code
#5UNiST (LARGE)
75.5
F1· 2022-05-04
Unified Semantic Typing with Meaningful Label Inference Code
#6RE-MC
75.4
F1· Extra Data
No paperCode
#7GenPT (T5)
75.3
F1· 2022-10-22
Generative Prompt Tuning for Relation Classification Code
#8RECENT+SpanBERTSOTA
75.2
F1· 2021-05-18
Relation Classification with Entity Type Restriction
#9SuRE (PEGASUS-large)
75.1
F1· 2022-05-19
Summarization as Indirect Supervision for Relation Extraction Code
#10EXOBRAIN
75
F1· 2021-07-20
Improving Sentence-Level Relation Extraction through Curriculum Learning
#11DeepStruct multi-task
74.9
F1· 2022-05-21
DeepStruct: Pretraining of Language Models for Structure Prediction Code
#12Relation ReductionSOTA
74.8
F1· 2020-10-09
Relation Classification as Two-way Span-Prediction
#13RoBERTa-large-typed-marker
74.6
F1· 2021-02-02
An Improved Baseline for Sentence-level Relation Extraction Code
#14NLI_DeBERTa
73.9
F1· 2021-09-08
Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extraction Code
#15Noise-robust Co-regularization + BERT-large
73
F1· 2021-04-17
Learning from Noisy Labels for Entity-Centric Information Extraction Code
#16LUKE 483MSOTA
72.7
F1· 2020-10-02
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Code
#17DeNERT-KG
72.4
F1· Extra Data
No paper
#18K-ADAPTER (F+L)SOTA
72.04
F1· Extra Data· 2020-02-05
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters Code
#19K-Adapter
72
F1· 2020-02-05
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters Code
#20TANL
71.9
F1· 2021-01-14
Structured Prediction as Translation between Augmented Natural Languages Code
#21TANL
71.9
F1· 2021-01-14
Structured Prediction as Translation between Augmented Natural Languages Code
#22KEPLERSOTA
71.7
F1· Extra Data· 2019-11-13
KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation Code
#23KEPLER
71.7
F1· 2019-11-13
KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation Code
#24BERTEM+MTBSOTA
71.5
F1· Extra Data· 2019-06-07
Matching the Blanks: Distributional Similarity for Relation Learning Code
#25KnowBert-W+W
71.5
F1· Extra Data· 2019-09-09
Knowledge Enhanced Contextual Word Representations Code
#26DG-SpanBERT-large
71.5
F1· 2020-04-07
Efficient long-distance relation extraction with DG-SpanBERT
#27MTB Baldini Soares et al. (2019)
71.5
F1· 2019-06-07
Matching the Blanks: Distributional Similarity for Relation Learning Code
#28KnowBERT
71.5
F1· 2019-09-09
Knowledge Enhanced Contextual Word Representations Code
#29RoBERTa
71.3
F1· 2020-02-05
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters Code
#30RELA
71.2
F1· 2022-12-29
Sequence Generation with Label Augmentation for Relation Extraction Code
#31NLI_RoBERTa
71
F1· 2021-09-08
Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extraction Code
#32SpanBERT-large
70.8
F1· 2019-07-24
SpanBERT: Improving Pre-training by Representing and Predicting Spans Code
#33SpanBERT
70.8
F1· 2019-07-24
SpanBERT: Improving Pre-training by Representing and Predicting Spans Code
#34GDPNet
70.5
F1· 2020-12-12
GDPNet: Refining Latent Multi-View Graph for Relation Extraction Code
#35Contrastive Pre-training
69.5
F1· 2020-10-05
Learning from Context or Names? An Empirical Study on Neural Relation Extraction Code
#36R-BERTSOTA
69.4
F1· 2019-05-20
Enriching Pre-trained Language Model with Entity Information for Relation Classification Code
#37C-GCN + PA-LSTMSOTA
68.2
F1· 2018-09-26
Graph Convolution over Pruned Dependency Trees Improves Relation Extraction Code
#38C-AGGCN
68.2
F1· 2019-06-18
Attention Guided Graph Convolutional Networks for Relation Extraction Code
#39ERNIE
68
F1· 2019-05-17
ERNIE: Enhanced Language Representation with Informative Entities Code
#40ERNIE
67.97
F1· 2019-05-17
ERNIE: Enhanced Language Representation with Informative Entities Code
#41BERT-LSTM-base
67.8
F1· 2019-04-10
Simple BERT Models for Relation Extraction and Semantic Role Labeling Code
#42SA-LSTM+D
67.6
F1
No paperCode
#43TRE
67.4
F1· 2019-06-07
Improving Relation Extraction by Pre-trained Language Representations Code
#44Alt et al. (2019)
67.4
F1· 2019-06-07
Improving Relation Extraction by Pre-trained Language Representations Code
#45GCN + PA-LSTM
67.1
F1· 2018-09-26
Graph Convolution over Pruned Dependency Trees Improves Relation Extraction Code
#46C-SGC
67
F1· 2019-02-19
Simplifying Graph Convolutional Networks Code
#47C-GCN
66.4
F1· 2018-09-26
Graph Convolution over Pruned Dependency Trees Improves Relation Extraction Code
#48C-GCN
66.4
F1· 2018-09-26
Graph Convolution over Pruned Dependency Trees Improves Relation Extraction Code
#49BERT
66
F1· 2019-05-17
ERNIE: Enhanced Language Representation with Informative Entities Code
#50PA-LSTM
65.1
F1
No paperCode
#51AGGCN
65.1
F1· 2019-06-18
Attention Guided Graph Convolutional Networks for Relation Extraction Code
#52GCN
64
F1· 2018-09-26
Graph Convolution over Pruned Dependency Trees Improves Relation Extraction Code
#53TANL (multi-task)
61.9
F1· 2021-01-14
Structured Prediction as Translation between Augmented Natural Languages Code
#54LLM-QA4RE (XXLarge)
52.2
F1· 2023-05-18
Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractors Code
#55DeepEx (zero-shot top-1)
49.2
F1· 2021-09-23
Zero-Shot Information Extraction as a Unified Text-to-Triple Translation Code
#56Deepstruct zero-shot
36.1
F1· 2022-05-21
DeepStruct: Pretraining of Language Models for Structure Prediction Code