Relation Extraction on TACRED

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	RAG4RE	86.6	No	Retrieval-Augmented Generation-based Relation Ex...	2024-04-20	Code
2	DeepStruct multi-task w/ finetune	76.8	No	DeepStruct: Pretraining of Language Models for S...	2022-05-21	Code
3	DeepStruct multi-task w/ finetune	76.8	No	DeepStruct: Pretraining of Language Models for S...	2022-05-21	Code
4	DeepEx (zero-shot top-10)	76.4	No	Zero-Shot Information Extraction as a Unified Te...	2021-09-23	Code
5	UNiST (LARGE)	75.5	No	Unified Semantic Typing with Meaningful Label In...	2022-05-04	Code
6	RE-MC	75.4	Yes	-	-	Code
7	GenPT (T5)	75.3	No	Generative Prompt Tuning for Relation Classifica...	2022-10-22	Code
8	RECENT+SpanBERT	75.2	No	Relation Classification with Entity Type Restric...	2021-05-18	-
9	SuRE (PEGASUS-large)	75.1	No	Summarization as Indirect Supervision for Relati...	2022-05-19	Code
10	EXOBRAIN	75	No	Improving Sentence-Level Relation Extraction thr...	2021-07-20	-
11	DeepStruct multi-task	74.9	No	DeepStruct: Pretraining of Language Models for S...	2022-05-21	Code
12	Relation Reduction	74.8	No	Relation Classification as Two-way Span-Prediction	2020-10-09	-
13	RoBERTa-large-typed-marker	74.6	No	An Improved Baseline for Sentence-level Relation...	2021-02-02	Code
14	NLI_DeBERTa	73.9	No	Label Verbalization and Entailment for Effective...	2021-09-08	Code
15	Noise-robust Co-regularization + BERT-large	73	No	Learning from Noisy Labels for Entity-Centric In...	2021-04-17	Code
16	LUKE 483M	72.7	No	LUKE: Deep Contextualized Entity Representations...	2020-10-02	Code
17	DeNERT-KG	72.4	Yes	-	-	-
18	K-ADAPTER (F+L)	72.04	Yes	K-Adapter: Infusing Knowledge into Pre-Trained M...	2020-02-05	Code
19	K-Adapter	72	No	K-Adapter: Infusing Knowledge into Pre-Trained M...	2020-02-05	Code
20	TANL	71.9	No	Structured Prediction as Translation between Aug...	2021-01-14	Code
21	TANL	71.9	No	Structured Prediction as Translation between Aug...	2021-01-14	Code
22	KEPLER	71.7	Yes	KEPLER: A Unified Model for Knowledge Embedding ...	2019-11-13	Code
23	KEPLER	71.7	No	KEPLER: A Unified Model for Knowledge Embedding ...	2019-11-13	Code
24	BERTEM+MTB	71.5	Yes	Matching the Blanks: Distributional Similarity f...	2019-06-07	Code
25	KnowBert-W+W	71.5	Yes	Knowledge Enhanced Contextual Word Representations	2019-09-09	Code
26	DG-SpanBERT-large	71.5	No	Efficient long-distance relation extraction with...	2020-04-07	-
27	MTB Baldini Soares et al. (2019)	71.5	No	Matching the Blanks: Distributional Similarity f...	2019-06-07	Code
28	KnowBERT	71.5	No	Knowledge Enhanced Contextual Word Representations	2019-09-09	Code
29	RoBERTa	71.3	No	K-Adapter: Infusing Knowledge into Pre-Trained M...	2020-02-05	Code
30	RELA	71.2	No	Sequence Generation with Label Augmentation for ...	2022-12-29	Code
31	NLI_RoBERTa	71	No	Label Verbalization and Entailment for Effective...	2021-09-08	Code
32	SpanBERT-large	70.8	No	SpanBERT: Improving Pre-training by Representing...	2019-07-24	Code
33	SpanBERT	70.8	No	SpanBERT: Improving Pre-training by Representing...	2019-07-24	Code
34	GDPNet	70.5	No	GDPNet: Refining Latent Multi-View Graph for Rel...	2020-12-12	Code
35	Contrastive Pre-training	69.5	No	Learning from Context or Names? An Empirical Stu...	2020-10-05	Code
36	R-BERT	69.4	No	Enriching Pre-trained Language Model with Entity...	2019-05-20	Code
37	C-GCN + PA-LSTM	68.2	No	Graph Convolution over Pruned Dependency Trees I...	2018-09-26	Code
38	C-AGGCN	68.2	No	Attention Guided Graph Convolutional Networks fo...	2019-06-18	Code
39	ERNIE	68	No	ERNIE: Enhanced Language Representation with Inf...	2019-05-17	Code
40	ERNIE	67.97	No	ERNIE: Enhanced Language Representation with Inf...	2019-05-17	Code
41	BERT-LSTM-base	67.8	No	Simple BERT Models for Relation Extraction and S...	2019-04-10	Code
42	SA-LSTM+D	67.6	No	-	-	Code
43	TRE	67.4	No	Improving Relation Extraction by Pre-trained Lan...	2019-06-07	Code
44	Alt et al. (2019)	67.4	No	Improving Relation Extraction by Pre-trained Lan...	2019-06-07	Code
45	GCN + PA-LSTM	67.1	No	Graph Convolution over Pruned Dependency Trees I...	2018-09-26	Code
46	C-SGC	67	No	Simplifying Graph Convolutional Networks	2019-02-19	Code
47	C-GCN	66.4	No	Graph Convolution over Pruned Dependency Trees I...	2018-09-26	Code
48	C-GCN	66.4	No	Graph Convolution over Pruned Dependency Trees I...	2018-09-26	Code
49	BERT	66	No	ERNIE: Enhanced Language Representation with Inf...	2019-05-17	Code
50	PA-LSTM	65.1	No	-	-	Code
51	AGGCN	65.1	No	Attention Guided Graph Convolutional Networks fo...	2019-06-18	Code
52	GCN	64	No	Graph Convolution over Pruned Dependency Trees I...	2018-09-26	Code
53	TANL (multi-task)	61.9	No	Structured Prediction as Translation between Aug...	2021-01-14	Code
54	LLM-QA4RE (XXLarge)	52.2	No	Aligning Instruction Tasks Unlocks Large Languag...	2023-05-18	Code
55	DeepEx (zero-shot top-1)	49.2	No	Zero-Shot Information Extraction as a Unified Te...	2021-09-23	Code
56	Deepstruct zero-shot	36.1	No	DeepStruct: Pretraining of Language Models for S...	2022-05-21	Code