Named Entity Recognition (NER) on ACE 2005

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	Ours: cross-sentence ALB	90.9	No	A Frustratingly Easy Approach for Entity and Rel...	2020-10-24	Code
2	GoLLIE	89.6	Yes	GoLLIE: Annotation Guidelines improve Zero-Shot ...	2023-10-05	Code
3	BINDER	89.5	No	Optimizing Bi-Encoder for Named Entity Recogniti...	2022-08-30	Code
4	Triaffine + ALBERT	88.83	No	Fusing Heterogeneous Factors with Triaffine Mech...	2021-10-14	Code
5	PromptNER [RoBERTa-large]	88.26	No	PromptNER: Prompt Locating and Typing for Named ...	2023-05-26	Code
6	PIQN	87.42	No	Parallel Instance Query Network for Named Entity...	2022-03-20	Code
7	PIQN	87.42	No	Parallel Instance Query Network for Named Entity...	2022-03-20	Code
8	CNN-NER	87.42	No	An Embarrassingly Easy but Strong Baseline for N...	2022-08-09	Code
9	PromptNER [BERT-large]	87.21	No	PromptNER: Prompt Locating and Typing for Named ...	2023-05-26	Code
10	Baseline + BS	87.15	No	Boundary Smoothing for Named Entity Recognition	2022-04-26	Code
11	Sequence-to-Set	87.05	No	A Sequence-to-Set Network for Nested Named Entit...	2021-05-19	Code
12	DiffusionNER	86.93	No	DiffusionNER: Boundary Diffusion for Named Entit...	2023-05-22	Code
13	BERT-MRC	86.88	Yes	A Unified MRC Framework for Named Entity Recogni...	2019-10-25	Code
14	Triaffine + BERT	86.82	No	Fusing Heterogeneous Factors with Triaffine Mech...	2021-10-14	Code
15	W2NER	86.79	No	Unified Named Entity Recognition as Word-Word Re...	2021-12-19	Code
16	UniNER-7B	86.69	No	UniversalNER: Targeted Distillation from Large L...	2023-08-07	Code
17	Locate and Label	86.67	No	Locate and Label: A Two-stage Identifier for Nes...	2021-05-14	Code
18	Locate and Label	86.67	No	Locate and Label: A Two-stage Identifier for Nes...	2021-05-14	Code
19	Hashing	85.9	No	To be Continuous, or to be Discrete, Those are B...	2024-06-12	Code
20	BoningKnife	85.46	No	BoningKnife: Joint Entity Mention Detection and ...	2021-07-20	-
21	BoningKnife	85.46	No	BoningKnife: Joint Entity Mention Detection and ...	2021-07-20	-
22	Biaffine-NER	85.4	No	Named Entity Recognition as Dependency Parsing	2020-05-14	Code
23	PO-TreeCRFs	85.4	No	Nested Named Entity Recognition with Partially-O...	2020-12-15	Code
24	LogSumExpDecoder	84.93	No	-	-	Code
25	BARTNER	84.74	No	A Unified Generative Framework for Various NER S...	2021-06-02	Code
26	Second-best learning and decoding	84.34	No	Nested Named Entity Recognition via Second-best ...	2019-09-05	Code
27	Second-best learning and decoding + BERT + Flair	84.34	Yes	Nested Named Entity Recognition via Second-best ...	2019-09-05	Code
28	seq2seq+BERT+Flair	84.33	No	Neural Architectures for Nested NER through Line...	2019-08-19	Code
29	seq2seq+BERT+Flair	84.33	No	Neural Architectures for Nested NER through Line...	2019-08-19	Code
30	Second-best learning and decoding + BERT	83.99	Yes	Nested Named Entity Recognition via Second-best ...	2019-09-05	Code
31	Merge and Label	82.4	No	Merge and Label: A novel neural network architec...	2019-06-30	Code
32	Merge and Label	82.4	Yes	Merge and Label: A novel neural network architec...	2019-06-30	Code
33	MGNER	78.2	No	Multi-Grained Named Entity Recognition	2019-06-20	Code
34	MGNER	78.2	Yes	Multi-Grained Named Entity Recognition	2019-06-20	Code
35	Second-best learning and decoding	76.83	No	Nested Named Entity Recognition via Second-best ...	2019-09-05	Code
36	Anchor-Region Networks	75.9	No	Sequence-to-Nuggets: Nested Entity Mention Detec...	2019-06-10	Code
37	BiFlaG	75.1	No	Bipartite Flat-Graph Network for Nested Named En...	2020-05-01	Code
38	BiFlaG	75.1	No	Bipartite Flat-Graph Network for Nested Named En...	2020-05-01	Code
39	Anchor-Region Networks	74.9	No	Sequence-to-Nuggets: Nested Entity Mention Detec...	2019-06-10	Code
40	Neural segmental hypergraphs	74.5	No	Neural Segmental Hypergraphs for Overlapping Men...	2018-10-03	Code
41	Neural segmental hypergraphs	74.5	No	Neural Segmental Hypergraphs for Overlapping Men...	2018-10-03	Code
42	Neural transition-based model	73	No	A Neural Transition-based Model for Nested Menti...	2018-10-03	Code
43	neural transition-based model	73	No	A Neural Transition-based Model for Nested Menti...	2018-10-03	Code
44	Neural layered model	72.2	No	-	-	Code
45	Neural layered model	72.2	No	-	-	Code

#1Ours: cross-sentence ALBSOTA
90.9
F1· 2020-10-24
A Frustratingly Easy Approach for Entity and Relation Extraction Code
#2GoLLIE
89.6
F1· Extra Data· 2023-10-05
GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction Code
#3BINDER
89.5
F1· 2022-08-30
Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learning Code
#4Triaffine + ALBERT
88.83
F1· 2021-10-14
Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognition Code
#5PromptNER [RoBERTa-large]
88.26
F1· 2023-05-26
PromptNER: Prompt Locating and Typing for Named Entity Recognition Code
#6PIQN
87.42
F1· 2022-03-20
Parallel Instance Query Network for Named Entity Recognition Code
#7PIQN
87.42
F1· 2022-03-20
Parallel Instance Query Network for Named Entity Recognition Code
#8CNN-NER
87.42
F1· 2022-08-09
An Embarrassingly Easy but Strong Baseline for Nested Named Entity Recognition Code
#9PromptNER [BERT-large]
87.21
F1· 2023-05-26
PromptNER: Prompt Locating and Typing for Named Entity Recognition Code
#10Baseline + BS
87.15
F1· 2022-04-26
Boundary Smoothing for Named Entity Recognition Code
#11Sequence-to-Set
87.05
F1· 2021-05-19
A Sequence-to-Set Network for Nested Named Entity Recognition Code
#12DiffusionNER
86.93
F1· 2023-05-22
DiffusionNER: Boundary Diffusion for Named Entity Recognition Code
#13BERT-MRCSOTA
86.88
F1· Extra Data· 2019-10-25
A Unified MRC Framework for Named Entity Recognition Code
#14Triaffine + BERT
86.82
F1· 2021-10-14
Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognition Code
#15W2NER
86.79
F1· 2021-12-19
Unified Named Entity Recognition as Word-Word Relation Classification Code
#16UniNER-7B
86.69
F1· 2023-08-07
UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition Code
#17Locate and Label
86.67
F1· 2021-05-14
Locate and Label: A Two-stage Identifier for Nested Named Entity Recognition Code
#18Locate and Label
86.67
F1· 2021-05-14
Locate and Label: A Two-stage Identifier for Nested Named Entity Recognition Code
#19Hashing
85.9
F1· 2024-06-12
To be Continuous, or to be Discrete, Those are Bits of Questions Code
#20BoningKnife
85.46
F1· 2021-07-20
BoningKnife: Joint Entity Mention Detection and Typing for Nested NER via prior Boundary Knowledge
#21BoningKnife
85.46
F1· 2021-07-20
BoningKnife: Joint Entity Mention Detection and Typing for Nested NER via prior Boundary Knowledge
#22Biaffine-NER
85.4
F1· 2020-05-14
Named Entity Recognition as Dependency Parsing Code
#23PO-TreeCRFs
85.4
F1· 2020-12-15
Nested Named Entity Recognition with Partially-Observed TreeCRFs Code
#24LogSumExpDecoder
84.93
F1
No paperCode
#25BARTNER
84.74
F1· 2021-06-02
A Unified Generative Framework for Various NER Subtasks Code
#26Second-best learning and decodingSOTA
84.34
F1· 2019-09-05
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding Code
#27Second-best learning and decoding + BERT + Flair
84.34
F1· Extra Data· 2019-09-05
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding Code
#28seq2seq+BERT+FlairSOTA
84.33
F1· 2019-08-19
Neural Architectures for Nested NER through Linearization Code
#29seq2seq+BERT+Flair
84.33
F1· 2019-08-19
Neural Architectures for Nested NER through Linearization Code
#30Second-best learning and decoding + BERT
83.99
F1· Extra Data· 2019-09-05
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding Code
#31Merge and LabelSOTA
82.4
F1· 2019-06-30
Merge and Label: A novel neural network architecture for nested NER Code
#32Merge and Label
82.4
F1· Extra Data· 2019-06-30
Merge and Label: A novel neural network architecture for nested NER Code
#33MGNERSOTA
78.2
F1· 2019-06-20
Multi-Grained Named Entity Recognition Code
#34MGNER
78.2
F1· Extra Data· 2019-06-20
Multi-Grained Named Entity Recognition Code
#35Second-best learning and decoding
76.83
F1· 2019-09-05
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding Code
#36Anchor-Region NetworksSOTA
75.9
F1· 2019-06-10
Sequence-to-Nuggets: Nested Entity Mention Detection via Anchor-Region Networks Code
#37BiFlaG
75.1
F1· 2020-05-01
Bipartite Flat-Graph Network for Nested Named Entity Recognition Code
#38BiFlaG
75.1
F1· 2020-05-01
Bipartite Flat-Graph Network for Nested Named Entity Recognition Code
#39Anchor-Region Networks
74.9
F1· 2019-06-10
Sequence-to-Nuggets: Nested Entity Mention Detection via Anchor-Region Networks Code
#40Neural segmental hypergraphsSOTA
74.5
F1· 2018-10-03
Neural Segmental Hypergraphs for Overlapping Mention Recognition Code
#41Neural segmental hypergraphs
74.5
F1· 2018-10-03
Neural Segmental Hypergraphs for Overlapping Mention Recognition Code
#42Neural transition-based model
73
F1· 2018-10-03
A Neural Transition-based Model for Nested Mention Recognition Code
#43neural transition-based model
73
F1· 2018-10-03
A Neural Transition-based Model for Nested Mention Recognition Code
#44Neural layered model
72.2
F1
No paperCode
#45Neural layered model
72.2
F1
No paperCode