Named Entity Recognition (NER) on GENIA

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	PIQN	81.77	No	Parallel Instance Query Network for Named Entity...	2022-03-20	Code
2	DiffusionNER	81.53	No	DiffusionNER: Boundary Diffusion for Named Entit...	2023-05-22	Code
3	CNN-NER	81.4	No	An Embarrassingly Easy but Strong Baseline for N...	2022-08-09	Code
4	W2NER	81.39	No	Unified Named Entity Recognition as Word-Word Re...	2021-12-19	Code
5	Triaffine + BioBERT	81.23	No	Fusing Heterogeneous Factors with Triaffine Mech...	2021-10-14	Code
6	DeepStruct multi-task w/ finetune	80.8	No	DeepStruct: Pretraining of Language Models for S...	2022-05-21	Code
7	Locate and Label	80.54	No	Locate and Label: A Two-stage Identifier for Nes...	2021-05-14	Code
8	Hashing	80.54	No	To be Continuous, or to be Discrete, Those are B...	2024-06-12	Code
9	Biaffine-NER	80.5	No	Named Entity Recognition as Dependency Parsing	2020-05-14	Code
10	BINDER	80.5	No	Optimizing Bi-Encoder for Named Entity Recogniti...	2022-08-30	Code
11	Sequence-to-Set	80.44	No	A Sequence-to-Set Network for Nested Named Entit...	2021-05-19	Code
12	DeepStruct multi-task	80.2	No	DeepStruct: Pretraining of Language Models for S...	2022-05-21	Code
13	BioBART	79.93	No	BioBART: Pretraining and Evaluation of A Biomedi...	2022-04-08	Code
14	BARTNER	79.23	No	A Unified Generative Framework for Various NER S...	2021-06-02	Code
15	Pyramid + BERT	79.19	Yes	-	-	Code
16	LogSumExpDecoder	78.93	No	-	-	Code
17	seq2seq+BERT+Flair	78.31	No	Neural Architectures for Nested NER through Line...	2019-08-19	Code
18	seq2seq+BERT+Flair	78.31	No	Neural Architectures for Nested NER through Line...	2019-08-19	Code
19	SpanModel + SequenceLabelingModel	78.3	No	Comparing and combining some popular NER approac...	2023-05-30	Code
20	PO-TreeCRFs	78.2	No	Nested Named Entity Recognition with Partially-O...	2020-12-15	Code
21	Pyramid	77.78	No	-	-	Code
22	UniNER-7B	77.54	No	UniversalNER: Targeted Distillation from Large L...	2023-08-07	Code
23	Second-best learning and decoding + BERT + Flair	77.36	No	Nested Named Entity Recognition via Second-best ...	2019-09-05	Code
24	Second-best learning and decoding + BERT + Flair	77.36	Yes	Nested Named Entity Recognition via Second-best ...	2019-09-05	Code
25	Second-best learning and decoding	77.19	No	Nested Named Entity Recognition via Second-best ...	2019-09-05	Code
26	Second-best learning and decoding	77.19	No	Nested Named Entity Recognition via Second-best ...	2019-09-05	Code
27	Second-best learning and decoding + BERT	77.05	Yes	Nested Named Entity Recognition via Second-best ...	2019-09-05	Code
28	BiFlaG	76	No	Bipartite Flat-Graph Network for Nested Named En...	2020-05-01	Code
29	BiFlaG	76	No	Bipartite Flat-Graph Network for Nested Named En...	2020-05-01	Code
30	Neural segmental hypergraphs	75.1	No	Neural Segmental Hypergraphs for Overlapping Men...	2018-10-03	Code
31	Neural segmental hypergraphs	75.1	No	Neural Segmental Hypergraphs for Overlapping Men...	2018-10-03	Code
32	Anchor-Region Networks	74.8	No	Sequence-to-Nuggets: Nested Entity Mention Detec...	2019-06-10	Code
33	Anchor-Region Networks	74.8	No	Sequence-to-Nuggets: Nested Entity Mention Detec...	2019-06-10	Code
34	Neural layered model	74.7	No	-	-	Code
35	Boundary-aware neural model	74.7	No	-	-	Code
36	Neural layered model	74.7	No	-	-	Code
37	Boundary-aware neural model	74.7	No	-	-	Code
38	Neural transition-based model	73.9	No	A Neural Transition-based Model for Nested Menti...	2018-10-03	Code
39	Neural transition-based model	73.9	No	A Neural Transition-based Model for Nested Menti...	2018-10-03	Code
40	Deepstruct zero-shot	47.2	No	DeepStruct: Pretraining of Language Models for S...	2022-05-21	Code

#1PIQNSOTA
81.77
F1· 2022-03-20
Parallel Instance Query Network for Named Entity Recognition Code
#2DiffusionNER
81.53
F1· 2023-05-22
DiffusionNER: Boundary Diffusion for Named Entity Recognition Code
#3CNN-NER
81.4
F1· 2022-08-09
An Embarrassingly Easy but Strong Baseline for Nested Named Entity Recognition Code
#4W2NERSOTA
81.39
F1· 2021-12-19
Unified Named Entity Recognition as Word-Word Relation Classification Code
#5Triaffine + BioBERTSOTA
81.23
F1· 2021-10-14
Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognition Code
#6DeepStruct multi-task w/ finetune
80.8
F1· 2022-05-21
DeepStruct: Pretraining of Language Models for Structure Prediction Code
#7Locate and LabelSOTA
80.54
F1· 2021-05-14
Locate and Label: A Two-stage Identifier for Nested Named Entity Recognition Code
#8Hashing
80.54
F1· 2024-06-12
To be Continuous, or to be Discrete, Those are Bits of Questions Code
#9Biaffine-NERSOTA
80.5
F1· 2020-05-14
Named Entity Recognition as Dependency Parsing Code
#10BINDER
80.5
F1· 2022-08-30
Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learning Code
#11Sequence-to-Set
80.44
F1· 2021-05-19
A Sequence-to-Set Network for Nested Named Entity Recognition Code
#12DeepStruct multi-task
80.2
F1· 2022-05-21
DeepStruct: Pretraining of Language Models for Structure Prediction Code
#13BioBART
79.93
F1· 2022-04-08
BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model Code
#14BARTNER
79.23
F1· 2021-06-02
A Unified Generative Framework for Various NER Subtasks Code
#15Pyramid + BERT
79.19
F1· Extra Data
No paperCode
#16LogSumExpDecoder
78.93
F1
No paperCode
#17seq2seq+BERT+FlairSOTA
78.31
F1· 2019-08-19
Neural Architectures for Nested NER through Linearization Code
#18seq2seq+BERT+Flair
78.31
F1· 2019-08-19
Neural Architectures for Nested NER through Linearization Code
#19SpanModel + SequenceLabelingModel
78.3
F1· 2023-05-30
Comparing and combining some popular NER approaches on Biomedical tasks Code
#20PO-TreeCRFs
78.2
F1· 2020-12-15
Nested Named Entity Recognition with Partially-Observed TreeCRFs Code
#21Pyramid
77.78
F1
No paperCode
#22UniNER-7B
77.54
F1· 2023-08-07
UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition Code
#23Second-best learning and decoding + BERT + Flair
77.36
F1· 2019-09-05
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding Code
#24Second-best learning and decoding + BERT + Flair
77.36
F1· Extra Data· 2019-09-05
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding Code
#25Second-best learning and decoding
77.19
F1· 2019-09-05
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding Code
#26Second-best learning and decoding
77.19
F1· 2019-09-05
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding Code
#27Second-best learning and decoding + BERT
77.05
F1· Extra Data· 2019-09-05
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding Code
#28BiFlaG
76
F1· 2020-05-01
Bipartite Flat-Graph Network for Nested Named Entity Recognition Code
#29BiFlaG
76
F1· 2020-05-01
Bipartite Flat-Graph Network for Nested Named Entity Recognition Code
#30Neural segmental hypergraphsSOTA
75.1
F1· 2018-10-03
Neural Segmental Hypergraphs for Overlapping Mention Recognition Code
#31Neural segmental hypergraphs
75.1
F1· 2018-10-03
Neural Segmental Hypergraphs for Overlapping Mention Recognition Code
#32Anchor-Region Networks
74.8
F1· 2019-06-10
Sequence-to-Nuggets: Nested Entity Mention Detection via Anchor-Region Networks Code
#33Anchor-Region Networks
74.8
F1· 2019-06-10
Sequence-to-Nuggets: Nested Entity Mention Detection via Anchor-Region Networks Code
#34Neural layered model
74.7
F1
No paperCode
#35Boundary-aware neural model
74.7
F1
No paperCode
#36Neural layered model
74.7
F1
No paperCode
#37Boundary-aware neural model
74.7
F1
No paperCode
#38Neural transition-based model
73.9
F1· 2018-10-03
A Neural Transition-based Model for Nested Mention Recognition Code
#39Neural transition-based model
73.9
F1· 2018-10-03
A Neural Transition-based Model for Nested Mention Recognition Code
#40Deepstruct zero-shot
47.2
F1· 2022-05-21
DeepStruct: Pretraining of Language Models for Structure Prediction Code