Named Entity Recognition (NER) on Ontonotes v5 (English)

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	BERT-MRC+DSC	92.07	Yes	Dice Loss for Data-imbalanced NLP Tasks	2019-11-07	Code
2	PL-Marker	91.9	No	Packed Levitated Marker for Entity and Relation ...	2021-09-13	Code
3	Baseline + BS	91.74	No	Boundary Smoothing for Named Entity Recognition	2022-04-26	Code
4	Biaffine-NER	91.3	No	Named Entity Recognition as Dependency Parsing	2020-05-14	Code
5	BERT-MRC	91.11	Yes	A Unified MRC Framework for Named Entity Recogni...	2019-10-25	Code
6	PIQN	90.96	No	Parallel Instance Query Network for Named Entity...	2022-03-20	Code
7	HGN	90.92	No	Hero-Gang Neural Model For Named Entity Recognit...	2022-05-15	Code
8	Syn-LSTM + BERT (wo doc-context)	90.85	No	Better Feature Integration for Named Entity Reco...	2021-04-12	Code
9	DiffusionNER	90.66	No	DiffusionNER: Boundary Diffusion for Named Entit...	2023-05-22	Code
10	W2NER	90.5	No	Unified Named Entity Recognition as Word-Word Re...	2021-12-19	Code
11	BARTNER	90.38	No	A Unified Generative Framework for Various NER S...	2021-06-02	Code
12	AESINER	90.32	No	Improving Named Entity Recognition with Attentiv...	2020-10-29	Code
13	Hierarchical + BERT	90.3	Yes	Hierarchical Contextualized Representation for N...	2019-11-06	Code
14	HSCRF + softdict	89.94	Yes	-	-	Code
15	DGLSTM-CRF + ELMo	89.88	Yes	Dependency-Guided LSTM-CRF for Named Entity Reco...	2019-09-23	Code
16	NuNER	89.1	No	NuNER: Entity Recognition Encoder Pre-training v...	2024-02-23	Code
17	Syn-LSTM (wo doc-context)	89.04	No	Better Feature Integration for Named Entity Reco...	2021-04-12	Code
18	CVT + Multi-Task + Large	88.81	No	Semi-Supervised Sequence Modeling with Cross-Vie...	2018-09-22	Code
19	DGLSTM-CRF (L=2)	88.52	No	Dependency-Guided LSTM-CRF for Named Entity Reco...	2019-09-23	Code
20	Att-BiLSTM-CNN	88.4	No	Why Attention? Analyze BiLSTM Deficiency and Its...	2019-08-29	Code
21	BiLSTM-LAN	88.16	No	Hierarchically-Refined Label Attention Network f...	2019-08-23	Code
22	Hierarchical	87.98	No	Hierarchical Contextualized Representation for N...	2019-11-06	Code
23	Bi-LSTM-CRF + Lexical Features	87.95	Yes	Robust Lexical Features for Improved Neural Netw...	2018-06-09	Code
24	GRN	87.67	No	GRN: Gated Relation Network to Enhance Convoluti...	2019-07-12	Code
25	BiLSTM-CRF	86.99	No	Fast and Accurate Entity Recognition with Iterat...	2017-02-07	Code
26	Iterated Dilated CNN	86.84	No	Fast and Accurate Entity Recognition with Iterat...	2017-02-07	Code
27	Chiu and Nichols (2016)	86.19	No	Named Entity Recognition with Bidirectional LSTM...	2015-11-26	Code
28	Joint Model	84.04	No	-	-	-

#1BERT-MRC+DSCSOTA
92.07
F1· Extra Data· 2019-11-07
Dice Loss for Data-imbalanced NLP Tasks Code
#2PL-Marker
91.9
F1· 2021-09-13
Packed Levitated Marker for Entity and Relation Extraction Code
#3Baseline + BS
91.74
F1· 2022-04-26
Boundary Smoothing for Named Entity Recognition Code
#4Biaffine-NER
91.3
F1· 2020-05-14
Named Entity Recognition as Dependency Parsing Code
#5BERT-MRCSOTA
91.11
F1· Extra Data· 2019-10-25
A Unified MRC Framework for Named Entity Recognition Code
#6PIQN
90.96
F1· 2022-03-20
Parallel Instance Query Network for Named Entity Recognition Code
#7HGN
90.92
F1· 2022-05-15
Hero-Gang Neural Model For Named Entity Recognition Code
#8Syn-LSTM + BERT (wo doc-context)
90.85
F1· 2021-04-12
Better Feature Integration for Named Entity Recognition Code
#9DiffusionNER
90.66
F1· 2023-05-22
DiffusionNER: Boundary Diffusion for Named Entity Recognition Code
#10W2NER
90.5
F1· 2021-12-19
Unified Named Entity Recognition as Word-Word Relation Classification Code
#11BARTNER
90.38
F1· 2021-06-02
A Unified Generative Framework for Various NER Subtasks Code
#12AESINER
90.32
F1· 2020-10-29
Improving Named Entity Recognition with Attentive Ensemble of Syntactic Information Code
#13Hierarchical + BERT
90.3
F1· Extra Data· 2019-11-06
Hierarchical Contextualized Representation for Named Entity Recognition Code
#14HSCRF + softdict
89.94
F1· Extra Data
No paperCode
#15DGLSTM-CRF + ELMoSOTA
89.88
F1· Extra Data· 2019-09-23
Dependency-Guided LSTM-CRF for Named Entity Recognition Code
#16NuNER
89.1
F1· 2024-02-23
NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data Code
#17Syn-LSTM (wo doc-context)
89.04
F1· 2021-04-12
Better Feature Integration for Named Entity Recognition Code
#18CVT + Multi-Task + LargeSOTA
88.81
F1· 2018-09-22
Semi-Supervised Sequence Modeling with Cross-View Training Code
#19DGLSTM-CRF (L=2)
88.52
F1· 2019-09-23
Dependency-Guided LSTM-CRF for Named Entity Recognition Code
#20Att-BiLSTM-CNN
88.4
F1· 2019-08-29
Why Attention? Analyze BiLSTM Deficiency and Its Remedies in the Case of NER Code
#21BiLSTM-LAN
88.16
F1· 2019-08-23
Hierarchically-Refined Label Attention Network for Sequence Labeling Code
#22Hierarchical
87.98
F1· 2019-11-06
Hierarchical Contextualized Representation for Named Entity Recognition Code
#23Bi-LSTM-CRF + Lexical FeaturesSOTA
87.95
F1· Extra Data· 2018-06-09
Robust Lexical Features for Improved Neural Network Named-Entity Recognition Code
#24GRN
87.67
F1· 2019-07-12
GRN: Gated Relation Network to Enhance Convolutional Neural Network for Named Entity Recognition Code
#25BiLSTM-CRFSOTA
86.99
F1· 2017-02-07
Fast and Accurate Entity Recognition with Iterated Dilated Convolutions Code
#26Iterated Dilated CNN
86.84
F1· 2017-02-07
Fast and Accurate Entity Recognition with Iterated Dilated Convolutions Code
#27Chiu and Nichols (2016)SOTA
86.19
F1· 2015-11-26
Named Entity Recognition with Bidirectional LSTM-CNNs Code
#28Joint Model
84.04
F1
No paper