Named Entity Recognition (NER) on CoNLL 2003 (English)

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	ACE + document-context	94.6	No	Automated Concatenation of Embeddings for Struct...	2020-10-10	Code
2	LUKE 483M	94.3	No	LUKE: Deep Contextualized Entity Representations...	2020-10-02	Code
3	Co-regularized LUKE	94.22	No	Learning from Noisy Labels for Entity-Centric In...	2021-04-17	Code
4	LUKE + SubRegWeigh (K-means)	94.2	No	SubRegWeigh: Effective and Efficient Annotation ...	2024-09-10	Code
5	ASP+T5-3B	94.1	No	Autoregressive Structured Prediction with Langua...	2022-10-26	Code
6	FLERT XLM-R	94.09	Yes	FLERT: Document-Level Features for Named Entity ...	2020-11-13	Code
7	PL-Marker	94	No	Packed Levitated Marker for Entity and Relation ...	2021-09-13	Code
8	CL-KL	93.85	No	Improving Named Entity Recognition by External C...	2021-05-08	Code
9	XLNet-GCN	93.82	No	Named entity recognition architecture combining ...	2021-12-15	Code
10	RoBERTa + SubRegWeigh (K-means)	93.81	No	SubRegWeigh: Effective and Efficient Annotation ...	2024-09-10	Code
11	ASP+flan-T5-large	93.8	No	Autoregressive Structured Prediction with Langua...	2022-10-26	Code
12	InferNER	93.76	No	-	-	-
13	Cross-sentence context (First)	93.74	No	Exploring Cross-sentence Contexts for Named Enti...	2020-06-02	Code
14	XLM-RoBERTa-large union	93.69	No	Transformer-based Named Entity Recognition with ...	2024-06-25	-
15	Baseline + BS	93.65	No	Boundary Smoothing for Named Entity Recognition	2022-04-26	Code
16	ACE	93.64	No	Automated Concatenation of Embeddings for Struct...	2020-10-10	Code
17	BERT-CRF	93.6	No	Focusing on Potential Named Entities During Acti...	2021-11-06	Code
18	CNN Large + fine-tune	93.5	Yes	Cloze-driven Pretraining of Self-attention Netwo...	2019-03-19	-
19	Biaffine-NER	93.5	No	Named Entity Recognition as Dependency Parsing	2020-05-14	Code
20	GCDT + BERT-L	93.47	Yes	GCDT: A Global Context Enhanced Deep Transition ...	2019-06-06	Code
21	I-DARTS + Flair	93.47	Yes	-	-	Code
22	CrossWeigh + Pooled Flair	93.43	No	CrossWeigh: Training Named Entity Tagger from Im...	2019-09-03	Code
23	LSTM-CRF+ELMo+BERT+Flair	93.38	No	Neural Architectures for Nested NER through Line...	2019-08-19	Code
24	Hierarchical + BERT	93.37	No	Hierarchical Contextualized Representation for N...	2019-11-06	Code
25	BERT-CRF (Replicated in AdaSeq)	93.35	No	Improving Named Entity Recognition by External C...	2021-05-08	Code
26	BERT-MRC+DSC	93.33	Yes	Dice Loss for Data-imbalanced NLP Tasks	2019-11-07	Code
27	XLNet	93.28	No	Named entity recognition architecture combining ...	2021-12-15	Code
28	BARTNER	93.24	No	A Unified Generative Framework for Various NER S...	2021-06-02	Code
29	GoLLIE	93.1	Yes	GoLLIE: Annotation Guidelines improve Zero-Shot ...	2023-10-05	Code
30	Flair embeddings	93.09	Yes	-	-	Code
31	PromptNER [RoBERTa-large]	93.08	Yes	PromptNER: Prompt Locating and Typing for Named ...	2023-05-26	Code
32	W2NER	93.07	No	Unified Named Entity Recognition as Word-Word Re...	2021-12-19	Code
33	BERT-MRC	93.04	Yes	A Unified MRC Framework for Named Entity Recogni...	2019-10-25	Code
34	Locate and Label	92.94	No	Locate and Label: A Two-stage Identifier for Nes...	2021-05-14	Code
35	PIQN	92.87	No	Parallel Instance Query Network for Named Entity...	2022-03-20	Code
36	DiffusionNER	92.78	No	DiffusionNER: Boundary Diffusion for Named Entit...	2023-05-22	Code
37	HSCRF + softdict	92.75	Yes	-	-	Code
38	TENER	92.62	No	TENER: Adapting Transformer Encoder for Named En...	2019-11-10	Code
39	CVT + Multi-Task	92.61	Yes	Semi-Supervised Sequence Modeling with Cross-Vie...	2018-09-22	Code
40	CVT + Multi-Task + Large	92.61	No	Semi-Supervised Sequence Modeling with Cross-Vie...	2018-09-22	Code
41	Stack LSTM	92.43	No	Joint Learning of Named Entity Recognition and E...	2019-07-18	-
42	PromptNER [BERT-large]	92.41	No	PromptNER: Prompt Locating and Typing for Named ...	2023-05-26	Code
43	DGLSTM-CRF + ELMo (L=2) 3.0pt1-4.51.5	92.4	No	Dependency-Guided LSTM-CRF for Named Entity Reco...	2019-09-23	Code
44	GRN	92.34	No	GRN: Gated Relation Network to Enhance Convoluti...	2019-07-12	Code
45	Neural-CRF+AE	92.29	No	Evaluating the Utility of Hand-crafted Features ...	2018-08-28	Code
46	MGNER	92.28	No	Multi-Grained Named Entity Recognition	2019-06-20	Code
47	BiLSTM-CRF+ELMo	92.22	Yes	Deep contextualized word representations	2018-02-15	Code
48	SpanRel	92.2	No	Generalizing Natural Language Analysis through S...	2019-11-10	Code
49	LD-Net	92.03	No	Efficient Contextualized Representation: Languag...	2018-04-20	Code
50	GCDT	91.96	No	GCDT: A Global Context Enhanced Deep Transition ...	2019-06-06	Code
51	Hierarchical	91.96	No	Hierarchical Contextualized Representation for N...	2019-11-06	Code
52	CRF + AutoEncoder	91.87	No	Evaluating the Utility of Hand-crafted Features ...	2018-08-28	Code
53	PRISM	91.8	No	-	-	Code
54	GraphIE (GCN+BiLSTM)	91.74	No	-	-	-
55	Bi-LSTM-CRF + Lexical Features	91.73	No	Robust Lexical Features for Improved Neural Netw...	2018-06-09	Code
56	IntNet + BiLSTM-CRF	91.64	No	Learning Better Internal Structure of Words for ...	2018-10-29	-
57	Yang et al. ([2017a])	91.62	No	Neural Reranking for Named Entity Recognition	2017-07-17	Code
58	Bi-LSTM-CNN	91.62	No	Named Entity Recognition with Bidirectional LSTM...	2015-11-26	Code
59	S-LSTM	91.57	No	Sentence-State LSTM for Text Representation	2018-05-07	Code
60	LSTM with dynamic skip	91.56	No	Long Short-Term Memory with Dynamic Skip Connect...	2018-11-09	Code
61	Adversarial Bi-LSTM	91.56	No	Robust Multilingual Part-of-Speech Tagging via A...	2017-11-14	Code
62	HSCRF	91.38	No	Hybrid semi-Markov CRF for Neural Sequence Label...	2018-05-10	Code
63	IXA pipes	91.36	No	Robust Multilingual Named Entity Recognition wit...	2017-01-31	Code
64	NCRF++	91.35	No	NCRF++: An Open-source Neural Sequence Labeling ...	2018-06-14	Code
65	Yang et al.	91.26	No	Transfer Learning for Sequence Tagging with Hier...	2017-03-18	Code
66	LM-LSTM-CRF	91.24	No	Empower Sequence Labeling with Task-Aware Neural...	2017-09-13	Code
67	Bi-LSTM-CNN-CRF	91.22	No	-	-	Code
68	BLSTM-CNN-CRF	91.21	No	End-to-end Sequence Labeling via Bi-directional ...	2016-03-04	Code
69	Bi-LSTM + Logic rules	91.18	No	Harnessing Deep Neural Networks with Logic Rules	2016-03-21	Code
70	LSTM-CRF	90.94	No	Neural Architectures for Named Entity Recognition	2016-03-04	Code
71	GCN	88.63	No	Named entity recognition architecture combining ...	2021-12-15	Code
72	SWEM-CRF	86.28	No	Baseline Needs More Love: On Simple Word-Embeddi...	2018-05-24	Code
73	VSL-GG-Hier	84.7	No	Variational Sequential Labelers for Semi-Supervi...	2019-06-23	Code