Named Entity Recognition (NER) on WNUT 2017

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	CL-KL	60.45	No	Improving Named Entity Recognition by External C...	2021-05-08	Code
2	RoBERTa + SubRegWeigh (K-means)	60.29	No	SubRegWeigh: Effective and Efficient Annotation ...	2024-09-10	Code
3	BERT-CRF (Replicated in AdaSeq)	59.69	No	Improving Named Entity Recognition by External C...	2021-05-08	Code
4	RoBERTa-BiLSTM-context	59.61	No	Supplementary Features of BiLSTM for Enhanced Se...	2023-05-31	Code
5	BERT + RegLER	58.9	No	Regularization for Long Named Entity Recognition	2021-04-15	Code
6	TNER -xlm-r-large	58.5	No	T-NER: An All-Round Python Library for Transform...	2022-09-09	Code
7	HGN	57.41	No	Hero-Gang Neural Model For Named Entity Recognit...	2022-05-15	Code
8	ASA + RoBERTa	57.3	No	Adversarial Self-Attention for Language Understa...	2022-06-25	Code
9	BERTweet	56.5	No	BERTweet: A pre-trained language model for Engli...	2020-05-20	Code
10	MINER	54.86	No	MINER: Improving Out-of-Vocabulary Named Entity ...	2022-04-09	Code
11	GoLLIE	54.3	Yes	GoLLIE: Annotation Guidelines improve Zero-Shot ...	2023-10-05	Code
12	Truecase	52.3	No	Robust Named Entity Recognition with Truecasing ...	2019-12-15	-
13	AESINER	50.68	No	Improving Named Entity Recognition with Attentiv...	2020-10-29	Code
14	InferNER	50.52	No	-	-	-
15	SA-NER	50.36	No	Named Entity Recognition for Social Media Texts ...	2020-10-29	Code
16	CrossWeigh + Pooled Flair	50.03	No	CrossWeigh: Training Named Entity Tagger from Im...	2019-09-03	Code
17	ASA + BERT-base	49.8	No	Adversarial Self-Attention for Language Understa...	2022-06-25	Code
18	Aguilar et al.	45.55	No	Modeling Noisiness to Recognize Named Entities u...	2019-06-10	-
19	NeuralCRF+SAC	44.77	No	-	-	Code
20	Cross-BiLSTM-CNN	42.85	No	Why Attention? Analyze BiLSTM Deficiency and Its...	2019-08-29	Code
21	BiLSTMCRFBP	42.3	No	Regularization for Long Named Entity Recognition	2021-04-15	Code
22	UH-RiTUAL	41.86	No	A Multi-task Approach for Named Entity Recogniti...	2019-06-10	Code
23	SpinningBytes	40.78	No	-	-	-

#1CL-KLSOTA
60.45
F1· 2021-05-08
Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning Code
#2RoBERTa + SubRegWeigh (K-means)
60.29
F1· 2024-09-10
SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization Code
#3BERT-CRF (Replicated in AdaSeq)
59.69
F1· 2021-05-08
Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning Code
#4RoBERTa-BiLSTM-context
59.61
F1· 2023-05-31
Supplementary Features of BiLSTM for Enhanced Sequence Labeling Code
#5BERT + RegLERSOTA
58.9
F1· 2021-04-15
Regularization for Long Named Entity Recognition Code
#6TNER -xlm-r-large
58.5
F1· 2022-09-09
T-NER: An All-Round Python Library for Transformer-based Named Entity Recognition Code
#7HGN
57.41
F1· 2022-05-15
Hero-Gang Neural Model For Named Entity Recognition Code
#8ASA + RoBERTa
57.3
F1· 2022-06-25
Adversarial Self-Attention for Language Understanding Code
#9BERTweetSOTA
56.5
F1· 2020-05-20
BERTweet: A pre-trained language model for English Tweets Code
#10MINER
54.86
F1· 2022-04-09
MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspective Code
#11GoLLIE
54.3
F1· Extra Data· 2023-10-05
GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction Code
#12TruecaseSOTA
52.3
F1· 2019-12-15
Robust Named Entity Recognition with Truecasing Pretraining
#13AESINER
50.68
F1· 2020-10-29
Improving Named Entity Recognition with Attentive Ensemble of Syntactic Information Code
#14InferNER
50.52
F1
No paper
#15SA-NER
50.36
F1· 2020-10-29
Named Entity Recognition for Social Media Texts with Semantic Augmentation Code
#16CrossWeigh + Pooled FlairSOTA
50.03
F1· 2019-09-03
CrossWeigh: Training Named Entity Tagger from Imperfect Annotations Code
#17ASA + BERT-base
49.8
F1· 2022-06-25
Adversarial Self-Attention for Language Understanding Code
#18Aguilar et al.SOTA
45.55
F1· 2019-06-10
Modeling Noisiness to Recognize Named Entities using Multitask Neural Networks on Social Media
#19NeuralCRF+SAC
44.77
F1
No paperCode
#20Cross-BiLSTM-CNN
42.85
F1· 2019-08-29
Why Attention? Analyze BiLSTM Deficiency and Its Remedies in the Case of NER Code
#21BiLSTMCRFBP
42.3
F1· 2021-04-15
Regularization for Long Named Entity Recognition Code
#22UH-RiTUAL
41.86
F1· 2019-06-10
A Multi-task Approach for Named Entity Recognition in Social Media Data Code
#23SpinningBytes
40.78
F1
No paper