Named Entity Recognition (NER) on NCBI-disease

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	BioBERT	89.71	No	BioBERT: a pre-trained biomedical language repre...	2019-01-25	Code
2	SpanModel + SequenceLabelingModel	89.6	No	Comparing and combining some popular NER approac...	2023-05-30	Code
3	SciFive-Base	89.39	No	SciFive: a text-to-text transformer model for bi...	2021-05-28	Code
4	BLSTM-CNN-Char (SparkNLP)	89.13	No	Biomedical Named Entity Recognition at Scale	2020-11-12	Code
5	Spark NLP	89.13	No	Biomedical Named Entity Recognition at Scale	2020-11-12	Code
6	KeBioLM	89.1	No	Improving Biomedical Pretrained Language Models ...	2021-04-21	Code
7	CL-KL	88.96	No	Improving Named Entity Recognition by External C...	2021-05-08	Code
8	BioKMNER + BioBERT	88.77	No	-	-	Code
9	BioLinkBERT (large)	88.76	No	LinkBERT: Pretraining Language Models with Docum...	2022-03-29	Code
10	CompactBioBERT	88.67	No	On the Effectiveness of Compact Biomedical Trans...	2022-09-07	Code
11	STM	88.6	No	Learning A Unified Named Entity Tagger From Mult...	2019-09-25	Code
12	BERN2	88.6	No	BERN2: an advanced neural biomedical named entit...	2022-01-06	Code
13	BERN	88.3	No	-	-	Code
14	DistilBioBERT	87.93	No	On the Effectiveness of Compact Biomedical Trans...	2022-09-07	Code
15	RDANER	87.89	Yes	A Robust and Domain-Adaptive Approach for Low-Re...	2021-01-02	Code
16	PubMedBERT uncased	87.82	No	Domain-Specific Language Model Pretraining for B...	2020-07-31	Code
17	BioMegatron BERT-cased	87.8	No	BioMegatron: Larger Biomedical Domain Language M...	2020-10-12	Code
18	BioDistilBERT	87.61	No	On the Effectiveness of Compact Biomedical Trans...	2022-09-07	Code
19	ELECTRAMed	87.54	Yes	ELECTRAMed: a new pre-trained language represent...	2021-04-19	Code
20	BioMobileBERT	87.21	No	On the Effectiveness of Compact Biomedical Trans...	2022-09-07	Code
21	SciBERT (Base Vocab)	86.88	Yes	SciBERT: A Pretrained Language Model for Scienti...	2019-03-26	Code
22	GoLLIE	86.5	Yes	GoLLIE: Annotation Guidelines improve Zero-Shot ...	2023-10-05	Code
23	SciBERT (SciVocab)	86.45	Yes	SciBERT: A Pretrained Language Model for Scienti...	2019-03-26	Code
24	BERT-CRF	84.5	No	Focusing on Potential Named Entities During Acti...	2021-11-06	Code
25	GPT-4	65.98	No	-	-	-
26	NuNER Zero Span	61.1	Yes	NuNER: Entity Recognition Encoder Pre-training v...	2024-02-23	Code

#1BioBERTSOTA
89.71
F1· 2019-01-25
BioBERT: a pre-trained biomedical language representation model for biomedical text mining Code
#2SpanModel + SequenceLabelingModel
89.6
F1· 2023-05-30
Comparing and combining some popular NER approaches on Biomedical tasks Code
#3SciFive-Base
89.39
F1· 2021-05-28
SciFive: a text-to-text transformer model for biomedical literature Code
#4BLSTM-CNN-Char (SparkNLP)
89.13
F1· 2020-11-12
Biomedical Named Entity Recognition at Scale Code
#5Spark NLP
89.13
F1· 2020-11-12
Biomedical Named Entity Recognition at Scale Code
#6KeBioLM
89.1
F1· 2021-04-21
Improving Biomedical Pretrained Language Models with Knowledge Code
#7CL-KL
88.96
F1· 2021-05-08
Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning Code
#8BioKMNER + BioBERT
88.77
F1
No paperCode
#9BioLinkBERT (large)
88.76
F1· 2022-03-29
LinkBERT: Pretraining Language Models with Document Links Code
#10CompactBioBERT
88.67
F1· 2022-09-07
On the Effectiveness of Compact Biomedical Transformers Code
#11STM
88.6
F1· 2019-09-25
Learning A Unified Named Entity Tagger From Multiple Partially Annotated Corpora For Efficient Adaptation Code
#12BERN2
88.6
F1· 2022-01-06
BERN2: an advanced neural biomedical named entity recognition and normalization tool Code
#13BERN
88.3
F1
No paperCode
#14DistilBioBERT
87.93
F1· 2022-09-07
On the Effectiveness of Compact Biomedical Transformers Code
#15RDANER
87.89
F1· Extra Data· 2021-01-02
A Robust and Domain-Adaptive Approach for Low-Resource Named Entity Recognition Code
#16PubMedBERT uncased
87.82
F1· 2020-07-31
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing Code
#17BioMegatron BERT-cased
87.8
F1· 2020-10-12
BioMegatron: Larger Biomedical Domain Language Model Code
#18BioDistilBERT
87.61
F1· 2022-09-07
On the Effectiveness of Compact Biomedical Transformers Code
#19ELECTRAMed
87.54
F1· Extra Data· 2021-04-19
ELECTRAMed: a new pre-trained language representation model for biomedical NLP Code
#20BioMobileBERT
87.21
F1· 2022-09-07
On the Effectiveness of Compact Biomedical Transformers Code
#21SciBERT (Base Vocab)
86.88
F1· Extra Data· 2019-03-26
SciBERT: A Pretrained Language Model for Scientific Text Code
#22GoLLIE
86.5
F1· Extra Data· 2023-10-05
GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction Code
#23SciBERT (SciVocab)
86.45
F1· Extra Data· 2019-03-26
SciBERT: A Pretrained Language Model for Scientific Text Code
#24BERT-CRF
84.5
F1· 2021-11-06
Focusing on Potential Named Entities During Active Label Acquisition Code
#25GPT-4
65.98
F1
No paper
#26NuNER Zero Span
61.1
F1· Extra Data· 2024-02-23
NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data Code