Entity Typing on Open Entity

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	MLMET	78.2	No	LUKE: Deep Contextualized Entity Representations...	2020-10-02	Code
2	MCCE-B (replicated by Adaseq)	52.1	No	Recall, Expand and Multi-Candidate Cross-Encode:...	2022-12-18	Code
3	Prompt + NPCRF (replicated by Adaseq)	50.1	No	Modeling Label Correlations for Ultra-Fine Entit...	2022-12-03	Code
4	UniST-Large	49.9	No	Unified Semantic Typing with Meaningful Label In...	2022-05-04	Code
5	Prompt Learning (replicated by Adaseq)）	49.3	No	Modeling Label Correlations for Ultra-Fine Entit...	2022-12-03	Code
6	MLMET	49.1	No	Ultra-Fine Entity Typing with Weak Supervision f...	2021-06-08	Code
7	RoBERTa-Large + NPCRF (replicated by Adaseq)	47.3	No	Modeling Label Correlations for Ultra-Fine Entit...	2022-12-03	Code
8	LRN	45.4	No	Fine-grained Entity Typing via Label Reasoning	2021-09-13	-
9	Box4Type	44.8	No	Modeling Fine-Grained Entity Types with Box Embe...	2021-01-02	Code
10	RoBERTa-Large (replicated by Adaseq)	43.8	No	Modeling Label Correlations for Ultra-Fine Entit...	2022-12-03	Code
11	LDET	40.1	No	Learning to Denoise Distantly-Labeled Data for E...	2019-05-04	Code
12	LabelGCN	36.9	No	Imposing Label-Relational Inductive Bias for Ext...	2019-03-06	Code
13	UFET-biLSTM	31.3	No	Ultra-Fine Entity Typing	2018-07-13	Code

#1MLMETSOTA
78.2
F1· 2020-10-02
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Code
#2MCCE-B (replicated by Adaseq)
52.1
F1· 2022-12-18
Recall, Expand and Multi-Candidate Cross-Encode: Fast and Accurate Ultra-Fine Entity Typing Code
#3Prompt + NPCRF (replicated by Adaseq)
50.1
F1· 2022-12-03
Modeling Label Correlations for Ultra-Fine Entity Typing with Neural Pairwise Conditional Random Field Code
#4UniST-Large
49.9
F1· 2022-05-04
Unified Semantic Typing with Meaningful Label Inference Code
#5Prompt Learning (replicated by Adaseq)）
49.3
F1· 2022-12-03
Modeling Label Correlations for Ultra-Fine Entity Typing with Neural Pairwise Conditional Random Field Code
#6MLMET
49.1
F1· 2021-06-08
Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model Code
#7RoBERTa-Large + NPCRF (replicated by Adaseq)
47.3
F1· 2022-12-03
Modeling Label Correlations for Ultra-Fine Entity Typing with Neural Pairwise Conditional Random Field Code
#8LRN
45.4
F1· 2021-09-13
Fine-grained Entity Typing via Label Reasoning
#9Box4Type
44.8
F1· 2021-01-02
Modeling Fine-Grained Entity Types with Box Embeddings Code
#10RoBERTa-Large (replicated by Adaseq)
43.8
F1· 2022-12-03
Modeling Label Correlations for Ultra-Fine Entity Typing with Neural Pairwise Conditional Random Field Code
#11LDETSOTA
40.1
F1· 2019-05-04
Learning to Denoise Distantly-Labeled Data for Entity Typing Code
#12LabelGCNSOTA
36.9
F1· 2019-03-06
Imposing Label-Relational Inductive Bias for Extremely Fine-Grained Entity Typing Code
#13UFET-biLSTMSOTA
31.3
F1· 2018-07-13
Ultra-Fine Entity Typing Code