Word Sense Disambiguation on Supervised:

Metric: SemEval 2007 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	SemEval 2007▼	Extra Data	Paper	Date↕	Code
1	SANDWiCH	80.9	No	SANDWiCH: Semantical Analysis of Neighbours for ...	2025-03-07	Code
2	ConSeC+WNGC	78.5	No	-	-	Code
3	ESR+WNGC	78.5	No	-	-	Code
4	ConSeC	77.4	No	-	-	Code
5	ESR	77	No	-	-	Code
6	ESCHER SemCor	76.3	No	-	-	Code
7	GlossGPT	76.2	No	-	-	Code
8	EWISER+WNGC	75.2	No	-	-	Code
9	BEM	74.5	No	-	-	-
10	SemCor+WNGC, hypernyms	73.4	No	Sense Vocabulary Compression through the Semanti...	2019-05-14	Code
11	SparseLMMS+WNGC	73	No	-	-	-
12	GlossBERT	72.5	No	GlossBERT: BERT for Word Sense Disambiguation wi...	2019-08-20	Code
13	EWISER	71	No	-	-	Code
14	ARES	71	No	-	-	-
15	SparseLMMS	68.8	No	-	-	-
16	BERT (linear projection)	68.1	No	Improved Word Sense Disambiguation Using Pre-Tra...	2019-10-01	Code
17	SemCor+WNGT, vocabulary reduced, ensemble	66.81	No	Improving the Coverage and the Generalization Ab...	2018-11-02	-
18	BERT (nearest neighbour)	63.3	No	Improved Word Sense Disambiguation Using Pre-Tra...	2019-10-01	Code
19	supWSD<sub>emb</sub>	63.1	No	-	-	-
20	ELMo	62.2	No	Deep contextualized word representations	2018-02-15	Code
21	context2vec	61.3	No	-	-	-
22	supWSD	60.2	No	-	-	-
23	MFS baseline	54.5	No	-	-	-

#1SANDWiCHSOTA
80.9
SemEval 2007· 2025-03-07
SANDWiCH: Semantical Analysis of Neighbours for Disambiguating Words in Context ad Hoc Code
#2ConSeC+WNGC
78.5
SemEval 2007
No paperCode
#3ESR+WNGC
78.5
SemEval 2007
No paperCode
#4ConSeC
77.4
SemEval 2007
No paperCode
#5ESR
77
SemEval 2007
No paperCode
#6ESCHER SemCor
76.3
SemEval 2007
No paperCode
#7GlossGPT
76.2
SemEval 2007
No paperCode
#8EWISER+WNGC
75.2
SemEval 2007
No paperCode
#9BEM
74.5
SemEval 2007
No paper
#10SemCor+WNGC, hypernymsSOTA
73.4
SemEval 2007· 2019-05-14
Sense Vocabulary Compression through the Semantic Knowledge of WordNet for Neural Word Sense Disambiguation Code
#11SparseLMMS+WNGC
73
SemEval 2007
No paper
#12GlossBERT
72.5
SemEval 2007· 2019-08-20
GlossBERT: BERT for Word Sense Disambiguation with Gloss Knowledge Code
#13EWISER
71
SemEval 2007
No paperCode
#14ARES
71
SemEval 2007
No paper
#15SparseLMMS
68.8
SemEval 2007
No paper
#16BERT (linear projection)
68.1
SemEval 2007· 2019-10-01
Improved Word Sense Disambiguation Using Pre-Trained Contextualized Word Representations Code
#17SemCor+WNGT, vocabulary reduced, ensembleSOTA
66.81
SemEval 2007· 2018-11-02
Improving the Coverage and the Generalization Ability of Neural Word Sense Disambiguation through Hypernymy and Hyponymy Relationships
#18BERT (nearest neighbour)
63.3
SemEval 2007· 2019-10-01
Improved Word Sense Disambiguation Using Pre-Trained Contextualized Word Representations Code
#19supWSD<sub>emb</sub>
63.1
SemEval 2007
No paper
#20ELMoSOTA
62.2
SemEval 2007· 2018-02-15
Deep contextualized word representations Code
#21context2vec
61.3
SemEval 2007
No paper
#22supWSD
60.2
SemEval 2007
No paper
#23MFS baseline
54.5
SemEval 2007
No paper