Word Sense Disambiguation on WiC-TSV

Metric: Task 3 Accuracy: general purpose (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Task 3 Accuracy: general purpose▼	Extra Data	Paper	Date↕	Code
1	Human	82.1	No	WiC-TSV: An Evaluation Benchmark for Target Sens...	2020-04-30	Code
2	transformers	77	No	-	-	-
3	Bert-base	73.5	No	WiC-TSV: An Evaluation Benchmark for Target Sens...	2020-04-30	Code
4	CTLR	72.1	No	-	-	-
5	FastText	57.1	No	WiC-TSV: An Evaluation Benchmark for Target Sens...	2020-04-30	Code
6	Unsupervised Bert	54.4	No	WiC-TSV: An Evaluation Benchmark for Target Sens...	2020-04-30	Code
7	All true	53.8	No	WiC-TSV: An Evaluation Benchmark for Target Sens...	2020-04-30	Code

#1HumanSOTA
82.1
Task 3 Accuracy: general purpose· 2020-04-30
WiC-TSV: An Evaluation Benchmark for Target Sense Verification of Words in Context Code
#2transformers
77
Task 3 Accuracy: general purpose
No paper
#3Bert-base
73.5
Task 3 Accuracy: general purpose· 2020-04-30
WiC-TSV: An Evaluation Benchmark for Target Sense Verification of Words in Context Code
#4CTLR
72.1
Task 3 Accuracy: general purpose
No paper
#5FastText
57.1
Task 3 Accuracy: general purpose· 2020-04-30
WiC-TSV: An Evaluation Benchmark for Target Sense Verification of Words in Context Code
#6Unsupervised Bert
54.4
Task 3 Accuracy: general purpose· 2020-04-30
WiC-TSV: An Evaluation Benchmark for Target Sense Verification of Words in Context Code
#7All true
53.8
Task 3 Accuracy: general purpose· 2020-04-30
WiC-TSV: An Evaluation Benchmark for Target Sense Verification of Words in Context Code