TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Natural Language Processing/Word Sense Disambiguation

Word Sense Disambiguation

41 benchmarks1035 papers

The task of Word Sense Disambiguation (WSD) consists of associating words in context with their most suitable entry in a pre-defined sense inventory. The de-facto sense inventory for English in WSD is WordNet.. For example, given the word “mouse” and the following sentence:

“A mouse consists of an object held in one's hand, with one or more buttons.”

we would assign “mouse” with its electronic device sense (the 4th sense in the WordNet sense inventory).

Benchmarks

Word Sense Disambiguation on Words in Context

Accuracy

Word Sense Disambiguation on Supervised:

Senseval 2Senseval 3SemEval 2013SemEval 2015SemEval 2007

Word Sense Disambiguation on RUSSE

Accuracy

Word Sense Disambiguation on SemEval 2013 Task 12

F1Unsupervised

Word Sense Disambiguation on SensEval 2

F1

Word Sense Disambiguation on SensEval 3 Task 1

F1

Word Sense Disambiguation on SemEval 2007 Task 7

F1Unsupervised

Word Sense Disambiguation on SemEval 2007 Task 17

F1

Word Sense Disambiguation on FEWS

F1 (Zero shot test)F1 (Fewshot Test)F1 (Zeroshot Dev)F1(FewShot Dev)

Word Sense Disambiguation on WiC-TSV

Task 1 Accuracy: allTask 1 Accuracy: general purposeTask 1 Accuracy: domain specificTask 3 Accuracy: allTask 3 Accuracy: general purposeTask 3 Accuracy: domain specificTask 2 Accuracy: allTask 2 Accuracy: general purposeTask 2 Accuracy: domain specific

Word Sense Disambiguation on BIG-bench (Anachronisms)

Accuracy

Word Sense Disambiguation on SemEval 2015 Task 13

F1

Word Sense Disambiguation on Knowledge-based:

AllSenseval 2Senseval 3SemEval 2007SemEval 2013SemEval 2015

Word Sense Disambiguation on SemEval 2010 WSI

F-ScoreV-MeasureAVG

Word Sense Disambiguation on SensEval 3 Lexical Sample

F1

Word Sense Disambiguation on SensEval 2 Lexical Sample

F1

Word Sense Disambiguation on TS50

Sequence Recovery %(All)