TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Hypernyms under Siege: Linguistically-motivated Artillery ...

Hypernyms under Siege: Linguistically-motivated Artillery for Hypernymy Detection

Vered Shwartz, Enrico Santus, Dominik Schlechtweg

2016-12-14EACL 2017 4Hypernym Discovery
PaperPDFCode(official)

Abstract

The fundamental role of hypernymy in NLP has motivated the development of many methods for the automatic identification of this relation, most of which rely on word distribution. We investigate an extensive number of such unsupervised measures, using several distributional semantic models that differ by context type and feature weighting. We analyze the performance of the different methods based on their linguistic motivation. Comparison to the state-of-the-art supervised methods shows that while supervised methods generally outperform the unsupervised ones, the former are sensitive to the distribution of training instances, hurting their reliability. Being based on general linguistic hypotheses and independent from training data, unsupervised measures are more robust, and therefore are still useful artillery for hypernymy detection.

Results

TaskDatasetMetricValueModel
Hypernym DiscoveryGeneralMAP1.36balAPInc
Hypernym DiscoveryGeneralMRR3.18balAPInc
Hypernym DiscoveryGeneralP@51.3balAPInc
Hypernym DiscoveryMusic domainMAP1.95balAPInc
Hypernym DiscoveryMusic domainMRR5.01balAPInc
Hypernym DiscoveryMusic domainP@52.15balAPInc
Hypernym DiscoveryMedical domainMAP0.91balAPInc
Hypernym DiscoveryMedical domainMRR2.1balAPInc
Hypernym DiscoveryMedical domainP@51.08balAPInc
Taxonomy LearningGeneralMAP1.36balAPInc
Taxonomy LearningGeneralMRR3.18balAPInc
Taxonomy LearningGeneralP@51.3balAPInc
Taxonomy LearningMusic domainMAP1.95balAPInc
Taxonomy LearningMusic domainMRR5.01balAPInc
Taxonomy LearningMusic domainP@52.15balAPInc
Taxonomy LearningMedical domainMAP0.91balAPInc
Taxonomy LearningMedical domainMRR2.1balAPInc
Taxonomy LearningMedical domainP@51.08balAPInc

Related Papers

OntoTune: Ontology-Driven Self-training for Aligning Large Language Models2025-02-08TaxoLLaMA: WordNet-based Model for Solving Multiple Lexical Semantic Tasks2024-03-14Probing Pretrained Language Models with Hierarchy Properties2023-12-15Modelling Commonsense Properties using Pre-Trained Bi-Encoders2022-10-06HyperBox: A Supervised Approach for Hypernym Discovery using Box Embeddings2022-04-05CogALex 2.0: Impact of Data Quality on Lexical-Semantic Relation Prediction2021-12-14Analyzing BERT’s Knowledge of Hypernymy via Prompting2021-11-01Hypernym Discovery via a Recurrent Mapping Model2021-08-01