TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Ensembling Graph Predictions for AMR Parsing

Ensembling Graph Predictions for AMR Parsing

Hoang Thanh Lam, Gabriele Picco, Yufang Hou, Young-suk Lee, Lam M. Nguyen, Dzung T. Phan, Vanessa López, Ramon Fernandez Astudillo

2021-10-18NeurIPS 2021 12AMR Parsing
PaperPDFCode(official)

Abstract

In many machine learning tasks, models are trained to predict structure data such as graphs. For example, in natural language processing, it is very common to parse texts into dependency trees or abstract meaning representation (AMR) graphs. On the other hand, ensemble methods combine predictions from multiple models to create a new one that is more robust and accurate than individual predictions. In the literature, there are many ensembling techniques proposed for classification or regression problems, however, ensemble graph prediction has not been studied thoroughly. In this work, we formalize this problem as mining the largest graph that is the most supported by a collection of graph predictions. As the problem is NP-Hard, we propose an efficient heuristic algorithm to approximate the optimal solution. To validate our approach, we carried out experiments in AMR parsing problems. The experimental results demonstrate that the proposed approach can combine the strength of state-of-the-art AMR parsers to create new predictions that are more accurate than any individual models in five standard benchmark datasets.

Results

TaskDatasetMetricValueModel
Semantic ParsingThe Little PrinceSmatch79.52Graphene Smatch
Semantic ParsingLDC2017T10Smatch86.26Graphene Smatch (IBM)
Semantic ParsingLDC2017T10Smatch85.85Graphene Support (IBM)
Semantic ParsingLDC2020T02Smatch84.87Graphene Smatch (IBM)
Semantic ParsingLDC2020T02Smatch84.41Graphene Support (IBM)
Semantic ParsingNew3Smatch76.32Graphene Smatch
Semantic ParsingBioSmatch62.8Graphene Smatch
AMR ParsingThe Little PrinceSmatch79.52Graphene Smatch
AMR ParsingLDC2017T10Smatch86.26Graphene Smatch (IBM)
AMR ParsingLDC2017T10Smatch85.85Graphene Support (IBM)
AMR ParsingLDC2020T02Smatch84.87Graphene Smatch (IBM)
AMR ParsingLDC2020T02Smatch84.41Graphene Support (IBM)
AMR ParsingNew3Smatch76.32Graphene Smatch
AMR ParsingBioSmatch62.8Graphene Smatch

Related Papers

Reassessing Graph Linearization for Sequence-to-sequence AMR Parsing: On the Advantages and Limitations of Triple-Based Encoding2025-05-13Should Cross-Lingual AMR Parsing go Meta? An Empirical Assessment of Meta-Learning and Joint Learning AMR Parsing2024-10-04Adapting Abstract Meaning Representation Parsing to the Clinical Narrative -- the SPRING THYME parser2024-05-15AMR Parsing is Far from Solved: GrAPES, the Granular AMR Parsing Evaluation Suite2023-12-06AMR Parsing with Causal Hierarchical Attention and Pointers2023-10-18Guiding AMR Parsing with Reverse Graph Linearization2023-10-13Incorporating Graph Information in Transformer-based AMR Parsing2023-06-23AMRs Assemble! Learning to Ensemble with Autoregressive Models for AMR Parsing2023-06-19