The 2018 Shared Task on Extrinsic Parser Evaluation: On the Downstream Utility of English Universal Dependency Parsers
Murhaf Fares, Stephan Oepen, Lilja {\O}vrelid, Jari Bj{\"o}rne, Richard Johansson
Abstract
We summarize empirical results and tentative conclusions from the Second Extrinsic Parser Evaluation Initiative (EPE 2018). We review the basic task setup, downstream applications involved, and end-to-end results for seventeen participating teams. Based on in-depth quantitative and qualitative analysis, we correlate intrinsic evaluation results at different layers of morph-syntactic analysis with observed downstream behavior.
Related Papers
Overcoming Occlusions in the Wild: A Multi-Task Age Head Approach to Age Estimation2025-06-16diffDemorph: Extending Reference-Free Demorphing to Unseen Faces2025-05-20MorphGuard: Morph Specific Margin Loss for Enhancing Robustness to Face Morphing Attacks2025-05-15Seeing Cells Clearly: Evaluating Machine Vision Strategies for Microglia Centroid Detection in 3D Images2025-05-07ChatGPT Encounters Morphing Attack Detection: Zero-Shot MAD with Multi-Modal Large Language Models and General Vision Models2025-03-13GraphMorph: Tubular Structure Extraction by Morphing Predicted Graphs2025-02-17MorphNLI: A Stepwise Approach to Natural Language Inference Using Text Morphing2025-02-13Relative Age Estimation Using Face Images2025-02-07