TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Semantically-Aligned Universal Tree-Structured Solver for ...

Semantically-Aligned Universal Tree-Structured Solver for Math Word Problems

Jinghui Qin, Lihui Lin, Xiaodan Liang, Rumin Zhang, Liang Lin

2020-10-14EMNLP 2020 11MathMath Word Problem Solving
PaperPDFCode(official)

Abstract

A practical automatic textual math word problems (MWPs) solver should be able to solve various textual MWPs while most existing works only focused on one-unknown linear MWPs. Herein, we propose a simple but efficient method called Universal Expression Tree (UET) to make the first attempt to represent the equations of various MWPs uniformly. Then a semantically-aligned universal tree-structured solver (SAU-Solver) based on an encoder-decoder framework is proposed to resolve multiple types of MWPs in a unified model, benefiting from our UET representation. Our SAU-Solver generates a universal expression tree explicitly by deciding which symbol to generate according to the generated symbols' semantic meanings like human solving MWPs. Besides, our SAU-Solver also includes a novel subtree-level semanticallyaligned regularization to further enforce the semantic constraints and rationality of the generated expression tree by aligning with the contextual information. Finally, to validate the universality of our solver and extend the research boundary of MWPs, we introduce a new challenging Hybrid Math Word Problems dataset (HMWP), consisting of three types of MWPs. Experimental results on several MWPs datasets show that our model can solve universal types of MWPs and outperforms several state-of-the-art models.

Results

TaskDatasetMetricValueModel
Question AnsweringMath23KAccuracy (5-fold)74.84SAU-Solver
Question AnsweringALG514Accuracy (%)57.39SAU-Solver
Math Word Problem SolvingMath23KAccuracy (5-fold)74.84SAU-Solver
Math Word Problem SolvingALG514Accuracy (%)57.39SAU-Solver
Mathematical Question AnsweringMath23KAccuracy (5-fold)74.84SAU-Solver
Mathematical Question AnsweringALG514Accuracy (%)57.39SAU-Solver
Mathematical ReasoningMath23KAccuracy (5-fold)74.84SAU-Solver
Mathematical ReasoningALG514Accuracy (%)57.39SAU-Solver

Related Papers

VAR-MATH: Probing True Mathematical Reasoning in Large Language Models via Symbolic Multi-Instance Benchmarks2025-07-17QuestA: Expanding Reasoning Capacity in LLMs via Question Augmentation2025-07-17Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training2025-07-16Temperature and Persona Shape LLM Agent Consensus With Minimal Accuracy Gains in Qualitative Coding2025-07-15Personalized Exercise Recommendation with Semantically-Grounded Knowledge Tracing2025-07-15Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination2025-07-14A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement Learning2025-07-11Skip a Layer or Loop it? Test-Time Depth Adaptation of Pretrained LLMs2025-07-10