TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Learning to Reason Deductively: Math Word Problem Solving ...

Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction

Zhanming Jie, Jierui Li, Wei Lu

2022-03-19ACL 2022 5MathRelation ExtractionMath Word Problem SolvingRelational Reasoning
PaperPDFCode(official)

Abstract

Solving math word problems requires deductive reasoning over the quantities in the text. Various recent research efforts mostly relied on sequence-to-sequence or sequence-to-tree models to generate mathematical expressions without explicitly performing relational reasoning between quantities in the given context. While empirically effective, such approaches typically do not provide explanations for the generated expressions. In this work, we view the task as a complex relation extraction problem, proposing a novel approach that presents explainable deductive reasoning steps to iteratively construct target expressions, where each step involves a primitive operation over two quantities defining their relation. Through extensive experiments on four benchmark datasets, we show that the proposed model significantly outperforms existing strong baselines. We further demonstrate that the deductive procedure not only presents more explainable steps but also enables us to make more accurate predictions on questions that require more complex reasoning.

Results

TaskDatasetMetricValueModel
Question AnsweringMath23KAccuracy (5-fold)83Roberta-DeductReasoner
Question AnsweringMAWPSAccuracy (%)92Roberta-DeductReasoner
Question AnsweringSVAMPExecution Accuracy47.3Roberta-DeductReasoner
Question AnsweringMathQAAnswer Accuracy78.6Roberta-DeductReasoner
Math Word Problem SolvingMath23KAccuracy (5-fold)83Roberta-DeductReasoner
Math Word Problem SolvingMAWPSAccuracy (%)92Roberta-DeductReasoner
Math Word Problem SolvingSVAMPExecution Accuracy47.3Roberta-DeductReasoner
Math Word Problem SolvingMathQAAnswer Accuracy78.6Roberta-DeductReasoner
Mathematical Question AnsweringMath23KAccuracy (5-fold)83Roberta-DeductReasoner
Mathematical Question AnsweringMAWPSAccuracy (%)92Roberta-DeductReasoner
Mathematical Question AnsweringSVAMPExecution Accuracy47.3Roberta-DeductReasoner
Mathematical Question AnsweringMathQAAnswer Accuracy78.6Roberta-DeductReasoner
Mathematical ReasoningMath23KAccuracy (5-fold)83Roberta-DeductReasoner
Mathematical ReasoningMAWPSAccuracy (%)92Roberta-DeductReasoner
Mathematical ReasoningSVAMPExecution Accuracy47.3Roberta-DeductReasoner
Mathematical ReasoningMathQAAnswer Accuracy78.6Roberta-DeductReasoner

Related Papers

VAR-MATH: Probing True Mathematical Reasoning in Large Language Models via Symbolic Multi-Instance Benchmarks2025-07-17QuestA: Expanding Reasoning Capacity in LLMs via Question Augmentation2025-07-17Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training2025-07-16Temperature and Persona Shape LLM Agent Consensus With Minimal Accuracy Gains in Qualitative Coding2025-07-15Personalized Exercise Recommendation with Semantically-Grounded Knowledge Tracing2025-07-15Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination2025-07-14A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement Learning2025-07-11Skip a Layer or Loop it? Test-Time Depth Adaptation of Pretrained LLMs2025-07-10