Improving Numerical Reasoning Skills in the Modular Approach for Complex Question Answering on Text

• URL: http://arxiv.org/abs/2109.02289v1
• Date: Mon, 6 Sep 2021 08:34:31 GMT
• Title: Improving Numerical Reasoning Skills in the Modular Approach for Complex Question Answering on Text
• Authors: Xiao-Yu Guo, Yuan-Fang Li and Gholamreza Haffari
• Abstract summary: A successful approach to complex question answering (CQA) on text, Neural Module Networks (NMNs), follows the programmer-interpreter paradigm. We propose effective techniques to improve NMNs' numerical reasoning capabilities by making the interpreter question-aware.
• Score: 39.22253030039486
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Numerical reasoning skills are essential for complex question answering (CQA) over text. It requires opertaions including counting, comparison, addition and subtraction. A successful approach to CQA on text, Neural Module Networks (NMNs), follows the programmer-interpreter paradigm and leverages specialised modules to perform compositional reasoning. However, the NMNs framework does not consider the relationship between numbers and entities in both questions and paragraphs. We propose effective techniques to improve NMNs' numerical reasoning capabilities by making the interpreter question-aware and capturing the relationship between entities and numbers. On the same subset of the DROP dataset for CQA on text, experimental results show that our additions outperform the original NMNs by 3.0 points for the overall F1 score.

Related papers

• Knowledge Graph Reasoning over Entities and Numerical Values [48.67312700426019]
  We introduce new numerical variables and operations to describe queries involving numerical attribute values. We also propose the framework of Number Reasoning Network (NRN) for encoding entities and numerical values into separate encoding structures.
  arXiv  Detail & Related papers  (2023-06-02T09:46:29Z)
• MURMUR: Modular Multi-Step Reasoning for Semi-Structured Data-to-Text Generation [102.20036684996248]
  We propose MURMUR, a neuro-symbolic modular approach to text generation from semi-structured data with multi-step reasoning. We conduct experiments on two data-to-text generation tasks like WebNLG and LogicNLG.
  arXiv  Detail & Related papers  (2022-12-16T17:36:23Z)
• Teaching Neural Module Networks to Do Arithmetic [54.06832128723388]
  We up-grade NMNs by bridging the gap between its interpreter and the complex questions. We introduce addition and subtraction modules that perform numerical reasoning over numbers. On a subset of DROP, experimental results show that our proposed methods enhance NMNs' numerical reasoning skills by 17.7% improvement of F1 score.
  arXiv  Detail & Related papers  (2022-10-06T06:38:04Z)
• Injecting Numerical Reasoning Skills into Knowledge Base Question Answering Models [19.964729281684363]
  This paper proposes a new embedding-based KBQA framework which takes numerical reasoning into account. We present NumericalTransformer on top of NSM, a state-of-the-art embedding-based KBQA model, to create NT-NSM. Experiments on KBQA benchmarks demonstrate that NT-NSM is empowered with numerical reasoning skills and substantially outperforms the baselines in answering ordinal constrained questions.
  arXiv  Detail & Related papers  (2021-12-12T01:30:29Z)
• Weakly Supervised Neuro-Symbolic Module Networks for Numerical Reasoning [44.5641465035393]
  We propose Weakly-Supervised Neuro-Symbolic Module Network (WNSMN) trained with answers as the sole supervision for numerical reasoning based. It learns to execute a noisy MRC program obtained from the dependency parsing of the query, as discrete actions over both neural and symbolic reasoning modules and trains it end-to-end in a reinforcement learning framework with discrete reward from answer matching. This showcases the effectiveness and generalizability of modular networks that can handle explicit discrete reasoning over noisy programs in an end-to-end manner.
  arXiv  Detail & Related papers  (2021-01-28T03:36:09Z)
• Question Answering over Knowledge Bases by Leveraging Semantic Parsing and Neuro-Symbolic Reasoning [73.00049753292316]
  We propose a semantic parsing and reasoning-based Neuro-Symbolic Question Answering(NSQA) system. NSQA achieves state-of-the-art performance on QALD-9 and LC-QuAD 1.0.
  arXiv  Detail & Related papers  (2020-12-03T05:17:55Z)
• Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Models [61.480085460269514]
  We propose a framework for building interpretable systems that learn to solve complex tasks by decomposing them into simpler ones solvable by existing models. We use this framework to build ModularQA, a system that can answer multi-hop reasoning questions by decomposing them into sub-questions answerable by a neural factoid single-span QA model and a symbolic calculator.
  arXiv  Detail & Related papers  (2020-09-01T23:45:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.