Explicit Memory Tracker with Coarse-to-Fine Reasoning for Conversational
Machine Reading
- URL: http://arxiv.org/abs/2005.12484v2
- Date: Tue, 23 Jun 2020 06:14:38 GMT
- Title: Explicit Memory Tracker with Coarse-to-Fine Reasoning for Conversational
Machine Reading
- Authors: Yifan Gao, Chien-Sheng Wu, Shafiq Joty, Caiming Xiong, Richard Socher,
Irwin King, Michael R. Lyu, and Steven C.H. Hoi
- Abstract summary: We present a new framework of conversational machine reading that comprises a novel Explicit Memory Tracker (EMT)
Our framework generates clarification questions by adopting a coarse-to-fine reasoning strategy.
EMT achieves new state-of-the-art results of 74.6% micro-averaged decision accuracy and 49.5 BLEU4.
- Score: 177.50355465392047
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: The goal of conversational machine reading is to answer user questions given
a knowledge base text which may require asking clarification questions.
Existing approaches are limited in their decision making due to struggles in
extracting question-related rules and reasoning about them. In this paper, we
present a new framework of conversational machine reading that comprises a
novel Explicit Memory Tracker (EMT) to track whether conditions listed in the
rule text have already been satisfied to make a decision. Moreover, our
framework generates clarification questions by adopting a coarse-to-fine
reasoning strategy, utilizing sentence-level entailment scores to weight
token-level distributions. On the ShARC benchmark (blind, held-out) testset,
EMT achieves new state-of-the-art results of 74.6% micro-averaged decision
accuracy and 49.5 BLEU4. We also show that EMT is more interpretable by
visualizing the entailment-oriented reasoning process as the conversation
flows. Code and models are released at
https://github.com/Yifan-Gao/explicit_memory_tracker.
Related papers
- Bridging The Gap: Entailment Fused-T5 for Open-retrieval Conversational
Machine Reading Comprehension [48.529698533726496]
Open-retrieval conversational machine reading comprehension simulates real-life conversational interaction scenes.
Recent studies explored the methods to reduce the information gap between decision-making and question generation.
We propose a novel one-stage end-to-end framework, called Entailment Fused-T5 (EFT), to bridge the information gap between decision-making and generation.
arXiv Detail & Related papers (2022-12-19T10:38:30Z) - ET5: A Novel End-to-end Framework for Conversational Machine Reading
Comprehension [48.529698533726496]
We propose an end-to-end framework for conversational machine reading comprehension based on entailment reasoning T5 (ET5)
Despite the lightweight of our proposed framework, experimental results show that the proposed ET5 achieves new state-of-the-art results on the ShARC leaderboard with the BLEU-4 score of 55.2.
arXiv Detail & Related papers (2022-09-23T08:58:03Z) - Open-Retrieval Conversational Machine Reading [80.13988353794586]
In conversational machine reading, systems need to interpret natural language rules, answer high-level questions, and ask follow-up clarification questions.
Existing works assume the rule text is provided for each user question, which neglects the essential retrieval step in real scenarios.
In this work, we propose and investigate an open-retrieval setting of conversational machine reading.
arXiv Detail & Related papers (2021-02-17T08:55:01Z) - Discern: Discourse-Aware Entailment Reasoning Network for Conversational
Machine Reading [157.14821839576678]
Discern is a discourse-aware entailment reasoning network to strengthen the connection and enhance the understanding for both document and dialog.
Our experiments show that Discern achieves state-of-the-art results of 78.3% macro-averaged accuracy on decision making and 64.0 BLEU1 on follow-up question generation.
arXiv Detail & Related papers (2020-10-05T07:49:51Z) - Retrospective Reader for Machine Reading Comprehension [90.6069071495214]
Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage.
When unanswerable questions are involved in the MRC task, an essential verification module called verifier is especially required in addition to the encoder.
This paper devotes itself to exploring better verifier design for the MRC task with unanswerable questions.
arXiv Detail & Related papers (2020-01-27T11:14:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.