ET5: A Novel End-to-end Framework for Conversational Machine Reading Comprehension

• URL: http://arxiv.org/abs/2209.11484v1
• Date: Fri, 23 Sep 2022 08:58:03 GMT
• Title: ET5: A Novel End-to-end Framework for Conversational Machine Reading Comprehension
• Authors: Xiao Zhang, Heyan Huang, Zewen Chi and Xian-Ling Mao
• Abstract summary: We propose an end-to-end framework for conversational machine reading comprehension based on entailment reasoning T5 (ET5) Despite the lightweight of our proposed framework, experimental results show that the proposed ET5 achieves new state-of-the-art results on the ShARC leaderboard with the BLEU-4 score of 55.2.
• Score: 48.529698533726496
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Conversational machine reading comprehension (CMRC) aims to assist computers to understand an natural language text and thereafter engage in a multi-turn conversation to answer questions related to the text. Existing methods typically require three steps: (1) decision making based on entailment reasoning; (2) span extraction if required by the above decision; (3) question rephrasing based on the extracted span. However, for nearly all these methods, the span extraction and question rephrasing steps cannot fully exploit the fine-grained entailment reasoning information in decision making step because of their relative independence, which will further enlarge the information gap between decision making and question phrasing. Thus, to tackle this problem, we propose a novel end-to-end framework for conversational machine reading comprehension based on shared parameter mechanism, called entailment reasoning T5 (ET5). Despite the lightweight of our proposed framework, experimental results show that the proposed ET5 achieves new state-of-the-art results on the ShARC leaderboard with the BLEU-4 score of 55.2. Our model and code are publicly available at https://github.com/Yottaxx/ET5.

Related papers

• Explicit Alignment and Many-to-many Entailment Based Reasoning for Conversational Machine Reading [8.910847114561191]
  Conversational Machine Reading (CMR) requires answering a user's initial question through multi-turn dialogue interactions based on a given document. Our proposed method achieves state-of-the-art in micro-accuracy and ranks the first place on the public leaderboard of the CMR benchmark dataset ShARC.
  arXiv  Detail & Related papers  (2023-10-20T10:27:24Z)
• Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMs [59.74002011562726]
  We propose a novel linguistic cue-based chain-of-thoughts (textitCue-CoT) to provide a more personalized and engaging response. We build a benchmark with in-depth dialogue questions, consisting of 6 datasets in both Chinese and English. Empirical results demonstrate our proposed textitCue-CoT method outperforms standard prompting methods in terms of both textithelpfulness and textitacceptability on all datasets.
  arXiv  Detail & Related papers  (2023-05-19T16:27:43Z)
• Bridging The Gap: Entailment Fused-T5 for Open-retrieval Conversational Machine Reading Comprehension [48.529698533726496]
  Open-retrieval conversational machine reading comprehension simulates real-life conversational interaction scenes. Recent studies explored the methods to reduce the information gap between decision-making and question generation. We propose a novel one-stage end-to-end framework, called Entailment Fused-T5 (EFT), to bridge the information gap between decision-making and generation.
  arXiv  Detail & Related papers  (2022-12-19T10:38:30Z)
• Towards End-to-End Open Conversational Machine Reading [57.18251784418258]
  In open-retrieval conversational machine reading (OR-CMR) task, machines are required to do multi-turn question answering given dialogue history and a textual knowledge base. We model OR-CMR as a unified text-to-text task in a fully end-to-end style. Experiments on the ShARC and OR-ShARC dataset show the effectiveness of our proposed end-to-end framework.
  arXiv  Detail & Related papers  (2022-10-13T15:50:44Z)
• Smoothing Dialogue States for Open Conversational Machine Reading [70.83783364292438]
  We propose an effective gating strategy by smoothing the two dialogue states in only one decoder and bridge decision making and question generation. Experiments on the OR-ShARC dataset show the effectiveness of our method, which achieves new state-of-the-art results.
  arXiv  Detail & Related papers  (2021-08-28T08:04:28Z)
• Explicit Memory Tracker with Coarse-to-Fine Reasoning for Conversational Machine Reading [177.50355465392047]
  We present a new framework of conversational machine reading that comprises a novel Explicit Memory Tracker (EMT) Our framework generates clarification questions by adopting a coarse-to-fine reasoning strategy. EMT achieves new state-of-the-art results of 74.6% micro-averaged decision accuracy and 49.5 BLEU4.
  arXiv  Detail & Related papers  (2020-05-26T02:21:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.