Counterfactual Data Augmentation via Perspective Transition for Open-Domain Dialogues

• URL: http://arxiv.org/abs/2210.16838v1
• Date: Sun, 30 Oct 2022 13:26:49 GMT
• Title: Counterfactual Data Augmentation via Perspective Transition for Open-Domain Dialogues
• Authors: Jiao Ou, Jinchao Zhang, Yang Feng, Jie Zhou
• Abstract summary: We propose a data augmentation method to automatically augment high-quality responses with different semantics by counterfactual inference. Experimental results show that our data augmentation method can augment high-quality responses with different semantics for a given dialogue history, and can outperform competitive baselines on multiple downstream tasks.
• Score: 34.78482218571574
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The construction of open-domain dialogue systems requires high-quality dialogue datasets. The dialogue data admits a wide variety of responses for a given dialogue history, especially responses with different semantics. However, collecting high-quality such a dataset in most scenarios is labor-intensive and time-consuming. In this paper, we propose a data augmentation method to automatically augment high-quality responses with different semantics by counterfactual inference. Specifically, given an observed dialogue, our counterfactual generation model first infers semantically different responses by replacing the observed reply perspective with substituted ones. Furthermore, our data selection method filters out detrimental augmented responses. Experimental results show that our data augmentation method can augment high-quality responses with different semantics for a given dialogue history, and can outperform competitive baselines on multiple downstream tasks.

Related papers

• EM Pre-training for Multi-party Dialogue Response Generation [86.25289241604199]
  In multi-party dialogues, the addressee of a response utterance should be specified before it is generated. We propose an Expectation-Maximization (EM) approach that iteratively performs the expectation steps to generate addressee labels.
  arXiv  Detail & Related papers  (2023-05-21T09:22:41Z)
• FCC: Fusing Conversation History and Candidate Provenance for Contextual Response Ranking in Dialogue Systems [53.89014188309486]
  We present a flexible neural framework that can integrate contextual information from multiple channels. We evaluate our model on the MSDialog dataset widely used for evaluating conversational response ranking tasks.
  arXiv  Detail & Related papers  (2023-03-31T23:58:28Z)
• Learning towards Selective Data Augmentation for Dialogue Generation [52.540330534137794]
  We argue that not all cases are beneficial for augmentation task, and the cases suitable for augmentation should obey the following two attributes. We propose a Selective Data Augmentation framework (SDA) for the response generation task.
  arXiv  Detail & Related papers  (2023-03-17T01:26:39Z)
• Learning from Perturbations: Diverse and Informative Dialogue Generation with Inverse Adversarial Training [10.17868476063421]
  We propose Inverse Adversarial Training (IAT) algorithm for training neural dialogue systems. IAT encourages the model to be sensitive to the perturbation in the dialogue history and therefore learning from perturbations. We show that our approach can better model dialogue history and generate more diverse and consistent responses.
  arXiv  Detail & Related papers  (2021-05-31T17:28:37Z)
• Reasoning in Dialog: Improving Response Generation by Context Reading Comprehension [49.92173751203827]
  In multi-turn dialog, utterances do not always take the full form of sentences. We propose to improve the response generation performance by examining the model's ability to answer a reading comprehension question.
  arXiv  Detail & Related papers  (2020-12-14T10:58:01Z)
• Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data [61.71319905364992]
  We propose a novel data augmentation method for training open-domain dialogue models by utilizing unpaired data. A data-level distillation process is first proposed to construct augmented dialogues where both post and response are retrieved from the unpaired data. A ranking module is employed to filter out low-quality dialogues. A model-level distillation process is employed to distill a teacher model trained on high-quality paired data to augmented dialogue pairs.
  arXiv  Detail & Related papers  (2020-09-20T13:06:38Z)
• Rethinking Dialogue State Tracking with Reasoning [76.0991910623001]
  This paper proposes to track dialogue states gradually with reasoning over dialogue turns with the help of the back-end data. Empirical results demonstrate that our method significantly outperforms the state-of-the-art methods by 38.6% in terms of joint belief accuracy for MultiWOZ 2.1.
  arXiv  Detail & Related papers  (2020-05-27T02:05:33Z)
• Diversifying Dialogue Generation with Non-Conversational Text [38.03510529185192]
  We propose a new perspective to diversify dialogue generation by leveraging non-conversational text. We collect a large-scale non-conversational corpus from multi sources including forum comments, idioms and book snippets. The resulting model is tested on two conversational datasets and is shown to produce significantly more diverse responses without sacrificing the relevance with context.
  arXiv  Detail & Related papers  (2020-05-09T02:16:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.