Difference-aware Knowledge Selection for Knowledge-grounded Conversation Generation

• URL: http://arxiv.org/abs/2009.09378v1
• Date: Sun, 20 Sep 2020 07:47:26 GMT
• Title: Difference-aware Knowledge Selection for Knowledge-grounded Conversation Generation
• Authors: Chujie Zheng, Yunbo Cao, Daxin Jiang, Minlie Huang
• Abstract summary: We propose a difference-aware knowledge selection method for multi-turn knowledge-grounded dialogs. It first computes the difference between the candidate knowledge sentences provided at the current turn and those chosen in the previous turns. Then, the differential information is fused with or disentangled from the contextual information to facilitate final knowledge selection.
• Score: 101.48602006200409
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In a multi-turn knowledge-grounded dialog, the difference between the knowledge selected at different turns usually provides potential clues to knowledge selection, which has been largely neglected in previous research. In this paper, we propose a difference-aware knowledge selection method. It first computes the difference between the candidate knowledge sentences provided at the current turn and those chosen in the previous turns. Then, the differential information is fused with or disentangled from the contextual information to facilitate final knowledge selection. Automatic, human observational, and interactive evaluation shows that our method is able to select knowledge more accurately and generate more informative responses, significantly outperforming the state-of-the-art baselines. The codes are available at https://github.com/chujiezheng/DiffKS.

Related papers

• A Knowledge Plug-and-Play Test Bed for Open-domain Dialogue Generation [51.31429493814664]
  We present a benchmark named multi-source Wizard of Wikipedia for evaluating multi-source dialogue knowledge selection and response generation. We propose a new challenge, dialogue knowledge plug-and-play, which aims to test an already trained dialogue model on using new support knowledge from previously unseen sources.
  arXiv  Detail & Related papers  (2024-03-06T06:54:02Z)
• Graph vs. Sequence: An Empirical Study on Knowledge Forms for Knowledge-Grounded Dialogue [45.36967792307907]
  We conduct a thorough experiment and study on the task to answer three essential questions. The questions involve the choice of appropriate knowledge form, the degree of mutual effects between knowledge and the model selection, and the few-shot performance of knowledge.
  arXiv  Detail & Related papers  (2023-12-13T03:16:33Z)
• Well Begun is Half Done: Generator-agnostic Knowledge Pre-Selection for Knowledge-Grounded Dialogue [24.395322923436026]
  We focus on the third under-explored category of study, which can not only select knowledge accurately in advance, but has the advantage to reduce the learning, adjustment, and interpretation burden. We propose GATE, a generator-agnostic knowledge selection method, to prepare knowledge for subsequent response generation models.
  arXiv  Detail & Related papers  (2023-10-11T17:00:29Z)
• Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphs [123.50636090341236]
  We propose to automatically convert background knowledge documents into document semantic graphs. Our document semantic graphs preserve sentence-level information through the use of sentence nodes and provide concept connections between sentences. Our experiments show that our semantic graph-based knowledge selection improves over sentence selection baselines for both the knowledge selection task and the end-to-end response generation task on HollE.
  arXiv  Detail & Related papers  (2022-06-15T04:51:32Z)
• There Are a Thousand Hamlets in a Thousand People's Eyes: Enhancing Knowledge-grounded Dialogue with Personal Memory [67.24942840683904]
  We introduce personal memory into knowledge selection in Knowledge-grounded conversation. We devise a learning scheme in which the forward mapping from personal memory to knowledge and its inverse mapping is included in a closed loop. Experiment results show that our method outperforms existing KGC methods significantly on both automatic evaluation and human evaluation.
  arXiv  Detail & Related papers  (2022-04-06T07:06:37Z)
• Knowledge-Grounded Dialogue with Reward-Driven Knowledge Selection [1.1633929083694388]
  Knoformer is a dialogue response generation model based on reinforcement learning. It can automatically select one or more related knowledge from the knowledge pool and does not need knowledge labels during training.
  arXiv  Detail & Related papers  (2021-08-31T08:53:08Z)
• Contextualized Knowledge-aware Attentive Neural Network: Enhancing Answer Selection with Knowledge [77.77684299758494]
  We extensively investigate approaches to enhancing the answer selection model with external knowledge from knowledge graph (KG) First, we present a context-knowledge interaction learning framework, Knowledge-aware Neural Network (KNN), which learns the QA sentence representations by considering a tight interaction with the external knowledge from KG and the textual information. To handle the diversity and complexity of KG information, we propose a Contextualized Knowledge-aware Attentive Neural Network (CKANN), which improves the knowledge representation learning with structure information via a customized Graph Convolutional Network (GCN) and comprehensively learns context-based and knowledge-based sentence representation via
  arXiv  Detail & Related papers  (2021-04-12T05:52:20Z)
• Improving Commonsense Question Answering by Graph-based Iterative Retrieval over Multiple Knowledge Sources [26.256653692882715]
  How to engage commonsense effectively in question answering systems is still under exploration. We propose a novel question-answering method by integrating ConceptNet, Wikipedia, and the Cambridge Dictionary. We use a pre-trained language model to encode the question, retrieved knowledge and choices, and propose an answer choice-aware attention mechanism.
  arXiv  Detail & Related papers  (2020-11-05T08:50:43Z)
• Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue [51.513276162736844]
  We propose a sequential latent variable model as the first approach to this matter. The model named sequential knowledge transformer (SKT) can keep track of the prior and posterior distribution over knowledge.
  arXiv  Detail & Related papers  (2020-02-18T11:59:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.