DIALKI: Knowledge Identification in Conversational Systems through Dialogue-Document Contextualization

• URL: http://arxiv.org/abs/2109.04673v1
• Date: Fri, 10 Sep 2021 05:40:37 GMT
• Title: DIALKI: Knowledge Identification in Conversational Systems through Dialogue-Document Contextualization
• Authors: Zeqiu Wu, Bo-Ru Lu, Hannaneh Hajishirzi and Mari Ostendorf
• Abstract summary: We introduce a knowledge identification model that leverages the document structure to provide dialogue-contextualized passage encodings. We demonstrate the effectiveness of our model on two document-grounded conversational datasets.
• Score: 41.21012318918167
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Identifying relevant knowledge to be used in conversational systems that are grounded in long documents is critical to effective response generation. We introduce a knowledge identification model that leverages the document structure to provide dialogue-contextualized passage encodings and better locate knowledge relevant to the conversation. An auxiliary loss captures the history of dialogue-document connections. We demonstrate the effectiveness of our model on two document-grounded conversational datasets and provide analyses showing generalization to unseen documents and long dialogue contexts.

Related papers

• Coarse-to-Fine Knowledge Selection for Document Grounded Dialogs [11.63334863772068]
  Multi-document grounded dialogue systems (DGDS) answer users' requests by finding supporting knowledge from a collection of documents. This paper proposes Re3G, which aims to optimize both coarse-grained knowledge retrieval and fine-grained knowledge extraction in a unified framework.
  arXiv  Detail & Related papers  (2023-02-23T08:28:29Z)
• Position Matters! Empirical Study of Order Effect in Knowledge-grounded Dialogue [54.98184262897166]
  We investigate how the order of the knowledge set can influence autoregressive dialogue systems' responses. We propose a simple and novel technique to alleviate the order effect by modifying the position embeddings of knowledge input.
  arXiv  Detail & Related papers  (2023-02-12T10:13:00Z)
• Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access [20.881612071473118]
  We propose Topic-Aware Response Generation'' (TARG) to better integrate topical information in task-oriented dialogue. TARG incorporates multiple topic-aware attention mechanisms to derive the importance weighting scheme over dialogue utterances and external knowledge sources.
  arXiv  Detail & Related papers  (2022-12-10T22:32:28Z)
• CorefDiffs: Co-referential and Differential Knowledge Flow in Document Grounded Conversations [31.676679227767917]
  For document-grounded dialog systems, the inter- and intra-document knowledge relations can be used to model such conversational flows. We develop a novel Multi-Document Co-Referential Graph (Coref-MDG) to capture the inter-document relationships. CorefDiffs significantly outperforms the state-of-the-art by 9.5%, 7.4%, and 8.2% on three public benchmarks.
  arXiv  Detail & Related papers  (2022-10-05T13:00:17Z)
• A Benchmark for Understanding and Generating Dialogue between Characters in Stories [75.29466820496913]
  We present the first study to explore whether machines can understand and generate dialogue in stories. We propose two new tasks including Masked Dialogue Generation and Dialogue Speaker Recognition. We show the difficulty of the proposed tasks by testing existing models with automatic and manual evaluation on DialStory.
  arXiv  Detail & Related papers  (2022-09-18T10:19:04Z)
• Manual-Guided Dialogue for Flexible Conversational Agents [84.46598430403886]
  How to build and use dialogue data efficiently, and how to deploy models in different domains at scale can be critical issues in building a task-oriented dialogue system. We propose a novel manual-guided dialogue scheme, where the agent learns the tasks from both dialogue and manuals. Our proposed scheme reduces the dependence of dialogue models on fine-grained domain ontology, and makes them more flexible to adapt to various domains.
  arXiv  Detail & Related papers  (2022-08-16T08:21:12Z)
• DG2: Data Augmentation Through Document Grounded Dialogue Generation [41.81030088619399]
  We propose an automatic data augmentation technique grounded on documents through a generative dialogue model. When supplementing the original dataset, our method achieves significant improvement over traditional data augmentation methods.
  arXiv  Detail & Related papers  (2021-12-15T18:50:14Z)
• "How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversations [87.95711406978157]
  This work presents a new benchmark on spoken task-oriented conversations. We study multi-domain dialogue state tracking and knowledge-grounded dialogue modeling. Our data set enables speech-based benchmarking of task-oriented dialogue systems.
  arXiv  Detail & Related papers  (2021-09-28T04:51:04Z)
• A Compare Aggregate Transformer for Understanding Document-grounded Dialogue [27.04964963480175]
  We propose a Compare Aggregate Transformer (CAT) to jointly denoise the dialogue context and aggregate the document information for response generation. Experimental results on the CMUDoG dataset show that the proposed CAT model outperforms the state-of-the-art approach and strong baselines.
  arXiv  Detail & Related papers  (2020-10-01T03:44:44Z)
• Rethinking Dialogue State Tracking with Reasoning [76.0991910623001]
  This paper proposes to track dialogue states gradually with reasoning over dialogue turns with the help of the back-end data. Empirical results demonstrate that our method significantly outperforms the state-of-the-art methods by 38.6% in terms of joint belief accuracy for MultiWOZ 2.1.
  arXiv  Detail & Related papers  (2020-05-27T02:05:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.