End-to-End Task-Oriented Dialog Modeling with Semi-Structured Knowledge Management

• URL: http://arxiv.org/abs/2106.11796v1
• Date: Tue, 22 Jun 2021 14:07:22 GMT
• Title: End-to-End Task-Oriented Dialog Modeling with Semi-Structured Knowledge Management
• Authors: Silin Gao, Ryuichi Takanobu, Minlie Huang
• Abstract summary: Current task-oriented dialog (TOD) systems mostly manage structured knowledge. They fall short of handling dialogs which also involve unstructured knowledge. We propose a TOD system with semi-structured knowledge management, SeKnow, which extends the belief state to manage knowledge with both structured and unstructured contents.
• Score: 40.99595530656065
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Current task-oriented dialog (TOD) systems mostly manage structured knowledge (e.g. databases and tables) to guide the goal-oriented conversations. However, they fall short of handling dialogs which also involve unstructured knowledge (e.g. reviews and documents). In this paper, we formulate a task of modeling TOD grounded on a fusion of structured and unstructured knowledge. To address this task, we propose a TOD system with semi-structured knowledge management, SeKnow, which extends the belief state to manage knowledge with both structured and unstructured contents. Furthermore, we introduce two implementations of SeKnow based on a non-pretrained sequence-to-sequence model and a pretrained language model, respectively. Both implementations use the end-to-end manner to jointly optimize dialog modeling grounded on structured and unstructured knowledge. We conduct experiments on the modified version of MultiWOZ 2.1 dataset, where dialogs are processed to involve semi-structured knowledge. Experimental results show that SeKnow has strong performances in both end-to-end dialog and intermediate knowledge management, compared to existing TOD systems and their extensions with pipeline knowledge management schemes.

Related papers

• InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systems [60.53276524369498]
  Large language models (LLMs) have been used for diverse tasks in natural language processing (NLP) We present InstructTODS, a novel framework for zero-shot end-to-end task-oriented dialogue systems. InstructTODS generates a proxy belief state that seamlessly translates user intentions into dynamic queries.
  arXiv  Detail & Related papers  (2023-10-13T06:36:26Z)
• Knowledge-Retrieval Task-Oriented Dialog Systems with Semi-Supervision [22.249113574918034]
  Most existing task-oriented dialog (TOD) systems track dialog states in terms of slots and values and use them to query a database to get relevant knowledge to generate responses. In real-life applications, user utterances are noisier, and thus it is more difficult to accurately track dialog states and correctly secure relevant knowledge. Inspired by such progress, we propose a retrieval-based method to enhance knowledge selection in TOD systems, which outperforms the traditional database query method for real-life dialogs.
  arXiv  Detail & Related papers  (2023-05-22T16:29:20Z)
• Knowledge-grounded Dialog State Tracking [12.585986197627477]
  We propose to perform dialog state tracking grounded on knowledge encoded externally. We query relevant knowledge of various forms based on the dialog context. We demonstrate superior performance of our proposed method over strong baselines.
  arXiv  Detail & Related papers  (2022-10-13T01:34:08Z)
• Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model [63.461030694700014]
  We propose a novel dual knowledge-enhanced generative pretrained language model for multimodal task-oriented dialog systems (DKMD) The proposed DKMD consists of three key components: dual knowledge selection, dual knowledge-enhanced context learning, and knowledge-enhanced response generation. Experiments on a public dataset verify the superiority of the proposed DKMD over state-of-the-art competitors.
  arXiv  Detail & Related papers  (2022-07-16T13:02:54Z)
• OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience [87.0233567695073]
  Existing studies in conversational AI mostly treat task-oriented dialog (TOD) and question answering (QA) as separate tasks. We propose a new task, Open-Book TOD (OB-TOD), which combines TOD with QA task and expand external knowledge sources. We propose a unified model OPERA which can appropriately access explicit and implicit external knowledge to tackle the defined task.
  arXiv  Detail & Related papers  (2022-06-24T18:21:26Z)
• Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning [89.64215566478931]
  Conversational recommender systems (CRS) aim to proactively elicit user preference and recommend high-quality items through natural language conversations. To develop an effective CRS, it is essential to seamlessly integrate the two modules. We propose a unified CRS model named UniCRS based on knowledge-enhanced prompt learning.
  arXiv  Detail & Related papers  (2022-06-19T09:21:27Z)
• HyKnow: End-to-End Task-Oriented Dialog Modeling with Hybrid Knowledge Management [58.82499963373537]
  We propose a TOD system with hybrid knowledge management, HyKnow. It extends the belief state to manage both structured and unstructured knowledge. It is the first end-to-end model that jointly optimize modeling grounded on these two kinds of knowledge.
  arXiv  Detail & Related papers  (2021-05-13T01:58:39Z)
• Unstructured Knowledge Access in Task-oriented Dialog Modeling using Language Inference, Knowledge Retrieval and Knowledge-Integrative Response Generation [44.184890645068485]
  Dialog systems enriched with external knowledge can handle user queries that are outside the scope of the supporting databases/APIs. We propose three subsystems, KDEAK, KnowleDgEFactor, and Ens-GPT, which form the pipeline for a task-oriented dialog system. Experimental results demonstrate that the proposed pipeline system outperforms the baseline and generates high-quality responses.
  arXiv  Detail & Related papers  (2021-01-15T11:24:32Z)
• GraphDialog: Integrating Graph Knowledge into End-to-End Task-Oriented Dialogue Systems [9.560436630775762]
  End-to-end task-oriented dialogue systems aim to generate system responses directly from plain text inputs. One is how to effectively incorporate external knowledge bases (KBs) into the learning framework; the other is how to accurately capture the semantics of dialogue history. We address these two challenges by exploiting the graph structural information in the knowledge base and in the dependency parsing tree of the dialogue.
  arXiv  Detail & Related papers  (2020-10-04T00:04:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.