Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue Systems

• URL: http://arxiv.org/abs/2010.05740v4
• Date: Wed, 29 Sep 2021 09:50:59 GMT
• Title: Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue Systems
• Authors: Yanjie Gou, Yinjie Lei, Lingqiao Liu, Yong Dai, Chunxu Shen
• Abstract summary: We propose a COntext-aware Memory Enhanced Transformer framework (COMET), which treats the KB as a sequence. Through extensive experiments, we show that our COMET framework can achieve superior performance over the state of the arts.
• Score: 28.347325247064944
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Incorporating knowledge bases (KB) into end-to-end task-oriented dialogue systems is challenging, since it requires to properly represent the entity of KB, which is associated with its KB context and dialogue context. The existing works represent the entity with only perceiving a part of its KB context, which can lead to the less effective representation due to the information loss, and adversely favor KB reasoning and response generation. To tackle this issue, we explore to fully contextualize the entity representation by dynamically perceiving all the relevant entities} and dialogue history. To achieve this, we propose a COntext-aware Memory Enhanced Transformer framework (COMET), which treats the KB as a sequence and leverages a novel Memory Mask to enforce the entity to only focus on its relevant entities and dialogue history, while avoiding the distraction from the irrelevant entities. Through extensive experiments, we show that our COMET framework can achieve superior performance over the state of the arts.

Related papers

• Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems [57.16442740983528]
  Crowdsourced labels play a crucial role in evaluating task-oriented dialogue systems. Previous studies suggest using only a portion of the dialogue context in the annotation process. This study investigates the influence of dialogue context on annotation quality.
  arXiv  Detail & Related papers  (2024-04-15T17:56:39Z)
• Improving the Robustness of Knowledge-Grounded Dialogue via Contrastive Learning [71.8876256714229]
  We propose an entity-based contrastive learning framework for improving the robustness of knowledge-grounded dialogue systems. Our method achieves new state-of-the-art performance in terms of automatic evaluation scores.
  arXiv  Detail & Related papers  (2024-01-09T05:16:52Z)
• Using Textual Interface to Align External Knowledge for End-to-End Task-Oriented Dialogue Systems [53.38517204698343]
  We propose a novel paradigm that uses a textual interface to align external knowledge and eliminate redundant processes. We demonstrate our paradigm in practice through MultiWOZ-Remake, including an interactive textual interface built for the MultiWOZ database.
  arXiv  Detail & Related papers  (2023-05-23T05:48:21Z)
• Context-Dependent Embedding Utterance Representations for Emotion Recognition in Conversations [1.8126187844654875]
  We approach Emotion Recognition in Conversations leveraging the conversational context. We propose context-dependent embedding representations of each utterance. The effectiveness of our approach is validated on the open-domain DailyDialog dataset and on the task-oriented EmoWOZ dataset.
  arXiv  Detail & Related papers  (2023-04-17T12:37:57Z)
• FCC: Fusing Conversation History and Candidate Provenance for Contextual Response Ranking in Dialogue Systems [53.89014188309486]
  We present a flexible neural framework that can integrate contextual information from multiple channels. We evaluate our model on the MSDialog dataset widely used for evaluating conversational response ranking tasks.
  arXiv  Detail & Related papers  (2023-03-31T23:58:28Z)
• Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access [20.881612071473118]
  We propose Topic-Aware Response Generation'' (TARG) to better integrate topical information in task-oriented dialogue. TARG incorporates multiple topic-aware attention mechanisms to derive the importance weighting scheme over dialogue utterances and external knowledge sources.
  arXiv  Detail & Related papers  (2022-12-10T22:32:28Z)
• Constraint based Knowledge Base Distillation in End-to-End Task Oriented Dialogs [23.678209058054062]
  Task-oriented dialogue systems generate responses based on dialog history and an accompanying knowledge base (KB) We propose a novel filtering technique that consists of (1) a pairwise similarity based filter that identifies relevant information by respecting the n-ary structure in a KB record. We also propose a new metric -- multiset entity F1 which fixes a correctness issue in the existing entity F1 metric.
  arXiv  Detail & Related papers  (2021-09-15T16:00:10Z)
• A Simple But Effective Approach to n-shot Task-Oriented Dialogue Augmentation [32.43362825854633]
  We introduce a framework that creates synthetic task-oriented dialogues in a fully automatic manner. Our framework uses the simple idea that each turn-pair in a task-oriented dialogue has a certain function. We observe significant improvements in the fine-tuning scenarios in several domains.
  arXiv  Detail & Related papers  (2021-02-27T18:55:12Z)
• Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems [79.02430277138801]
  The knowledge base (KB) plays an essential role in fulfilling user requests. End-to-end systems use the KB directly as input, but they cannot scale when the KB is larger than a few hundred entries. We propose a method to embed the KB, of any size, directly into the model parameters.
  arXiv  Detail & Related papers  (2020-09-28T22:13:54Z)
• Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion [77.21442487537139]
  Conversational recommender systems (CRS) aim to recommend high-quality items to users through interactive conversations. First, the conversation data itself lacks of sufficient contextual information for accurately understanding users' preference. Second, there is a semantic gap between natural language expression and item-level user preference.
  arXiv  Detail & Related papers  (2020-07-08T11:14:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.