MA-DST: Multi-Attention Based Scalable Dialog State Tracking

• URL: http://arxiv.org/abs/2002.08898v1
• Date: Fri, 7 Feb 2020 05:34:58 GMT
• Title: MA-DST: Multi-Attention Based Scalable Dialog State Tracking
• Authors: Adarsh Kumar, Peter Ku, Anuj Kumar Goyal, Angeliki Metallinou, Dilek Hakkani-Tur
• Abstract summary: Dialog State Tracking dialog agents provide a natural language interface for users to complete their goal. To enable accurate multi-domain DST, the model needs to encode dependencies between past utterances and slot semantics. We introduce a novel architecture for this task to encode the conversation history and slot semantics.
• Score: 13.358314140896937
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Task oriented dialog agents provide a natural language interface for users to complete their goal. Dialog State Tracking (DST), which is often a core component of these systems, tracks the system's understanding of the user's goal throughout the conversation. To enable accurate multi-domain DST, the model needs to encode dependencies between past utterances and slot semantics and understand the dialog context, including long-range cross-domain references. We introduce a novel architecture for this task to encode the conversation history and slot semantics more robustly by using attention mechanisms at multiple granularities. In particular, we use cross-attention to model relationships between the context and slots at different semantic levels and self-attention to resolve cross-domain coreferences. In addition, our proposed architecture does not rely on knowing the domain ontologies beforehand and can also be used in a zero-shot setting for new domains or unseen slot values. Our model improves the joint goal accuracy by 5% (absolute) in the full-data setting and by up to 2% (absolute) in the zero-shot setting over the present state-of-the-art on the MultiWoZ 2.1 dataset.

Related papers

• Exploring User Retrieval Integration towards Large Language Models for Cross-Domain Sequential Recommendation [66.72195610471624]
  Cross-Domain Sequential Recommendation aims to mine and transfer users' sequential preferences across different domains. We propose a novel framework named URLLM, which aims to improve the CDSR performance by exploring the User Retrieval approach.
  arXiv  Detail & Related papers  (2024-06-05T09:19:54Z)
• ChatterBox: Multi-round Multimodal Referring and Grounding [108.9673313949746]
  We present a new benchmark and an efficient vision-language model for this purpose. The proposed model, named ChatterBox, utilizes a two-branch architecture to collaboratively handle vision and language tasks. Experiments show that ChatterBox outperforms existing models in MRG both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2024-01-24T09:02:00Z)
• DORIC : Domain Robust Fine-Tuning for Open Intent Clustering through Dependency Parsing [14.709084509818474]
  DSTC11-Track2 aims to provide a benchmark for zero-shot, cross-domain, intent-set induction. We leveraged a multi-domain dialogue dataset to fine-tune the language model and proposed extracting Verb-Object pairs. Our approach achieved 3rd place in the precision score and showed superior accuracy and normalized mutual information (NMI) score than the baseline model.
  arXiv  Detail & Related papers  (2023-03-17T08:12:36Z)
• PoE: a Panel of Experts for Generalized Automatic Dialogue Assessment [58.46761798403072]
  A model-based automatic dialogue evaluation metric (ADEM) is expected to perform well across multiple domains. Despite significant progress, an ADEM that works well in one domain does not necessarily generalize to another. We propose a Panel of Experts (PoE) network that consists of a shared transformer encoder and a collection of lightweight adapters.
  arXiv  Detail & Related papers  (2022-12-18T02:26:50Z)
• Dialogue State Tracking with a Language Model using Schema-Driven Prompting [18.83983018421701]
  We introduce a new variation of the language modeling approach that uses schema-driven prompting to provide task-aware history encoding. Our purely generative system achieves state-of-the-art performance on MultiWOZ 2.2 and achieves competitive performance on two other benchmarks: MultiWOZ 2.1 and M2M.
  arXiv  Detail & Related papers  (2021-09-15T18:11:25Z)
• Zero-shot Generalization in Dialog State Tracking through Generative Question Answering [10.81203437307028]
  We introduce a novel framework that supports natural language queries for unseen constraints and slots in task-oriented dialogs. Our approach is based on generative question-answering using a conditional domain model pre-trained on substantive English sentences.
  arXiv  Detail & Related papers  (2021-01-20T21:47:20Z)
• TripPy: A Triple Copy Strategy for Value Independent Neural Dialog State Tracking [2.78632567955797]
  Task-oriented dialog systems rely on dialog state tracking (DST) to monitor the user's goal during an interaction. We present a new approach to DST which makes use of various copy mechanisms to fill slots with values.
  arXiv  Detail & Related papers  (2020-05-06T14:52:48Z)
• UniConv: A Unified Conversational Neural Architecture for Multi-domain Task-oriented Dialogues [101.96097419995556]
  "UniConv" is a novel unified neural architecture for end-to-end conversational systems in task-oriented dialogues. We conduct comprehensive experiments in dialogue state tracking, context-to-text, and end-to-end settings on the MultiWOZ2.1 benchmark.
  arXiv  Detail & Related papers  (2020-04-29T16:28:22Z)
• CrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Dataset [58.910961297314415]
  CrossWOZ is the first large-scale Chinese Cross-Domain Wizard-of-Oz task-oriented dataset. It contains 6K dialogue sessions and 102K utterances for 5 domains, including hotel, restaurant, attraction, metro, and taxi.
  arXiv  Detail & Related papers  (2020-02-27T03:06:35Z)
• Non-Autoregressive Dialog State Tracking [122.2328875457225]
  We propose a novel framework of Non-Autoregressive Dialog State Tracking (NADST) NADST can factor in potential dependencies among domains and slots to optimize the models towards better prediction of dialogue states as a complete set rather than separate slots. Our results show that our model achieves the state-of-the-art joint accuracy across all domains on the MultiWOZ 2.1 corpus.
  arXiv  Detail & Related papers  (2020-02-19T06:39:26Z)
• Domain-Aware Dialogue State Tracker for Multi-Domain Dialogue Systems [2.3859169601259347]
  In task-oriented dialogue systems the dialogue state tracker (DST) component is responsible for predicting the state of the dialogue based on the dialogue history. We propose a domain-aware dialogue state tracker that is completely data-driven and it is modeled to predict for dynamic service schemas.
  arXiv  Detail & Related papers  (2020-01-21T13:41:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.