The SPPD System for Schema Guided Dialogue State Tracking Challenge

• URL: http://arxiv.org/abs/2006.09035v1
• Date: Tue, 16 Jun 2020 09:57:40 GMT
• Title: The SPPD System for Schema Guided Dialogue State Tracking Challenge
• Authors: Miao Li, Haoqi Xiong, Yunbo Cao (Smart Platform Product Department, Tencent Inc, China)
• Abstract summary: This paper introduces one of our group's work on the Dialog System Technology Challenges 8 (DSTC8) The challenge, named as Track 4 in DSTC8, provides a brand new and challenging dataset for developing scalable multi-domain dialogue state tracking algorithms. We propose a zero-shot dialogue state tracking system for this task.
• Score: 2.181419218084711
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper introduces one of our group's work on the Dialog System Technology Challenges 8 (DSTC8), the SPPD system for Schema Guided dialogue state tracking challenge. This challenge, named as Track 4 in DSTC8, provides a brand new and challenging dataset for developing scalable multi-domain dialogue state tracking algorithms for real world dialogue systems. We propose a zero-shot dialogue state tracking system for this task. The key components of the system is a number of BERT based zero-shot NLU models that can effectively capture semantic relations between natural language descriptions of services' schemas and utterances from dialogue turns. We also propose some strategies to make the system better to exploit information from longer dialogue history and to overcome the slot carryover problem for multi-domain dialogues. The experimental results show that the proposed system achieves a significant improvement compared with the baseline system.

Related papers

• Are cascade dialogue state tracking models speaking out of turn in spoken dialogues? [1.786898113631979]
  This paper proposes a comprehensive analysis of the errors of state of the art systems in complex settings such as Dialogue State Tracking. Based on spoken MultiWoz, we identify that errors on non-categorical slots' values are essential to address in order to bridge the gap between spoken and chat-based dialogue systems.
  arXiv  Detail & Related papers  (2023-11-03T08:45:22Z)
• Self-Explanation Prompting Improves Dialogue Understanding in Large Language Models [52.24756457516834]
  We propose a novel "Self-Explanation" prompting strategy to enhance the comprehension abilities of Large Language Models (LLMs) This task-agnostic approach requires the model to analyze each dialogue utterance before task execution, thereby improving performance across various dialogue-centric tasks. Experimental results from six benchmark datasets confirm that our method consistently outperforms other zero-shot prompts and matches or exceeds the efficacy of few-shot prompts.
  arXiv  Detail & Related papers  (2023-09-22T15:41:34Z)
• S3-DST: Structured Open-Domain Dialogue Segmentation and State Tracking in the Era of LLMs [22.319211779438934]
  The advent of Large Language Model (LLM)-based chat systems has introduced many real-world intricacies in open-domain dialogues. We propose joint dialogue segmentation and state tracking per segment in open-domain dialogue systems. We evaluate S3-DST on a proprietary anonymized open-domain dialogue dataset, as well as publicly available DST and segmentation datasets.
  arXiv  Detail & Related papers  (2023-09-16T00:59:23Z)
• HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Data [87.67278915655712]
  We present a new dialogue dataset, HybriDialogue, which consists of crowdsourced natural conversations grounded on both Wikipedia text and tables. The conversations are created through the decomposition of complex multihop questions into simple, realistic multiturn dialogue interactions.
  arXiv  Detail & Related papers  (2022-04-28T00:52:16Z)
• UniDS: A Unified Dialogue System for Chit-Chat and Task-oriented Dialogues [59.499965460525694]
  We propose a unified dialogue system (UniDS) with the two aforementioned skills. We design a unified dialogue data schema, compatible for both chit-chat and task-oriented dialogues. We train UniDS with mixed dialogue data from a pretrained chit-chat dialogue model.
  arXiv  Detail & Related papers  (2021-10-15T11:56:47Z)
• Overview of the Ninth Dialog System Technology Challenge: DSTC9 [111.35889309106359]
  The Ninth Dialog System Technology Challenge (DSTC-9) focuses on applying end-to-end dialog technologies for four distinct tasks in dialog systems. This paper describes the task definition, provided datasets, baselines and evaluation set-up for each track.
  arXiv  Detail & Related papers  (2020-11-12T16:43:10Z)
• Rethinking Dialogue State Tracking with Reasoning [76.0991910623001]
  This paper proposes to track dialogue states gradually with reasoning over dialogue turns with the help of the back-end data. Empirical results demonstrate that our method significantly outperforms the state-of-the-art methods by 38.6% in terms of joint belief accuracy for MultiWOZ 2.1.
  arXiv  Detail & Related papers  (2020-05-27T02:05:33Z)
• Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems [47.230754691257836]
  This paper describes our systems that are evaluated on all subtasks under NOESIS II challenge. Several adaptation methods are proposed to adapt the pre-trained language models for multi-turn dialogue systems. In the released evaluation results of Track 2 of DSTC 8, our proposed models ranked fourth in subtask 1, third in subtask 2, and first in subtask 3 and subtask 4 respectively.
  arXiv  Detail & Related papers  (2020-04-04T14:14:43Z)
• Hierarchical Context Enhanced Multi-Domain Dialogue System for Multi-domain Task Completion [17.66372217976539]
  This paper describes our submitted solution, Hierarchical Context Enhanced Dialogue System (HCEDS) The main motivation of our system is to comprehensively explore the potential of hierarchical context for sufficiently understanding complex dialogues. Results listed in the leaderboard show that our system achieves first place in automatic evaluation and the second place in human evaluation.
  arXiv  Detail & Related papers  (2020-03-03T05:10:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.