Overview of the Ninth Dialog System Technology Challenge: DSTC9

• URL: http://arxiv.org/abs/2011.06486v1
• Date: Thu, 12 Nov 2020 16:43:10 GMT
• Title: Overview of the Ninth Dialog System Technology Challenge: DSTC9
• Authors: Chulaka Gunasekara, Seokhwan Kim, Luis Fernando D'Haro, Abhinav Rastogi, Yun-Nung Chen, Mihail Eric, Behnam Hedayatnia, Karthik Gopalakrishnan, Yang Liu, Chao-Wei Huang, Dilek Hakkani-T\"ur, Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Minlie Huang, Jianfeng Gao, Shikib Mehri, Yulan Feng, Carla Gordon, Seyed Hossein Alavi, David Traum, Maxine Eskenazi, Ahmad Beirami, Eunjoon (EJ) Cho, Paul A. Crook, Ankita De, Alborz Geramifard, Satwik Kottur, Seungwhan Moon, Shivani Poddar, Rajen Subba
• Abstract summary: The Ninth Dialog System Technology Challenge (DSTC-9) focuses on applying end-to-end dialog technologies for four distinct tasks in dialog systems. This paper describes the task definition, provided datasets, baselines and evaluation set-up for each track.
• Score: 111.35889309106359
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: This paper introduces the Ninth Dialog System Technology Challenge (DSTC-9). This edition of the DSTC focuses on applying end-to-end dialog technologies for four distinct tasks in dialog systems, namely, 1. Task-oriented dialog Modeling with unstructured knowledge access, 2. Multi-domain task-oriented dialog, 3. Interactive evaluation of dialog, and 4. Situated interactive multi-modal dialog. This paper describes the task definition, provided datasets, baselines and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks.

Related papers

• Interactive Evaluation of Dialog Track at DSTC9 [8.2208199207543]
  The Interactive Evaluation of Dialog Track was introduced at the 9th Dialog System Technology Challenge. This paper provides an overview of the track, including the methodology and results.
  arXiv  Detail & Related papers  (2022-07-28T22:54:04Z)
• UniDS: A Unified Dialogue System for Chit-Chat and Task-oriented Dialogues [59.499965460525694]
  We propose a unified dialogue system (UniDS) with the two aforementioned skills. We design a unified dialogue data schema, compatible for both chit-chat and task-oriented dialogues. We train UniDS with mixed dialogue data from a pretrained chit-chat dialogue model.
  arXiv  Detail & Related papers  (2021-10-15T11:56:47Z)
• The SPPD System for Schema Guided Dialogue State Tracking Challenge [2.181419218084711]
  This paper introduces one of our group's work on the Dialog System Technology Challenges 8 (DSTC8) The challenge, named as Track 4 in DSTC8, provides a brand new and challenging dataset for developing scalable multi-domain dialogue state tracking algorithms. We propose a zero-shot dialogue state tracking system for this task.
  arXiv  Detail & Related papers  (2020-06-16T09:57:40Z)
• A Survey on Dialog Management: Recent Advances and Challenges [72.52920723074638]
  Dialog management (DM) is a crucial component in a task-oriented dialog system. Recent advances and challenges within three critical topics for DM: (1) improving model scalability to facilitate dialog system modeling in new scenarios, (2) dealing with the data scarcity problem for dialog policy learning, and (3) enhancing the training efficiency to achieve better task-completion performance.
  arXiv  Detail & Related papers  (2020-05-05T14:31:24Z)
• UniConv: A Unified Conversational Neural Architecture for Multi-domain Task-oriented Dialogues [101.96097419995556]
  "UniConv" is a novel unified neural architecture for end-to-end conversational systems in task-oriented dialogues. We conduct comprehensive experiments in dialogue state tracking, context-to-text, and end-to-end settings on the MultiWOZ2.1 benchmark.
  arXiv  Detail & Related papers  (2020-04-29T16:28:22Z)
• Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems [47.230754691257836]
  This paper describes our systems that are evaluated on all subtasks under NOESIS II challenge. Several adaptation methods are proposed to adapt the pre-trained language models for multi-turn dialogue systems. In the released evaluation results of Track 2 of DSTC 8, our proposed models ranked fourth in subtask 1, third in subtask 2, and first in subtask 3 and subtask 4 respectively.
  arXiv  Detail & Related papers  (2020-04-04T14:14:43Z)
• Recent Advances and Challenges in Task-oriented Dialog System [63.82055978899631]
  Task-oriented dialog systems are attracting more and more attention in academic and industrial communities. We discuss three critical topics for task-oriented dialog systems: (1) improving data efficiency to facilitate dialog modeling in low-resource settings, (2) modeling multi-turn dynamics for dialog policy learning, and (3) integrating domain knowledge into the dialog model.
  arXiv  Detail & Related papers  (2020-03-17T01:34:56Z)
• Hierarchical Context Enhanced Multi-Domain Dialogue System for Multi-domain Task Completion [17.66372217976539]
  This paper describes our submitted solution, Hierarchical Context Enhanced Dialogue System (HCEDS) The main motivation of our system is to comprehensively explore the potential of hierarchical context for sufficiently understanding complex dialogues. Results listed in the leaderboard show that our system achieves first place in automatic evaluation and the second place in human evaluation.
  arXiv  Detail & Related papers  (2020-03-03T05:10:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.