Goal-Oriented Multi-Task BERT-Based Dialogue State Tracker
- URL: http://arxiv.org/abs/2002.02450v1
- Date: Wed, 5 Feb 2020 22:56:12 GMT
- Title: Goal-Oriented Multi-Task BERT-Based Dialogue State Tracker
- Authors: Pavel Gulyaev, Eugenia Elistratova, Vasily Konovalov, Yuri Kuratov,
Leonid Pugachev, Mikhail Burtsev
- Abstract summary: State Tracking (DST) is a core component of virtual assistants such as Alexa or Siri.
In this work, we propose a GOaL-Oriented Multi-task BERT-based dialogue state tracker (GOLOMB)
- Score: 0.1864131501304829
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Dialogue State Tracking (DST) is a core component of virtual assistants such
as Alexa or Siri. To accomplish various tasks, these assistants need to support
an increasing number of services and APIs. The Schema-Guided State Tracking
track of the 8th Dialogue System Technology Challenge highlighted the DST
problem for unseen services. The organizers introduced the Schema-Guided
Dialogue (SGD) dataset with multi-domain conversations and released a zero-shot
dialogue state tracking model. In this work, we propose a GOaL-Oriented
Multi-task BERT-based dialogue state tracker (GOLOMB) inspired by architectures
for reading comprehension question answering systems. The model "queries"
dialogue history with descriptions of slots and services as well as possible
values of slots. This allows to transfer slot values in multi-domain dialogues
and have a capability to scale to unseen slot types. Our model achieves a joint
goal accuracy of 53.97% on the SGD dataset, outperforming the baseline model.
Related papers
- CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog
Evaluation [75.60156479374416]
CGoDial is a new challenging and comprehensive Chinese benchmark for Goal-oriented Dialog evaluation.
It contains 96,763 dialog sessions and 574,949 dialog turns totally, covering three datasets with different knowledge sources.
To bridge the gap between academic benchmarks and spoken dialog scenarios, we either collect data from real conversations or add spoken features to existing datasets via crowd-sourcing.
arXiv Detail & Related papers (2022-11-21T16:21:41Z) - SF-DST: Few-Shot Self-Feeding Reading Comprehension Dialogue State
Tracking with Auxiliary Task [17.763227077651173]
Few-shot dialogue state tracking model tracks user requests in dialogue with reliable accuracy even with a small amount of data.
Self-feeding belief state input increases the accuracy in multi-turn dialogue by summarizing previous dialogue.
New auxiliary task helps classify whether a slot is mentioned in the dialogue.
arXiv Detail & Related papers (2022-09-16T06:54:25Z) - Manual-Guided Dialogue for Flexible Conversational Agents [84.46598430403886]
How to build and use dialogue data efficiently, and how to deploy models in different domains at scale can be critical issues in building a task-oriented dialogue system.
We propose a novel manual-guided dialogue scheme, where the agent learns the tasks from both dialogue and manuals.
Our proposed scheme reduces the dependence of dialogue models on fine-grained domain ontology, and makes them more flexible to adapt to various domains.
arXiv Detail & Related papers (2022-08-16T08:21:12Z) - Multimodal Dialogue State Tracking [97.25466640240619]
Video-Dialogue Transformer Network (VDTN) learns contextual dependencies between videos and dialogues to generate multimodal dialogue states.
VDTN combines both object-level features and segment-level features and learns contextual dependencies between videos and dialogues to generate multimodal dialogue states.
arXiv Detail & Related papers (2022-06-16T03:18:42Z) - DialogZoo: Large-Scale Dialog-Oriented Task Learning [52.18193690394549]
We aim to build a unified foundation model which can solve massive diverse dialogue tasks.
To achieve this goal, we first collect a large-scale well-labeled dialogue dataset from 73 publicly available datasets.
arXiv Detail & Related papers (2022-05-25T11:17:16Z) - A Slot Is Not Built in One Utterance: Spoken Language Dialogs with
Sub-Slots [67.69407159704328]
This paper defines a new task named Sub-Slot based Task-Oriented Dialog (SSTOD)
The dataset includes a total of 40K dialogs and 500K utterances from four different domains: Chinese names, phone numbers, ID numbers and license plate numbers.
We find some new linguistic phenomena and interactive manners in SSTOD which raise critical challenges of building dialog agents for the task.
arXiv Detail & Related papers (2022-03-21T07:10:19Z) - Attention Guided Dialogue State Tracking with Sparse Supervision [5.758073912084366]
In call centers, for tasks like managing bookings or subscriptions, the user goal can be associated with actions issued by customer service agents.
These action logs are available in large volumes and can be utilized for learning dialogue states.
We extend a state-of-the-art encoder-decoder model to efficiently learn Dialogue State Tracking (DST) with sparse labels.
arXiv Detail & Related papers (2021-01-28T12:18:39Z) - CrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue
Dataset [58.910961297314415]
CrossWOZ is the first large-scale Chinese Cross-Domain Wizard-of-Oz task-oriented dataset.
It contains 6K dialogue sessions and 102K utterances for 5 domains, including hotel, restaurant, attraction, metro, and taxi.
arXiv Detail & Related papers (2020-02-27T03:06:35Z) - Domain-Aware Dialogue State Tracker for Multi-Domain Dialogue Systems [2.3859169601259347]
In task-oriented dialogue systems the dialogue state tracker (DST) component is responsible for predicting the state of the dialogue based on the dialogue history.
We propose a domain-aware dialogue state tracker that is completely data-driven and it is modeled to predict for dynamic service schemas.
arXiv Detail & Related papers (2020-01-21T13:41:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.