An Adversarial Learning based Multi-Step Spoken Language Understanding
System through Human-Computer Interaction
- URL: http://arxiv.org/abs/2106.14611v1
- Date: Sun, 6 Jun 2021 03:46:53 GMT
- Title: An Adversarial Learning based Multi-Step Spoken Language Understanding
System through Human-Computer Interaction
- Authors: Yu Wang, Yilin Shen, Hongxia Jin
- Abstract summary: We introduce a novel multi-step spoken language understanding system based on adversarial learning.
We demonstrate that the new system can improve parsing performance by at least $2.5%$ in terms of F1.
- Score: 70.25183730482915
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Most of the existing spoken language understanding systems can perform only
semantic frame parsing based on a single-round user query. They cannot take
users' feedback to update/add/remove slot values through multiround
interactions with users. In this paper, we introduce a novel multi-step spoken
language understanding system based on adversarial learning that can leverage
the multiround user's feedback to update slot values. We perform two
experiments on the benchmark ATIS dataset and demonstrate that the new system
can improve parsing performance by at least $2.5\%$ in terms of F1, with only
one round of feedback. The improvement becomes even larger when the number of
feedback rounds increases. Furthermore, we also compare the new system with
state-of-the-art dialogue state tracking systems and demonstrate that the new
interactive system can perform better on multiround spoken language
understanding tasks in terms of slot- and sentence-level accuracy.
Related papers
- Ruffle&Riley: Insights from Designing and Evaluating a Large Language Model-Based Conversational Tutoring System [21.139850269835858]
Conversational tutoring systems (CTSs) offer learning experiences through interactions based on natural language.
We discuss and evaluate a novel type of CTS that leverages recent advances in large language models (LLMs) in two ways.
The system enables AI-assisted content authoring by inducing an easily editable tutoring script automatically from a lesson text.
arXiv Detail & Related papers (2024-04-26T14:57:55Z) - Ruffle&Riley: Towards the Automated Induction of Conversational Tutoring
Systems [23.093767743306973]
Conversational tutoring systems (CTSs) offer learning experiences driven by natural language interaction.
We introduce a novel type of CTS that leverages the recent advances in large language models (LLMs) in two ways.
Ruffle&Riley allows a free-form conversation that follows the ITS-typical inner and outer loop structure.
arXiv Detail & Related papers (2023-09-26T23:27:06Z) - FCC: Fusing Conversation History and Candidate Provenance for Contextual
Response Ranking in Dialogue Systems [53.89014188309486]
We present a flexible neural framework that can integrate contextual information from multiple channels.
We evaluate our model on the MSDialog dataset widely used for evaluating conversational response ranking tasks.
arXiv Detail & Related papers (2023-03-31T23:58:28Z) - XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems
to Improve Language Understanding [73.24847320536813]
This study explores distilling visual information from pretrained multimodal transformers to pretrained language encoders.
Our framework is inspired by cross-modal encoders' success in visual-language tasks while we alter the learning objective to cater to the language-heavy characteristics of NLU.
arXiv Detail & Related papers (2022-04-15T03:44:00Z) - MeetDot: Videoconferencing with Live Translation Captions [18.60812558978417]
We present MeetDot, a videoconferencing system with live translation captions overlaid on screen.
Our system supports speech and captions in 4 languages and combines automatic speech recognition (ASR) and machine translation (MT) in a cascade.
We implement several features to enhance user experience and reduce their cognitive load, such as smooth scrolling captions and reducing caption flicker.
arXiv Detail & Related papers (2021-09-20T14:34:14Z) - Improving Conversational Question Answering Systems after Deployment
using Feedback-Weighted Learning [69.42679922160684]
We propose feedback-weighted learning based on importance sampling to improve upon an initial supervised system using binary user feedback.
Our work opens the prospect to exploit interactions with real users and improve conversational systems after deployment.
arXiv Detail & Related papers (2020-11-01T19:50:34Z) - Learning Adaptive Language Interfaces through Decomposition [89.21937539950966]
We introduce a neural semantic parsing system that learns new high-level abstractions through decomposition.
Users interactively teach the system by breaking down high-level utterances describing novel behavior into low-level steps.
arXiv Detail & Related papers (2020-10-11T08:27:07Z) - MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems [75.43457658815943]
We propose Minimalist Transfer Learning (MinTL) to simplify the system design process of task-oriented dialogue systems.
MinTL is a simple yet effective transfer learning framework, which allows us to plug-and-play pre-trained seq2seq models.
We instantiate our learning framework with two pre-trained backbones: T5 and BART, and evaluate them on MultiWOZ.
arXiv Detail & Related papers (2020-09-25T02:19:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.