An Analysis of Dialogue Repair in Virtual Voice Assistants

• URL: http://arxiv.org/abs/2307.07076v1
• Date: Thu, 13 Jul 2023 21:57:28 GMT
• Title: An Analysis of Dialogue Repair in Virtual Voice Assistants
• Authors: Matthew Carson Galbraith and Mireia G\'omez i Mart\'inez
• Abstract summary: This study examined the use of repair initiators in both English and Spanish with two popular assistants. Ultimately the data demonstrated that not only were there differences between human-assistant and human-human dialogue repair strategies, but that there were likewise differences among the assistants and the languages studied.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Language speakers often use what are known as repair initiators to mend fundamental disconnects that occur between them during verbal communication. Previous research in this field has mainly focused on the human-to-human use of repair initiator. We proposed an examination of dialogue repair structure wherein the dialogue initiator is human and the party that initiates or responds to the repair is a virtual assistant. This study examined the use of repair initiators in both English and Spanish with two popular assistants, Google Assistant and Apple's Siri. Our aim was to codify the differences, if any, in responses by voice assistants to dialogues in need of repair as compared to human-human dialogues also in need of repair. Ultimately the data demonstrated that not only were there differences between human-assistant and human-human dialogue repair strategies, but that there were likewise differences among the assistants and the languages studied.

Related papers

• "Mm, Wat?" Detecting Other-initiated Repair Requests in Dialogue [1.0616273526777913]
  This work proposes a multimodal model to automatically detect repair initiation in Dutch dialogues.<n>The results show that prosodic cues complement linguistic features and significantly improve the results of pretrained text and audio embeddings.
  arXiv  Detail & Related papers  (2025-10-28T16:58:26Z)
• SPACER: A Parallel Dataset of Speech Production And Comprehension of Error Repairs [6.987184873387818]
  We present a parallel dataset that captures how naturalistic speech errors are corrected by both speakers and comprehenders. Speakers are more likely to repair errors that introduce greater semantic and phonemic deviations, whereas comprehenders tend to correct errors that are phonemically similar to more plausible alternatives.
  arXiv  Detail & Related papers  (2025-03-20T23:12:00Z)
• Interactive Dialogue Agents via Reinforcement Learning on Hindsight Regenerations [58.65755268815283]
  Many real dialogues are interactive, meaning an agent's utterances will influence their conversational partner, elicit information, or change their opinion. We use this fact to rewrite and augment existing suboptimal data, and train via offline reinforcement learning (RL) an agent that outperforms both prompting and learning from unaltered human demonstrations. Our results in a user study with real humans show that our approach greatly outperforms existing state-of-the-art dialogue agents.
  arXiv  Detail & Related papers  (2024-11-07T21:37:51Z)
• An Analysis of Dialogue Repair in Voice Assistants [0.0]
  Spoken dialogue systems have transformed human-machine interaction by providing real-time responses to queries. This study explores the significance of interactional language in dialogue repair between virtual assistants and users. Findings reveal several assistant-generated strategies but an inability to replicate human-like repair strategies such as "huh?"
  arXiv  Detail & Related papers  (2023-11-07T12:50:11Z)
• Question-Interlocutor Scope Realized Graph Modeling over Key Utterances for Dialogue Reading Comprehension [61.55950233402972]
  We propose a new key utterances extracting method for dialogue reading comprehension. It performs prediction on the unit formed by several contiguous utterances, which can realize more answer-contained utterances. As a graph constructed on the text of utterances, we then propose Question-Interlocutor Scope Realized Graph (QuISG) modeling.
  arXiv  Detail & Related papers  (2022-10-26T04:00:42Z)
• Self-supervised Speaker Recognition Training Using Human-Machine Dialogues [22.262550043863445]
  We investigate how to pretrain speaker recognition models by leveraging dialogues between customers and smart-speaker devices. We propose an effective rejection mechanism that selectively learns from dialogues based on their acoustic homogeneity. Experiments demonstrate that the proposed method provides significant performance improvements, superior to earlier work.
  arXiv  Detail & Related papers  (2022-02-07T19:44:54Z)
• Actionable Conversational Quality Indicators for Improving Task-Oriented Dialog Systems [2.6094079735487994]
  This paper introduces and explains the use of Actionable Conversational Quality Indicators (ACQIs) ACQIs are used both to recognize parts of dialogs that can be improved, and to recommend how to improve them. We demonstrate the effectiveness of using ACQIs on LivePerson internal dialog systems used in commercial customer service applications.
  arXiv  Detail & Related papers  (2021-09-22T22:41:42Z)
• A Review of Speaker Diarization: Recent Advances with Deep Learning [78.20151731627958]
  Speaker diarization is a task to label audio or video recordings with classes corresponding to speaker identity. With the rise of deep learning technology, more rapid advancements have been made for speaker diarization. We discuss how speaker diarization systems have been integrated with speech recognition applications.
  arXiv  Detail & Related papers  (2021-01-24T01:28:05Z)
• Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialogue [76.88174667929665]
  A multi-turn dialogue is composed of multiple utterances from two or more different speaker roles. In the existing retrieval-based multi-turn dialogue modeling, the pre-trained language models (PrLMs) as encoder represent the dialogues coarsely. We propose a novel model to fill such a gap by modeling the effective utterance-aware and speaker-aware representations entailed in a dialogue history.
  arXiv  Detail & Related papers  (2020-09-14T15:07:19Z)
• Contextual Dialogue Act Classification for Open-Domain Conversational Agents [10.576497782941697]
  Classifying the general intent of the user utterance in a conversation, also known as Dialogue Act (DA), is a key step in Natural Language Understanding (NLU) for conversational agents. We propose CDAC (Contextual Dialogue Act), a simple yet effective deep learning approach for contextual dialogue act classification. We use transfer learning to adapt models trained on human-human conversations to predict dialogue acts in human-machine dialogues.
  arXiv  Detail & Related papers  (2020-05-28T06:48:10Z)
• Dialogue-Based Relation Extraction [53.2896545819799]
  We present the first human-annotated dialogue-based relation extraction (RE) dataset DialogRE. We argue that speaker-related information plays a critical role in the proposed task, based on an analysis of similarities and differences between dialogue-based and traditional RE tasks. Experimental results demonstrate that a speaker-aware extension on the best-performing model leads to gains in both the standard and conversational evaluation settings.
  arXiv  Detail & Related papers  (2020-04-17T03:51:57Z)
• TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue [113.45485470103762]
  In this work, we unify nine human-human and multi-turn task-oriented dialogue datasets for language modeling. To better model dialogue behavior during pre-training, we incorporate user and system tokens into the masked language modeling.
  arXiv  Detail & Related papers  (2020-04-15T04:09:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.