An Analysis of Dialogue Repair in Voice Assistants

• URL: http://arxiv.org/abs/2311.03952v2
• Date: Wed, 7 Feb 2024 22:10:35 GMT
• Title: An Analysis of Dialogue Repair in Voice Assistants
• Authors: Matthew Galbraith
• Abstract summary: Spoken dialogue systems have transformed human-machine interaction by providing real-time responses to queries. This study explores the significance of interactional language in dialogue repair between virtual assistants and users. Findings reveal several assistant-generated strategies but an inability to replicate human-like repair strategies such as "huh?"
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Spoken dialogue systems have transformed human-machine interaction by providing real-time responses to queries. However, misunderstandings between the user and system persist. This study explores the significance of interactional language in dialogue repair between virtual assistants and users by analyzing interactions with Google Assistant and Siri, focusing on their utilization and response to the other-initiated repair strategy "huh?" prevalent in human-human interaction. Findings reveal several assistant-generated strategies but an inability to replicate human-like repair strategies such as "huh?". English and Spanish user acceptability surveys show differences in users' repair strategy preferences and assistant usage, with both similarities and disparities among the two surveyed languages. These results shed light on inequalities between interactional language in human-human interaction and human-machine interaction, underscoring the need for further research on the impact of interactional language in human-machine interaction in English and beyond.

Related papers

• Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning [66.52010873968383]
  We introduce a conversational agent that interleaves search and reasoning across turns, enabling exploratory and adaptive behaviors learned through reinforcement learning (RL) training.<n>The experimental results across four widely used conversational benchmarks demonstrate the effectiveness of our methods.
  arXiv  Detail & Related papers  (2026-01-19T14:55:54Z)
• "Mm, Wat?" Detecting Other-initiated Repair Requests in Dialogue [1.0616273526777913]
  This work proposes a multimodal model to automatically detect repair initiation in Dutch dialogues.<n>The results show that prosodic cues complement linguistic features and significantly improve the results of pretrained text and audio embeddings.
  arXiv  Detail & Related papers  (2025-10-28T16:58:26Z)
• Relational Dissonance in Human-AI Interactions: The Case of Knowledge Work [4.678160092569168]
  We find that fundamental ontological and relational ambiguities inherent in anthropomorphic conversational agents make it difficult for individuals to maintain consistent relational stances toward them.<n>Our findings indicate that people's articulated positioning toward such agents often differs from the relational dynamics that occur during interactions.<n>We propose the concept of relational dissonance to help researchers, designers, and policymakers recognize the resulting tensions.
  arXiv  Detail & Related papers  (2025-09-19T10:15:55Z)
• UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversations [71.79210031338464]
  We show how to unify dense retrieval and response generation for large language models in conversation.<n>We conduct joint fine-tuning with different objectives and design two mechanisms to reduce the inconsistency risks.<n>The evaluations on five conversational search datasets demonstrate that our unified model can mutually improve both tasks and outperform the existing baselines.
  arXiv  Detail & Related papers  (2025-07-09T17:02:40Z)
• Understanding Learner-LLM Chatbot Interactions and the Impact of Prompting Guidelines [9.834055425277874]
  This study investigates learner-AI interactions through an educational experiment in which participants receive structured guidance on effective prompting. To assess user behavior and prompting efficacy, we analyze a dataset of 642 interactions from 107 users. Our findings provide a deeper understanding of how users engage with Large Language Models and the role of structured prompting guidance in enhancing AI-assisted communication.
  arXiv  Detail & Related papers  (2025-04-10T15:20:43Z)
• Does the Appearance of Autonomous Conversational Robots Affect User Spoken Behaviors in Real-World Conference Interactions? [19.873188667424024]
  We compare a human-like android, ERICA, with a less anthropomorphic humanoid, TELECO. The results show that participants produced fewer disfluencies and employed more complex syntax when interacting with ERICA. We conclude that designing robots to elicit more structured and fluent user speech can enhance their communicative alignment with humans.
  arXiv  Detail & Related papers  (2025-03-17T18:20:30Z)
• A Linguistic Comparison between Human and ChatGPT-Generated Conversations [9.022590646680095]
  The research employs Linguistic Inquiry and Word Count analysis, comparing ChatGPT-generated conversations with human conversations. Results show greater variability and authenticity in human dialogues, but ChatGPT excels in categories such as social processes, analytical style, cognition, attentional focus, and positive emotional tone.
  arXiv  Detail & Related papers  (2024-01-29T21:43:27Z)
• AntEval: Evaluation of Social Interaction Competencies in LLM-Driven Agents [65.16893197330589]
  Large Language Models (LLMs) have demonstrated their ability to replicate human behaviors across a wide range of scenarios. However, their capability in handling complex, multi-character social interactions has yet to be fully explored. We introduce the Multi-Agent Interaction Evaluation Framework (AntEval), encompassing a novel interaction framework and evaluation methods.
  arXiv  Detail & Related papers  (2024-01-12T11:18:00Z)
• Troubles and Failures in Interactional Language. Towards a Linguistically Informed Taxonomy [0.0]
  The goal of this talk is to introduce a systematic research agenda which aims to understand the nature of interaction between humans and artificial conversational agents (CA) Specifically, we shall take on linguistically defined variables that are known to influence the flow of conversations among humans (henceforth human-human interaction, HHI)
  arXiv  Detail & Related papers  (2023-11-13T10:24:51Z)
• A Graph-to-Text Approach to Knowledge-Grounded Response Generation in Human-Robot Interaction [2.3590037806133024]
  This paper presents a novel conversational model for human--robot interaction that rests upon a graph-based representation of the dialogue state. The neural conversational model employed to respond to user utterances relies on a simple but effective graph-to-text mechanism. The proposed approach is empirically evaluated through a user study with a humanoid robot.
  arXiv  Detail & Related papers  (2023-11-03T15:44:28Z)
• Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection [57.13665112065285]
  Human-Object Interaction (HOI) detection is a challenging computer vision task. We present a framework that enhances HOI detection by incorporating structured text knowledge.
  arXiv  Detail & Related papers  (2023-07-25T14:20:52Z)
• An Analysis of Dialogue Repair in Virtual Voice Assistants [0.0]
  This study examined the use of repair initiators in both English and Spanish with two popular assistants. Ultimately the data demonstrated that not only were there differences between human-assistant and human-human dialogue repair strategies, but that there were likewise differences among the assistants and the languages studied.
  arXiv  Detail & Related papers  (2023-07-13T21:57:28Z)
• Interactive Natural Language Processing [67.87925315773924]
  Interactive Natural Language Processing (iNLP) has emerged as a novel paradigm within the field of NLP. This paper offers a comprehensive survey of iNLP, starting by proposing a unified definition and framework of the concept.
  arXiv  Detail & Related papers  (2023-05-22T17:18:29Z)
• Solving NLP Problems through Human-System Collaboration: A Discussion-based Approach [98.13835740351932]
  This research aims to create a dataset and computational framework for systems that discuss and refine their predictions through dialogue. We show that the proposed system can have beneficial discussions with humans improving the accuracy by up to 25 points in the natural language inference task.
  arXiv  Detail & Related papers  (2023-05-19T16:24:50Z)
• Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
  We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
  arXiv  Detail & Related papers  (2022-07-20T13:37:57Z)
• Open-Ended Multi-Modal Relational Reasoning for Video Question Answering [1.8699569122464073]
  The primary focus of this agent is to assist individuals using language-based interactions within video-based scenes. Our proposed method integrates video recognition technology and natural language processing models within the robotic agent.
  arXiv  Detail & Related papers  (2020-12-01T20:49:59Z)
• Attention over Parameters for Dialogue Systems [69.48852519856331]
  We learn a dialogue system that independently parameterizes different dialogue skills, and learns to select and combine each of them through Attention over Parameters (AoP) The experimental results show that this approach achieves competitive performance on a combined dataset of MultiWOZ, In-Car Assistant, and Persona-Chat.
  arXiv  Detail & Related papers  (2020-01-07T03:10:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.