Better Slow than Sorry: Introducing Positive Friction for Reliable Dialogue Systems

• URL: http://arxiv.org/abs/2501.17348v2
• Date: Fri, 31 Jan 2025 17:51:30 GMT
• Title: Better Slow than Sorry: Introducing Positive Friction for Reliable Dialogue Systems
• Authors: Mert İnan, Anthony Sicilia, Suvodip Dey, Vardhan Dongre, Tejas Srinivasan, Jesse Thomason, Gökhan Tür, Dilek Hakkani-Tür, Malihe Alikhani,
• Abstract summary: frictionless dialogue risks fostering uncritical reliance on AI outputs, which can obscure implicit assumptions. We propose integrating positive friction into conversational AI, which promotes user reflection on goals, critical thinking on system response, and subsequent re-conditioning of AI systems.
• Score: 36.88021317372274
• License:
• Abstract: While theories of discourse and cognitive science have long recognized the value of unhurried pacing, recent dialogue research tends to minimize friction in conversational systems. Yet, frictionless dialogue risks fostering uncritical reliance on AI outputs, which can obscure implicit assumptions and lead to unintended consequences. To meet this challenge, we propose integrating positive friction into conversational AI, which promotes user reflection on goals, critical thinking on system response, and subsequent re-conditioning of AI systems. We hypothesize systems can improve goal alignment, modeling of user mental states, and task success by deliberately slowing down conversations in strategic moments to ask questions, reveal assumptions, or pause. We present an ontology of positive friction and collect expert human annotations on multi-domain and embodied goal-oriented corpora. Experiments on these corpora, along with simulated interactions using state-of-the-art systems, suggest incorporating friction not only fosters accountable decision-making, but also enhances machine understanding of user beliefs and goals, and increases task success rates.

Related papers

• Who Speaks Next? Multi-party AI Discussion Leveraging the Systematics of Turn-taking in Murder Mystery Games [7.946510318969307]
  This study focuses on conversational norms such as adjacency pairs and turn-taking found in conversation analysis. We propose a new framework called "Murder Mystery Agents" that applies these norms to AI agents' dialogue control. The proposed framework integrates next speaker selection based on adjacency pairs and a self-selection mechanism.
  arXiv  Detail & Related papers  (2024-12-06T10:45:54Z)
• Exploring a Behavioral Model of "Positive Friction" in Human-AI Interaction [1.8673970128645236]
  This paper first proposes a "positive friction" model that can help characterize how friction is currently beneficial in user and developer experiences with AI. It then explores this model in the context of AI users and developers by proposing the value of taking a hybrid "AI+human" lens.
  arXiv  Detail & Related papers  (2024-02-15T03:39:55Z)
• Expanding the Set of Pragmatic Considerations in Conversational AI [0.26206189324400636]
  We discuss several pragmatic limitations of current conversational AI systems. We label our complaints as "Turing Test Triggers" (TTTs) We develop a taxonomy of pragmatic considerations intended to identify what pragmatic competencies a conversational AI system requires.
  arXiv  Detail & Related papers  (2023-10-27T19:21:50Z)
• Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration [72.04629217161656]
  This work focuses on three aspects of proactive dialogue systems: clarification, target-guided, and non-collaborative dialogues. To trigger the proactivity of LLMs, we propose the Proactive Chain-of-Thought prompting scheme.
  arXiv  Detail & Related papers  (2023-05-23T02:49:35Z)
• A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospects [100.75759050696355]
  We provide a comprehensive overview of the prominent problems and advanced designs for conversational agent's proactivity in different types of dialogues. We discuss challenges that meet the real-world application needs but require a greater research focus in the future.
  arXiv  Detail & Related papers  (2023-05-04T11:38:49Z)
• Social Influence Dialogue Systems: A Scoping Survey of the Efforts Towards Influence Capabilities of Dialogue Systems [50.57882213439553]
  Social influence dialogue systems are capable of persuasion, negotiation, and therapy. There exists no formal definition or category for dialogue systems with these skills. This study serves as a comprehensive reference for social influence dialogue systems to inspire more dedicated research and discussion in this emerging area.
  arXiv  Detail & Related papers  (2022-10-11T17:57:23Z)
• Interacting with Non-Cooperative User: A New Paradigm for Proactive Dialogue Policy [83.61404191470126]
  We propose a new solution named I-Pro that can learn Proactive policy in the Interactive setting. Specifically, we learn the trade-off via a learned goal weight, which consists of four factors. The experimental results demonstrate I-Pro significantly outperforms baselines in terms of effectiveness and interpretability.
  arXiv  Detail & Related papers  (2022-04-07T14:11:31Z)
• You Impress Me: Dialogue Generation via Mutual Persona Perception [62.89449096369027]
  The research in cognitive science suggests that understanding is an essential signal for a high-quality chit-chat conversation. Motivated by this, we propose P2 Bot, a transmitter-receiver based framework with the aim of explicitly modeling understanding.
  arXiv  Detail & Related papers  (2020-04-11T12:51:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.