Expanding the Set of Pragmatic Considerations in Conversational AI

• URL: http://arxiv.org/abs/2310.18435v1
• Date: Fri, 27 Oct 2023 19:21:50 GMT
• Title: Expanding the Set of Pragmatic Considerations in Conversational AI
• Authors: S.M. Seals, Valerie L. Shalin
• Abstract summary: We discuss several pragmatic limitations of current conversational AI systems. We label our complaints as "Turing Test Triggers" (TTTs) We develop a taxonomy of pragmatic considerations intended to identify what pragmatic competencies a conversational AI system requires.
• Score: 0.26206189324400636
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Despite considerable performance improvements, current conversational AI systems often fail to meet user expectations. We discuss several pragmatic limitations of current conversational AI systems. We illustrate pragmatic limitations with examples that are syntactically appropriate, but have clear pragmatic deficiencies. We label our complaints as "Turing Test Triggers" (TTTs) as they indicate where current conversational AI systems fall short compared to human behavior. We develop a taxonomy of pragmatic considerations intended to identify what pragmatic competencies a conversational AI system requires and discuss implications for the design and evaluation of conversational AI systems.

Related papers

• WavChat: A Survey of Spoken Dialogue Models [66.82775211793547]
  Recent advancements in spoken dialogue models, exemplified by systems like GPT-4o, have captured significant attention in the speech domain. These advanced spoken dialogue models not only comprehend audio, music, and other speech-related features, but also capture stylistic and timbral characteristics in speech. Despite the progress in spoken dialogue systems, there is a lack of comprehensive surveys that systematically organize and analyze these systems.
  arXiv  Detail & Related papers  (2024-11-15T04:16:45Z)
• Imagining and building wise machines: The centrality of AI metacognition [78.76893632793497]
  We argue that shortcomings stem from one overarching failure: AI systems lack wisdom. While AI research has focused on task-level strategies, metacognition is underdeveloped in AI systems. We propose that integrating metacognitive capabilities into AI systems is crucial for enhancing their robustness, explainability, cooperation, and safety.
  arXiv  Detail & Related papers  (2024-11-04T18:10:10Z)
• Cognition is All You Need -- The Next Layer of AI Above Large Language Models [0.0]
  We present Cognitive AI, a framework for neurosymbolic cognition outside of large language models. We propose that Cognitive AI is a necessary precursor for the evolution of the forms of AI, such as AGI, and specifically claim that AGI cannot be achieved by probabilistic approaches on their own. We conclude with a discussion of the implications for large language models, adoption cycles in AI, and commercial Cognitive AI development.
  arXiv  Detail & Related papers  (2024-03-04T16:11:57Z)
• Enabling High-Level Machine Reasoning with Cognitive Neuro-Symbolic Systems [67.01132165581667]
  We propose to enable high-level reasoning in AI systems by integrating cognitive architectures with external neuro-symbolic components. We illustrate a hybrid framework centered on ACT-R and we discuss the role of generative models in recent and future applications.
  arXiv  Detail & Related papers  (2023-11-13T21:20:17Z)
• The Language Labyrinth: Constructive Critique on the Terminology Used in the AI Discourse [0.0]
  This paper claims, that AI debates are still characterised by a lack of critical distance to metaphors like 'training', 'learning' or 'deciding' As consequence, reflections regarding responsibility or potential use-cases are greatly distorted. It is a conceptual work at the intersection of critical computer science and philosophy of language.
  arXiv  Detail & Related papers  (2023-07-18T14:32:21Z)
• DiPlomat: A Dialogue Dataset for Situated Pragmatic Reasoning [89.92601337474954]
  Pragmatic reasoning plays a pivotal role in deciphering implicit meanings that frequently arise in real-life conversations. We introduce a novel challenge, DiPlomat, aiming at benchmarking machines' capabilities on pragmatic reasoning and situated conversational understanding.
  arXiv  Detail & Related papers  (2023-06-15T10:41:23Z)
• Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration [72.04629217161656]
  This work focuses on three aspects of proactive dialogue systems: clarification, target-guided, and non-collaborative dialogues. To trigger the proactivity of LLMs, we propose the Proactive Chain-of-Thought prompting scheme.
  arXiv  Detail & Related papers  (2023-05-23T02:49:35Z)
• Discourse over Discourse: The Need for an Expanded Pragmatic Focus in Conversational AI [0.5884031187931463]
  We discuss several challenges in both summarization of conversations and other conversational AI applications. We illustrate the importance of pragmatics with so-called star sentences. Because the baseline for quality of AI is indistinguishability from human behavior, we label our complaints as "Turing Test Triggers"
  arXiv  Detail & Related papers  (2023-04-27T21:51:42Z)
• Commonsense Reasoning for Conversational AI: A Survey of the State of the Art [0.76146285961466]
  The paper lists relevant training datasets and describes the primary approaches to include commonsense in conversational AI. The paper presents preliminary observations of the limited commonsense capabilities of two state-of-the-art open dialogue models, BlenderBot3 and LaMDA.
  arXiv  Detail & Related papers  (2023-02-15T19:55:57Z)
• "How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversations [87.95711406978157]
  This work presents a new benchmark on spoken task-oriented conversations. We study multi-domain dialogue state tracking and knowledge-grounded dialogue modeling. Our data set enables speech-based benchmarking of task-oriented dialogue systems.
  arXiv  Detail & Related papers  (2021-09-28T04:51:04Z)
• Argument Schemes and Dialogue for Explainable Planning [3.2741749231824904]
  We propose an argument scheme-based approach to provide explanations in the domain of AI planning. We present novel argument schemes to create arguments that explain a plan and its key elements. We also present a novel dialogue system using the argument schemes and critical questions for providing interactive dialectical explanations.
  arXiv  Detail & Related papers  (2021-01-07T17:43:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.