Conversational Alignment with Artificial Intelligence in Context

• URL: http://arxiv.org/abs/2505.22907v1
• Date: Wed, 28 May 2025 22:14:34 GMT
• Title: Conversational Alignment with Artificial Intelligence in Context
• Authors: Rachel Katharine Sterken, James Ravi Kirkpatrick,
• Abstract summary: This article explores what it means for AI agents to be conversationally aligned to human communicative norms and practices.<n>We suggest that current large language model (LLM) architectures, constraints, and affordances may impose fundamental limitations on achieving full conversational alignment.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The development of sophisticated artificial intelligence (AI) conversational agents based on large language models raises important questions about the relationship between human norms, values, and practices and AI design and performance. This article explores what it means for AI agents to be conversationally aligned to human communicative norms and practices for handling context and common ground and proposes a new framework for evaluating developers' design choices. We begin by drawing on the philosophical and linguistic literature on conversational pragmatics to motivate a set of desiderata, which we call the CONTEXT-ALIGN framework, for conversational alignment with human communicative practices. We then suggest that current large language model (LLM) architectures, constraints, and affordances may impose fundamental limitations on achieving full conversational alignment.

Related papers

• Single Conversation Methodology: A Human-Centered Protocol for AI-Assisted Software Development [0.0]
  We propose a novel and pragmatic approach to software development using large language models (LLMs)<n>In contrast to ad hoc interactions with generative AI, SCM emphasizes a structured and persistent development dialogue.<n>We aim to reassert the active role of the developer as architect and supervisor of the intelligent tool.
  arXiv  Detail & Related papers  (2025-07-16T22:43:30Z)
• Aligning Spoken Dialogue Models from User Interactions [55.192134724622235]
  We propose a novel preference alignment framework to improve spoken dialogue models on realtime conversations from user interactions.<n>We create a dataset of more than 150,000 preference pairs from raw multi-turn speech conversations annotated with AI feedback.<n>Our findings shed light on the importance of a well-calibrated balance among various dynamics, crucial for natural real-time speech dialogue systems.
  arXiv  Detail & Related papers  (2025-06-26T16:45:20Z)
• A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions [51.96890647837277]
  Large Language Models (LLMs) have propelled conversational AI from traditional dialogue systems into sophisticated agents capable of autonomous actions, contextual awareness, and multi-turn interactions with users.<n>This survey paper presents a desideratum for next-generation Conversational Agents - what has been achieved, what challenges persist, and what must be done for more scalable systems that approach human-level intelligence.
  arXiv  Detail & Related papers  (2025-04-07T21:01:25Z)
• Towards Anthropomorphic Conversational AI Part I: A Practical Framework [49.62013440962072]
  We introduce a multi- module framework designed to replicate the key aspects of human intelligence involved in conversations.<n>In the second stage of our approach, these conversational data, after filtering and labeling, can serve as training and testing data for reinforcement learning.
  arXiv  Detail & Related papers  (2025-02-28T03:18:39Z)
• Integrating Emotional and Linguistic Models for Ethical Compliance in Large Language Models [2.5200794639628032]
  This research develops advanced methodologies for Large Language Models (LLMs) to better manage linguistic behaviors related to emotions and ethics. We introduce DIKE, an adversarial framework that enhances the LLMs' ability to internalize and reflect global human values.
  arXiv  Detail & Related papers  (2024-05-11T19:26:00Z)
• Language Models in Dialogue: Conversational Maxims for Human-AI Interactions [14.312321347152249]
  We propose a set of maxims -- quantity, quality, relevance, manner, benevolence, and transparency -- for describing effective human-AI conversation. We evaluate the degree to which various language models are able to understand these maxims and find that models possess an internal prioritization of principles that can significantly impact their ability to interpret the maxims accurately.
  arXiv  Detail & Related papers  (2024-03-22T11:16:43Z)
• DiPlomat: A Dialogue Dataset for Situated Pragmatic Reasoning [89.92601337474954]
  Pragmatic reasoning plays a pivotal role in deciphering implicit meanings that frequently arise in real-life conversations. We introduce a novel challenge, DiPlomat, aiming at benchmarking machines' capabilities on pragmatic reasoning and situated conversational understanding.
  arXiv  Detail & Related papers  (2023-06-15T10:41:23Z)
• Interactive Natural Language Processing [67.87925315773924]
  Interactive Natural Language Processing (iNLP) has emerged as a novel paradigm within the field of NLP. This paper offers a comprehensive survey of iNLP, starting by proposing a unified definition and framework of the concept.
  arXiv  Detail & Related papers  (2023-05-22T17:18:29Z)
• Discourse over Discourse: The Need for an Expanded Pragmatic Focus in Conversational AI [0.5884031187931463]
  We discuss several challenges in both summarization of conversations and other conversational AI applications. We illustrate the importance of pragmatics with so-called star sentences. Because the baseline for quality of AI is indistinguishability from human behavior, we label our complaints as "Turing Test Triggers"
  arXiv  Detail & Related papers  (2023-04-27T21:51:42Z)
• Channel-aware Decoupling Network for Multi-turn Dialogue Comprehension [81.47133615169203]
  We propose compositional learning for holistic interaction across utterances beyond the sequential contextualization from PrLMs. We employ domain-adaptive training strategies to help the model adapt to the dialogue domains. Experimental results show that our method substantially boosts the strong PrLM baselines in four public benchmark datasets.
  arXiv  Detail & Related papers  (2023-01-10T13:18:25Z)
• In conversation with Artificial Intelligence: aligning language models with human values [4.56877715768796]
  Large-scale language technologies are increasingly used in various forms of communication with humans across different contexts. One particular use case for these technologies is conversational agents, which output natural language text in response to prompts and queries. This mode of engagement raises a number of social and ethical questions. We propose a number of steps that help answer these questions.
  arXiv  Detail & Related papers  (2022-09-01T21:16:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.