AI Empathy Erodes Cognitive Autonomy in Younger Users

• URL: http://arxiv.org/abs/2603.29886v1
• Date: Sun, 08 Feb 2026 18:28:52 GMT
• Title: AI Empathy Erodes Cognitive Autonomy in Younger Users
• Abstract summary: Affective alignment in generative AI represents a systemic risk to the developmental autonomy of younger users.<n>This paper exposes the misalignment between adult-labeled reward signals and the developmental requirements of younger users.
• Score: 0.4779196219827507
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Affective alignment in generative AI represents a systemic risk to the developmental autonomy of younger users. Although emotional mirroring is commonly seen as a hallmark of advanced human-machine interaction, it can also manifest as affective sycophancy, reinforcing a user's immediate emotional state. By providing a sense of objectivity to transient anxieties, these systems diminish the cognitive friction necessary for independent emotional management and critical thought. Reward models driven by RLHF could heighten this dilemma by embedding adult-focused definitions of helpfulness, unintentionally promoting emotional dependency in younger users rather than facilitating cognitive reappraisal. This paper exposes the misalignment between adult-labeled reward signals and the developmental requirements of younger users, proposing stoic architectures that emphasize functional neutrality to preserve user autonomy.

Related papers

• Personalized Emotional Intelligence in Generative AI through Symbolic Affective Reasoning [14.469053461172626]
  We introduce Emotion-augmented geneRatiOn System (EROS), a hybrid AI framework that integrates symbolic reasoning with deep learning to enable personalized emotion augmentation through visual content.<n>EROS discovers generalizable affective rules, identifies emotion-relevant image regions, and predicts context-aware visual modifications.<n>To account for individual variability, EROS incorporates an expandable memory bank that supports inference-time personalization without model fine-tuning.
  arXiv  Detail & Related papers  (2026-07-12T09:51:37Z)
• ENPMR-Bench: Benchmarking Proactive Memory Retrieval for Emotional Support Agents [53.83618283684421]
  We introduce ENPMR-Bench, a benchmark for evaluating Emotional Need-aware Proactive Memory Retrieval.<n> ENPMR-Bench includes over 1,800 memory-augmented dialogues and defines structured mappings between emotional needs and supportive memory types.
  arXiv  Detail & Related papers  (2026-05-26T16:22:35Z)
• Technosocial risks of ideal emotion recognition technologies: A defense of the (social) value of emotional expressions [51.56484100374058]
  I argue that the appeal of such systems rests on a misunderstanding of the social functions emotional expression.<n>ERTs threaten this expressive space by collapsing epistemic friction, displacing meaning with technology-mediated affective profiles, and narrowing the space for aspirational and role-sensitive expressions.<n>I argue that, although it is intuitive to think that increasing accuracy would legitimise such systems, in the case of ERTs accuracy does not straightforwardly justify their deployment, and may, in some contexts, provide a reason for regulatory restraint.
  arXiv  Detail & Related papers  (2026-02-09T14:20:42Z)
• Visually grounded emotion regulation via diffusion models and user-driven reappraisal [0.0]
  We propose a novel, visually based augmentation of cognitive reappraisal by integrating large-scale text-to-image diffusion models into the emotional regulation process.<n>Specifically, we introduce a system in which users reinterpret emotionally negative images via spoken reappraisals.<n>This generative transformation visually instantiates users' reappraisals while maintaining structural similarity to the original stimuli, externalizing and reinforcing regulatory intent.
  arXiv  Detail & Related papers  (2025-07-14T23:28:59Z)
• Feeling Machines: Ethics, Culture, and the Rise of Emotional AI [18.212492056071657]
  This paper explores the growing presence of emotionally responsive artificial intelligence through a critical and interdisciplinary lens.<n>It explores how AI systems that simulate or interpret human emotions are reshaping our interactions in areas such as education, healthcare, mental health, caregiving, and digital life.<n>The analysis is structured around four central themes: the ethical implications of emotional AI, the cultural dynamics of human-machine interaction, the risks and opportunities for vulnerable populations, and the emerging regulatory, design, and technical considerations.
  arXiv  Detail & Related papers  (2025-06-14T10:28:26Z)
• R-CAGE: A Structural Model for Emotion Output Design in Human-AI Interaction [2.1828601975620257]
  R-CAGE is a theoretical framework for restructuring emotional output in long-term human-AI interaction.<n>By structurally regulating emotional rhythm, sensory intensity, and interpretive affordances, R-CAGE frames emotion not as performative output but as sustainable design unit.
  arXiv  Detail & Related papers  (2025-05-11T15:30:23Z)
• Narrative-Centered Emotional Reflection: Scaffolding Autonomous Emotional Literacy with AI [0.0]
  Reflexion is an AI-powered platform designed to enable structured emotional self-reflection at scale.<n>System scaffolds a progressive journey from surface-level emotional recognition toward value-aligned action planning.
  arXiv  Detail & Related papers  (2025-04-29T01:24:46Z)
• Disentangle Identity, Cooperate Emotion: Correlation-Aware Emotional Talking Portrait Generation [63.94836524433559]
  DICE-Talk is a framework for disentangling identity with emotion and cooperating emotions with similar characteristics.<n>We develop a disentangled emotion embedder that jointly models audio-visual emotional cues through cross-modal attention.<n>Second, we introduce a correlation-enhanced emotion conditioning module with learnable Emotion Banks.<n>Third, we design an emotion discrimination objective that enforces affective consistency during the diffusion process.
  arXiv  Detail & Related papers  (2025-04-25T05:28:21Z)
• Teleology-Driven Affective Computing: A Causal Framework for Sustained Well-Being [0.1636303041090359]
  We propose a teleology-driven affective computing framework that unifies major emotion theories.<n>We advocate for creating a "dataverse" of personal affective events.<n>We introduce a meta-reinforcement learning paradigm to train agents in simulated environments.
  arXiv  Detail & Related papers  (2025-02-24T14:07:53Z)
• Enabling High-Level Machine Reasoning with Cognitive Neuro-Symbolic Systems [67.01132165581667]
  We propose to enable high-level reasoning in AI systems by integrating cognitive architectures with external neuro-symbolic components. We illustrate a hybrid framework centered on ACT-R and we discuss the role of generative models in recent and future applications.
  arXiv  Detail & Related papers  (2023-11-13T21:20:17Z)
• Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interaction [55.47134146639492]
  This article proposes a unifed end-to-end neural architecture, which is capable of simultaneously encoding the semantics and the emotions in a post. Experiments on real-world data demonstrate that the proposed method outperforms the state-of-the-art methods in terms of both content coherence and emotion appropriateness.
  arXiv  Detail & Related papers  (2021-06-06T06:26:15Z)
• Disambiguating Affective Stimulus Associations for Robot Perception and Dialogue [67.89143112645556]
  We provide a NICO robot with the ability to learn the associations between a perceived auditory stimulus and an emotional expression. NICO is able to do this for both individual subjects and specific stimuli, with the aid of an emotion-driven dialogue system. The robot is then able to use this information to determine a subject's enjoyment of perceived auditory stimuli in a real HRI scenario.
  arXiv  Detail & Related papers  (2021-03-05T20:55:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.