ER-EDF: A Psychology-Grounded Emotion Regulation Framework for Speech Empathetic Dialogue Generation in Large Audio-Language Models

• URL: http://arxiv.org/abs/2609.15089v1
• Date: Mon, 14 Sep 2026 06:07:44 GMT
• Title: ER-EDF: A Psychology-Grounded Emotion Regulation Framework for Speech Empathetic Dialogue Generation in Large Audio-Language Models
• Abstract summary: Empathetic response generation in spoken dialogue systems requires both accurate emotion perception and appropriate emotion regulation.<n>We propose ER-EDF, a framework that explicitly decouples emotion perception and emotion regulation in large audio-language models.<n>Experiments show ER-EDF consistently improves empathetic response quality in both automatic and human evaluations.
• Score: 13.58098743681316
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Empathetic response generation in spoken dialogue systems requires both accurate emotion perception and appropriate emotion regulation. Grounded in psychological theories such as the Perception-Action Model and emotion regulation theory, effective empathy depends not only on inferring a user's affective state but also on regulating how it is expressed in responses. However, recent large audio-language models (LALMs) largely treat emotion as a direct conditioning signal, lacking explicit regulatory mechanisms, which often leads to affect mirroring rather than calibrated support. We propose ER-EDF, a psychology-grounded framework that explicitly decouples emotion perception and emotion regulation in LALMs. Perception tracks the user's emotional state, while regulation determines how this state should guide empathetic response generation. The framework is model-agnostic and integrates seamlessly into existing LALMs. We further construct a spoken empathetic dialogue dataset and introduce empathy-aware evaluation metrics beyond lexical matching. Experiments across five LALMs and two datasets show that ER-EDF consistently improves empathetic response quality in both automatic and human evaluations, highlighting the importance of jointly modeling emotion perception and regulation in spoken empathetic dialogue systems, paving a new direction for psychologically grounded empathetic AI.

Related papers

• Closing the Affective Loop: Multimodal Speaker-Listener Emotion-Dynamics-Aware Empathetic Social Robots [19.640979258341904]
  AffectLoop is a speaker-listener emotion-dynamics-aware spoken dialogue system implemented on the Misty II robot.<n>The system generates a short spoken empathetic response together with emotionally congruent embodied behavior.<n>Preliminary results suggest that explicitly modeling both speaker emotional dynamics and listener affective state can improve embodied empathetic interaction.
  arXiv  Detail & Related papers  (2026-08-17T15:08:38Z)
• Do Emotions in Prompts Matter? Effects of Emotional Framing on Large Language Models [5.079126066502806]
  Emotional tone is pervasive in human communication, yet its influence on large language model (LLM) behaviour remains unclear.<n>Here, we examine how first-person emotional framing in user-side queries affect LLM performance across six benchmark domains.<n>We introduce EmotionRL, an adaptive emotional prompting framework that selects emotional framing adaptively for each query.
  arXiv  Detail & Related papers  (2026-04-02T16:31:08Z)
• ADEPT: RL-Aligned Agentic Decoding of Emotion via Evidence Probing Tools -- From Consensus Learning to Ambiguity-Driven Emotion Reasoning [67.22219034602514]
  We introduce ADEPT (Agentic Decoding of Emotion via Evidence Probing Tools), a framework that reframes emotion recognition as a multi-turn inquiry process.<n> ADEPT transforms an SLLM into an agent that maintains an evolving candidate emotion set and adaptively invokes dedicated semantic and acoustic probing tools.<n>We show that ADEPT improves primary emotion accuracy in most settings while substantially improving minor emotion characterization.
  arXiv  Detail & Related papers  (2026-02-13T08:33:37Z)
• Reflecting Twice before Speaking with Empathy: Self-Reflective Alternating Inference for Empathy-Aware End-to-End Spoken Dialogue [53.95386201009769]
  We introduce EmpathyEval, a descriptive natural-language-based evaluation model for assessing empathetic quality in spoken dialogues.<n>We propose ReEmpathy, an end-to-end Spoken Language Models that enhances empathetic dialogue through a novel Empathetic Self-Reflective Alternating Inference mechanism.
  arXiv  Detail & Related papers  (2026-01-26T09:04:50Z)
• A Unified Spoken Language Model with Injected Emotional-Attribution Thinking for Human-like Interaction [50.05919688888947]
  This paper presents a unified spoken language model for emotional intelligence, enhanced by a novel data construction strategy termed Injected Emotional-Attribution Thinking (IEAT)<n>IEAT incorporates user emotional states and their underlying causes into the model's internal reasoning process, enabling emotion-aware reasoning to be internalized rather than treated as explicit supervision.<n> Experiments on the Human-like Spoken Dialogue Systems Challenge (HumDial) Emotional Intelligence benchmark demonstrate that the proposed approach achieves top-ranked performance across emotional trajectory modeling, emotional reasoning, and empathetic response generation.
  arXiv  Detail & Related papers  (2026-01-08T14:07:30Z)
• Do LLMs "Feel"? Emotion Circuits Discovery and Control [54.57583855608979]
  We study the internal mechanisms that give rise to emotional expression and in controlling emotions in generated text.<n>This is the first systematic study to uncover and validate emotion circuits in large language models.
  arXiv  Detail & Related papers  (2025-10-13T12:24:24Z)
• Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Models [75.85319609088354]
  Sentient Agent as a Judge (SAGE) is an evaluation framework for large language models.<n>SAGE instantiates a Sentient Agent that simulates human-like emotional changes and inner thoughts during interaction.<n>SAGE provides a principled, scalable and interpretable tool for tracking progress toward genuinely empathetic and socially adept language agents.
  arXiv  Detail & Related papers  (2025-05-01T19:06:10Z)
• From Rational Answers to Emotional Resonance: The Role of Controllable Emotion Generation in Language Models [16.350658746140788]
  Large language models (LLMs) struggle to express emotions in a consistent, controllable, and contextually appropriate manner.<n>We propose a controllable emotion generation framework based on Emotion Vectors (EVs)<n>Our method enables fine-grained, continuous modulation of emotional tone without any additional training or architectural modification.
  arXiv  Detail & Related papers  (2025-02-06T13:38:57Z)
• CTSM: Combining Trait and State Emotions for Empathetic Response Model [2.865464162057812]
  Empathetic response generation endeavors to empower dialogue systems to perceive speakers' emotions and generate empathetic responses accordingly. We propose Combining Trait and State emotions for Empathetic Response Model (CTSM) To sufficiently perceive emotions in dialogue, we first construct and encode trait and state emotion embeddings. We further enhance emotional perception capability through an emotion guidance module that guides emotion representation.
  arXiv  Detail & Related papers  (2024-03-22T10:45:13Z)
• E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation [33.57399405783864]
  We propose a novel emotion correlation enhanced empathetic dialogue generation framework. Specifically, a multi-resolution emotion graph is devised to capture context-based emotion interactions. We then propose an emotion correlation enhanced decoder, with a novel correlation-aware aggregation and soft/hard strategy.
  arXiv  Detail & Related papers  (2023-11-25T12:47:39Z)
• CASE: Aligning Coarse-to-Fine Cognition and Affection for Empathetic Response Generation [59.8935454665427]
  Empathetic dialogue models usually consider only the affective aspect or treat cognition and affection in isolation. We propose the CASE model for empathetic dialogue generation.
  arXiv  Detail & Related papers  (2022-08-18T14:28:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.