Empathy-R1: A Chain-of-Empathy and Reinforcement Learning Framework for Long-Form Mental Health Support

• URL: http://arxiv.org/abs/2509.14851v2
• Date: Fri, 19 Sep 2025 07:24:59 GMT
• Title: Empathy-R1: A Chain-of-Empathy and Reinforcement Learning Framework for Long-Form Mental Health Support
• Authors: Xianrong Yao, Dong She, Chenxu Zhang, Yimeng Zhang, Yueru Sun, Noman Ahmed, Yang Gao, Zhanpeng Jin,
• Abstract summary: We introduce Empathy-R1, a novel framework that integrates a Chain-of-Empathy (CoE) reasoning process with Reinforcement Learning (RL)<n>Inspired by cognitive-behavioral therapy, our CoE paradigm guides the model to sequentially reason about a help-seeker's emotions, causes, and intentions.<n>Our framework is empowered by a new large-scale Chinese dataset, Empathy-QA, and a two-stage training process.
• Score: 17.95060134327437
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Empathy is critical for effective mental health support, especially when addressing Long Counseling Texts (LCTs). However, existing Large Language Models (LLMs) often generate replies that are semantically fluent but lack the structured reasoning necessary for genuine psychological support, particularly in a Chinese context. To bridge this gap, we introduce Empathy-R1, a novel framework that integrates a Chain-of-Empathy (CoE) reasoning process with Reinforcement Learning (RL) to enhance response quality for LCTs. Inspired by cognitive-behavioral therapy, our CoE paradigm guides the model to sequentially reason about a help-seeker's emotions, causes, and intentions, making its thinking process both transparent and interpretable. Our framework is empowered by a new large-scale Chinese dataset, Empathy-QA, and a two-stage training process. First, Supervised Fine-Tuning instills the CoE's reasoning structure. Subsequently, RL, guided by a dedicated reward model, refines the therapeutic relevance and contextual appropriateness of the final responses. Experiments show that Empathy-R1 achieves strong performance on key automatic metrics. More importantly, human evaluations confirm its superiority, showing a clear preference over strong baselines and achieving a Win@1 rate of 44.30% on our new benchmark. By enabling interpretable and contextually nuanced responses, Empathy-R1 represents a significant advancement in developing responsible and genuinely beneficial AI for mental health support.

Related papers

• Reflecting Twice before Speaking with Empathy: Self-Reflective Alternating Inference for Empathy-Aware End-to-End Spoken Dialogue [53.95386201009769]
  We introduce EmpathyEval, a descriptive natural-language-based evaluation model for assessing empathetic quality in spoken dialogues.<n>We propose ReEmpathy, an end-to-end Spoken Language Models that enhances empathetic dialogue through a novel Empathetic Self-Reflective Alternating Inference mechanism.
  arXiv  Detail & Related papers  (2026-01-26T09:04:50Z)
• PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Models [45.377102925731826]
  Large Language Models (LLMs) are increasingly deployed in human-centric applications, yet they often fail to provide substantive emotional support.<n>We propose Psychology-grounded Empathetic Reward Modeling (PERM) to address this limitation.
  arXiv  Detail & Related papers  (2026-01-15T15:56:55Z)
• Kardia-R1: Unleashing LLMs to Reason toward Understanding and Empathy for Emotional Support via Rubric-as-Judge Reinforcement Learning [20.717092979679553]
  KardiaBench is a large-scale user-grounded benchmark comprising 178,080 QA pairs across 22,080 conversations anchored to 671 real-world profiles.<n>Kardia-R1 is a framework that trains models for interpretable, stepwise empathetic cognition.<n>Our dataset and model will be released at https://github.com/JhCircle/Kardia-R1.
  arXiv  Detail & Related papers  (2025-12-01T04:54:03Z)
• Think Socially via Cognitive Reasoning [94.60442643943696]
  We introduce Cognitive Reasoning, a paradigm modeled on human social cognition.<n>CogFlow is a complete framework that instills this capability in LLMs.
  arXiv  Detail & Related papers  (2025-09-26T16:27:29Z)
• Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoning [21.062242651416675]
  We propose Psyche-R1, the first Chinese psychological large language model (LLM) that jointly integrates empathy, psychological expertise, and reasoning.<n>Specifically, we design a comprehensive data synthesis pipeline that produces over 75k high-quality psychological questions paired with detailed rationales.<n>Experiment results demonstrate the effectiveness of the Psyche-R1 across several psychological benchmarks.
  arXiv  Detail & Related papers  (2025-08-14T17:18:35Z)
• COMPEER: Controllable Empathetic Reinforcement Reasoning for Emotional Support Conversation [47.0476311232988]
  We propose controllable empathetic reasoning, which combines natural language reasoning with structured psychological steps.<n>We employ reinforcement learning with a unified process-outcome reward model that delivers precise feedback.<n>Our approach significantly improves model's emotional support ability, advancing the development of empathetic, human-like support systems.
  arXiv  Detail & Related papers  (2025-08-13T06:09:32Z)
• IntentionESC: An Intention-Centered Framework for Enhancing Emotional Support in Dialogue Systems [74.0855067343594]
  In emotional support conversations, unclear intentions can lead supporters to employ inappropriate strategies.<n>We propose the Intention-centered Emotional Support Conversation framework.<n>It defines the possible intentions of supporters, identifies key emotional state aspects for inferring these intentions, and maps them to appropriate support strategies.
  arXiv  Detail & Related papers  (2025-06-06T10:14:49Z)
• Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Models [75.85319609088354]
  Sentient Agent as a Judge (SAGE) is an evaluation framework for large language models.<n>SAGE instantiates a Sentient Agent that simulates human-like emotional changes and inner thoughts during interaction.<n>SAGE provides a principled, scalable and interpretable tool for tracking progress toward genuinely empathetic and socially adept language agents.
  arXiv  Detail & Related papers  (2025-05-01T19:06:10Z)
• Empathy Level Alignment via Reinforcement Learning for Empathetic Response Generation [17.210469986755747]
  We propose an empathetic response generation framework using reinforcement learning (EmpRL)<n>The framework develops an effective empathy reward function and generates empathetic responses by maximizing the expected reward through reinforcement learning.<n>Both automatic and human evaluations demonstrate that the proposed EmpRL framework significantly improves the quality of generated responses.
  arXiv  Detail & Related papers  (2024-08-06T06:16:00Z)
• APTNESS: Incorporating Appraisal Theory and Emotion Support Strategies for Empathetic Response Generation [71.26755736617478]
  Empathetic response generation is designed to comprehend the emotions of others. We develop a framework that combines retrieval augmentation and emotional support strategy integration. Our framework can enhance the empathy ability of LLMs from both cognitive and affective empathy perspectives.
  arXiv  Detail & Related papers  (2024-07-23T02:23:37Z)
• CASE: Aligning Coarse-to-Fine Cognition and Affection for Empathetic Response Generation [59.8935454665427]
  Empathetic dialogue models usually consider only the affective aspect or treat cognition and affection in isolation. We propose the CASE model for empathetic dialogue generation.
  arXiv  Detail & Related papers  (2022-08-18T14:28:38Z)
• Exemplars-guided Empathetic Response Generation Controlled by the Elements of Human Communication [88.52901763928045]
  We propose an approach that relies on exemplars to cue the generative model on fine stylistic properties that signal empathy to the interlocutor. We empirically show that these approaches yield significant improvements in empathetic response quality in terms of both automated and human-evaluated metrics.
  arXiv  Detail & Related papers  (2021-06-22T14:02:33Z)
• A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Support [11.736179504987712]
  We present a computational approach to understanding how empathy is expressed in online mental health platforms. We develop a novel unifying theoretically-grounded framework for characterizing the communication of empathy in text-based conversations.
  arXiv  Detail & Related papers  (2020-09-17T17:47:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.