RESCUE-BENCH: Towards Relation-Aware Multi-Party Emotional Support Conversation Systems

• URL: http://arxiv.org/abs/2609.09657v1
• Date: Wed, 09 Sep 2026 03:14:13 GMT
• Title: RESCUE-BENCH: Towards Relation-Aware Multi-Party Emotional Support Conversation Systems
• Abstract summary: We introduce emotional support relation-aware conversation, a new task that evaluates whether LLMs can capture and utilize the evolving dynamics of relationships to offer more effective emotional support.<n>We construct RESCUE (Relation-aware Emotional Support Conversation Understanding and Evaluation Benchmark) from real couple and family interview conversations.
• Score: 20.475363299302185
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Existing emotional support conversation systems mainly focus on one-on-one seeker-supporter interactions and individual emotional states, leaving interpersonal relations in multi-party scenarios underexplored. In this work, we introduce relation-aware emotional support conversation, a new task that evaluates whether LLMs can capture and utilize the evolving dynamics of relationships to offer more effective emotional support. We construct RESCUE (Relation-aware Emotional Support Conversation Understanding and Evaluation Benchmark) from real couple and family interview conversations, containing 191 samples, 7,079 annotated turns, and 1,064.8 minutes of video. Based on rich annotations of socio-emotional and support-related dynamics, RESCUE defines six tasks that evaluate two core capabilities required for relation-aware emotional support: Relational Understanding and Relation-Sensitive Support. Experiments with ten LLMs show that current models perform relatively well on tasks relying on local emotional or intervention cues, but struggle with relation-intensive tasks such as relation pattern prediction, viewpoint prediction, and support strategy prediction. These findings reveal the limitations of current LLMs in modeling interpersonal relations and making relation-sensitive support decisions.

Related papers

• From Momentary Emotion Inference to Sustained Emotion Support: Evaluating a Companion Agent in a Longitudinal Study [10.538313417326078]
  We use theory-based emotion-regulation companion, PAIR, to examine howgenerative agents sustain emotional support.<n>Across 1,093 sessions, we paired emotion estimates with self-reports before and after guidance and analyzed logs and interviews.<n>Our findings link memory updates and retained corrections to cross-session personalization, informing future emotional support tools.
  arXiv  Detail & Related papers  (2026-09-14T21:06:59Z)
• Which LLM Is Your Ideal Companion? Evaluating Emotional Companion Capabilities of LLMs Based on Adult Attachment Theory [3.7359433892769203]
  We introduce adult attachment theory into large language models (LLMs) evaluation.<n>To evaluate emotional companionship capabilities of LLMs in realistic interaction scenarios, we present an emotional companionship benchmark, ECBench.
  arXiv  Detail & Related papers  (2026-08-13T12:32:33Z)
• ENPMR-Bench: Benchmarking Proactive Memory Retrieval for Emotional Support Agents [53.83618283684421]
  We introduce ENPMR-Bench, a benchmark for evaluating Emotional Need-aware Proactive Memory Retrieval.<n> ENPMR-Bench includes over 1,800 memory-augmented dialogues and defines structured mappings between emotional needs and supportive memory types.
  arXiv  Detail & Related papers  (2026-05-26T16:22:35Z)
• Detecting Emotional Dynamic Trajectories: An Evaluation Framework for Emotional Support in Language Models [6.810484095299127]
  Emotional support is a core capability in human-AI interaction, with applications including psychological counseling, role play, and companionship.<n>Existing evaluations of large language models (LLMs) often rely on short, static dialogues and fail to capture the dynamic and long-term nature of emotional support.<n>Our framework constructs a large-scale benchmark consisting of 328 emotional contexts and 1,152 disturbance events, simulating realistic emotional shifts under evolving dialogue scenarios.
  arXiv  Detail & Related papers  (2025-11-12T05:47:28Z)
• MME-Emotion: A Holistic Evaluation Benchmark for Emotional Intelligence in Multimodal Large Language Models [108.61337743051483]
  We present MME-Emotion, a systematic benchmark that assesses both emotional understanding and reasoning capabilities of MLLMs.<n>MME-Emotion contains over 6,000 curated video clips with task-specific questioning-answering (QA) pairs, spanning broad scenarios to formulate eight emotional tasks.<n>It incorporates a holistic evaluation suite with hybrid metrics for emotion recognition and reasoning, analyzed through a multi-agent system framework.
  arXiv  Detail & Related papers  (2025-08-11T03:14:55Z)
• IntentionESC: An Intention-Centered Framework for Enhancing Emotional Support in Dialogue Systems [74.0855067343594]
  In emotional support conversations, unclear intentions can lead supporters to employ inappropriate strategies.<n>We propose the Intention-centered Emotional Support Conversation framework.<n>It defines the possible intentions of supporters, identifies key emotional state aspects for inferring these intentions, and maps them to appropriate support strategies.
  arXiv  Detail & Related papers  (2025-06-06T10:14:49Z)
• SweetieChat: A Strategy-Enhanced Role-playing Framework for Diverse Scenarios Handling Emotional Support Agent [27.301608019492043]
  Large Language Models (LLMs) have demonstrated promising potential in providing empathetic support during interactions.<n>We propose an innovative strategy-enhanced role-playing framework, designed to simulate authentic emotional support conversations.<n>Within this framework, we develop the textbfServeForEmo dataset, comprising an extensive collection of 3.7K+ multi-turn dialogues and 62.8K+ utterances.
  arXiv  Detail & Related papers  (2024-12-11T13:56:04Z)
• Building Emotional Support Chatbots in the Era of LLMs [64.06811786616471]
  We introduce an innovative methodology that synthesizes human insights with the computational prowess of Large Language Models (LLMs) By utilizing the in-context learning potential of ChatGPT, we generate an ExTensible Emotional Support dialogue dataset, named ExTES. Following this, we deploy advanced tuning techniques on the LLaMA model, examining the impact of diverse training strategies, ultimately yielding an LLM meticulously optimized for emotional support interactions.
  arXiv  Detail & Related papers  (2023-08-17T10:49:18Z)
• Facilitating Multi-turn Emotional Support Conversation with Positive Emotion Elicitation: A Reinforcement Learning Approach [58.88422314998018]
  Emotional support conversation (ESC) aims to provide emotional support (ES) to improve one's mental state. Existing works stay at fitting grounded responses and responding strategies which ignore the effect on ES and lack explicit goals to guide emotional positive transition. We introduce a new paradigm to formalize multi-turn ESC as a process of positive emotion elicitation.
  arXiv  Detail & Related papers  (2023-07-16T09:58:44Z)
• PoKE: Prior Knowledge Enhanced Emotional Support Conversation with Latent Variable [1.5787128553734504]
  The emotional support is a critical communication skill that should be trained into dialogue systems. Most existing studies predict support strategy according to current context and provide corresponding emotional support in response. We propose Prior Knowledge Enhanced emotional support conversation with latent variable model, PoKE.
  arXiv  Detail & Related papers  (2022-10-23T07:31:24Z)
• Towards Emotional Support Dialog Systems [61.58828606097423]
  We define the Emotional Support Conversation task and propose an ESC Framework, which is grounded on the Helping Skills Theory. We construct an Emotion Support Conversation dataset (ESConv) with rich annotation (especially support strategy) in a help-seeker and supporter mode. We evaluate state-of-the-art dialog models with respect to the ability to provide emotional support.
  arXiv  Detail & Related papers  (2021-06-02T13:30:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.