Mental-R1: Aligning LLM Reasoning for Mental Health Assessment

• URL: http://arxiv.org/abs/2606.13176v1
• Date: Thu, 11 Jun 2026 10:44:50 GMT
• Title: Mental-R1: Aligning LLM Reasoning for Mental Health Assessment
• Abstract summary: We propose Cognitive Relative Policy Optimization (CRPO), a reinforcement learning framework tailored for the mental health domain.<n>CRPO extends group relative policy optimization by integrating stage-dependent uncertainty modeling into the policy optimization process.<n>CRPO achieves an average improvement of 10.4 percentage points in weighted F1-score over the best reinforcement learning baseline.
• Score: 41.04728145197249
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Mental health problems such as anxiety, depression, and suicide remain urgent global challenges, where timely and accurate assessment is critical for effective intervention. Recently, large language models have been explored for mental health assessment. However, existing general-purpose post-training methods do not align with the cognitive processes of human assessment, which may lead to unreliable reasoning outcomes. To bridge this gap, we propose Cognitive Relative Policy Optimization (CRPO), a reinforcement learning framework tailored for the mental health domain. CRPO extends group relative policy optimization by integrating stage-dependent uncertainty modeling into the policy optimization process. Specifically, we introduce a stage-wise entropy regularization mechanism that encourages broad exploration in early reasoning phases and progressively enforces confident decision-making in later stages, mimicking the human cognitive shift from uncertainty to certainty. In addition, inspired by cognitive appraisal theory, we formalize cognitive reasoning stages, thereby guiding theory-grounded interpretable inference. Experiments on 8 mental health datasets show that CRPO achieves an average improvement of 10.4 percentage points in weighted F1-score over the best reinforcement learning baseline. Furthermore, the CRPO-trained model Mental-R1 demonstrates clear advantages compared with existing large language models on reasoning-intensive cases, suggesting that CRPO enhances reasoning capabilities for mental health assessment.

Related papers

• Measuring What Matters!! Assessing Therapeutic Principles in Mental-Health Conversation [11.873690830791022]
  We study the problem of evaluating AI-generated therapist-like responses for clinically grounded appropriateness and effectiveness.<n>We introduce FAITH-M, a benchmark annotated with expert-assigned ordinal ratings.<n>We propose CARE, a multi-stage evaluation framework that integrates intra-dialogue context, contrastive retrieval, and knowledge-distilled chain-of-thought reasoning.
  arXiv  Detail & Related papers  (2026-04-07T12:30:54Z)
• A Principle-Driven Adaptive Policy for Group Cognitive Stimulation Dialogue for Elderly with Cognitive Impairment [46.48467561674335]
  We propose a principle-driven adaptive policy actualized through a Group Cognitive Stimulation Dialogue system.<n>We first construct a dataset with over 500 hours of real-world CST conversations and 10,000+ simulated dialogues generated via our Principle-Guided Scenario Simulation strategy.<n>Our GCSD system then integrates four core modules to overcome limitations: (i) a multi-speaker context controller to resolve role confusion; (ii) a cognitive stimulation-focused attention loss to instill cognitive stimulation reasoning; and (iv) a multi-dimensional reward strategy to enhance response value.
  arXiv  Detail & Related papers  (2026-03-01T15:43:21Z)
• Responsible Evaluation of AI for Mental Health [72.85175110624736]
  Current approaches to evaluating AI tools in mental health care are fragmented and poorly aligned with clinical practice, social context, and first-hand user experience.<n>This paper argues for a rethinking of responsible evaluation by introducing an interdisciplinary framework that integrates clinical soundness, social context, and equity.
  arXiv  Detail & Related papers  (2026-01-20T12:55:10Z)
• MentraSuite: Post-Training Large Language Models for Mental Health Reasoning and Assessment [35.949107062098]
  MentraSuite is a unified framework for advancing reliable mental-health reasoning.<n>MentraBench is a benchmark spanning five core reasoning aspects, six tasks, and 13 datasets.<n>Mindora is a post-trained model optimized through a hybrid SFT-RL framework.
  arXiv  Detail & Related papers  (2025-12-10T13:26:22Z)
• Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoning [21.062242651416675]
  We propose Psyche-R1, the first Chinese psychological large language model (LLM) that jointly integrates empathy, psychological expertise, and reasoning.<n>Specifically, we design a comprehensive data synthesis pipeline that produces over 75k high-quality psychological questions paired with detailed rationales.<n>Experiment results demonstrate the effectiveness of the Psyche-R1 across several psychological benchmarks.
  arXiv  Detail & Related papers  (2025-08-14T17:18:35Z)
• Two Experts Are All You Need for Steering Thinking: Reinforcing Cognitive Effort in MoE Reasoning Models Without Additional Training [86.70255651945602]
  We introduce a novel inference-time steering methodology called Reinforcing Cognitive Experts (RICE)<n>RICE aims to improve reasoning performance without additional training or complexs.<n> Empirical evaluations with leading MoE-based LRMs demonstrate noticeable and consistent improvements in reasoning accuracy, cognitive efficiency, and cross-domain generalization.
  arXiv  Detail & Related papers  (2025-05-20T17:59:16Z)
• ProMind-LLM: Proactive Mental Health Care via Causal Reasoning with Sensor Data [5.961343130822046]
  Mental health risk is a critical global public health challenge.<n>With the development of large language models (LLMs), they stand out to be a promising tool for explainable mental health care applications.<n>This paper introduces ProMind-LLM, an innovative approach integrating objective behavior data as complementary information alongside subjective mental records.
  arXiv  Detail & Related papers  (2025-05-20T07:36:28Z)
• Ψ-Arena: Interactive Assessment and Optimization of LLM-based Psychological Counselors with Tripartite Feedback [51.26493826461026]
  We propose Psi-Arena, an interactive framework for comprehensive assessment and optimization of large language models (LLMs)<n>Arena features realistic arena interactions that simulate real-world counseling through multi-stage dialogues with psychologically profiled NPC clients.<n>Experiments across eight state-of-the-art LLMs show significant performance variations in different real-world scenarios and evaluation perspectives.
  arXiv  Detail & Related papers  (2025-05-06T08:22:51Z)
• Automated Fidelity Assessment for Strategy Training in Inpatient Rehabilitation using Natural Language Processing [53.096237570992294]
  Strategy training is a rehabilitation approach that teaches skills to reduce disability among those with cognitive impairments following a stroke. Standardized fidelity assessment is used to measure adherence to treatment principles. We developed a rule-based NLP algorithm, a long-short term memory (LSTM) model, and a bidirectional encoder representation from transformers (BERT) model for this task.
  arXiv  Detail & Related papers  (2022-09-14T15:33:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.