RSPC: A Benchmark for Modeling Stress and Psychiatric Conditions in Digitally Mediated Relationships using Psychiatrist Annotations

• URL: http://arxiv.org/abs/2606.27247v1
• Date: Thu, 25 Jun 2026 16:33:57 GMT
• Title: RSPC: A Benchmark for Modeling Stress and Psychiatric Conditions in Digitally Mediated Relationships using Psychiatrist Annotations
• Abstract summary: We introduce Stress Psychiatry Corpus (RSPC) containing 1,799 Reddit posts annotated by psychiatrists for diagnostic categories.<n>We benchmark seven fine-tuned transformer models and five large language models across multi-label disorder classification, trigger detection, and temporal prediction tasks.<n>Overall, RSFPC establishes a benchmark for NLP tasks that consider relational context and supports a shift from individual-centric to context-aware health modeling.
• Score: 14.966303520095563
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In NLP, mental health conditions are often modeled as isolated phenomena, without interpersonal context. We use Reddit posts about long-distance relationships to capture both mental health distress and associated relational triggers. We introduce the Relational Stress and Psychiatry Corpus (RSPC) containing 1,799 Reddit posts annotated by psychiatrists for diagnostic categories, including the most prevalent mood disorders (anxiety and depression), relational stressor triggers, and indications of relationship phase. We benchmark seven fine-tuned transformer models and five large language models across multi-label disorder classification, relational trigger detection, and temporal phase prediction tasks. We find clear task-dependent differences between model families, with Claude-3-Haiku achieving the best disorder classification performance (Macro-F1 = 0.538) and GPT-4o obtaining the strongest relational trigger detection performance (Macro-F1 = 0.519), suggesting distinct model capabilities. We further find strong associations between anxiety disorders and chronic relational uncertainty. Overall, RSPC establishes a benchmark for NLP tasks that consider relational context and supports a shift from individual-centric to context-aware mental health modeling that captures the social and temporal dynamics of distress.

Related papers

• When Symptoms Are Not Enough: Evidence-Weighting Patterns in Large Language Model Psychiatric Screening [3.840718882315825]
  We introduce a SCID-anchored benchmark of 555 semi-structured experiential interviews paired with diagnostic labels for anxiety disorder, major depressive disorder, post-traumatic stress disorder, and any current mental health disorder.<n>We evaluated whether false-negative errors reflected missed psychiatric evidence or differential weighting of symptom, functional-impairment, and protective-context cues.<n>GPT-4.1 Mini and GPT-5 Mini showed the most consistent disorder-specific accuracy.
  arXiv  Detail & Related papers  (2026-05-22T01:53:03Z)
• Predicting Neuromodulation Outcome for Parkinson's Disease with Generative Virtual Brain Model [95.41752463487008]
  Parkinson's disease affects over ten million people worldwide.<n>Inter-individual variability limits empirical treatment selection, increasing non-negligible surgical risk and cost.<n>We bridge this gap with a pretraining-finetuning framework to predict outcomes directly from resting-state fMRI.
  arXiv  Detail & Related papers  (2026-03-31T02:36:10Z)
• multiMentalRoBERTa: A Fine-tuned Multiclass Classifier for Mental Health Disorder [0.6308539010172308]
  The early detection of mental health disorders from social media text is critical for enabling timely support, risk assessment, and referral to appropriate resources.<n>This work introduces multiMentalRoBERTa, a fine-tuned RoBERTa model designed for multiclass classification of common mental health conditions.
  arXiv  Detail & Related papers  (2025-11-01T03:55:48Z)
• Tri-Modal Severity Fused Diagnosis across Depression and Post-traumatic Stress Disorders [26.208414155165432]
  Depression and post traumatic stress disorder (PTSD) often co-occur with connected symptoms, complicating automated assessment.<n>Our unified tri modal affective severity framework synchronizes interview text with sentence level transformer embeddings, audio with log Mel statistics with deltas, and facial signals with action units, gaze, head and pose descriptors.<n>Standardized features are fused via a calibrated late fusion classifier, yielding per disorder probabilities and feature-level attributions.
  arXiv  Detail & Related papers  (2025-10-23T05:46:38Z)
• Interpretable Neuropsychiatric Diagnosis via Concept-Guided Graph Neural Networks [56.75602443936853]
  One in five adolescents currently live with a diagnosed mental or behavioral health condition, such as anxiety, depression, or conduct disorder.<n>While prior works use graph neural network (GNN) approaches for disorder prediction, they remain black-boxes, limiting their reliability and clinical translation.<n>In this work, we propose a concept-based diagnosis framework that that encodes interpretable functional connectivity concepts.<n>Our design ensures predictions through clinically meaningful connectivity patterns, enabling both interpretability and strong predictive performance.
  arXiv  Detail & Related papers  (2025-10-02T19:38:46Z)
• MoodAngels: A Retrieval-augmented Multi-agent Framework for Psychiatry Diagnosis [58.67342568632529]
  MoodAngels is the first specialized multi-agent framework for mood disorder diagnosis.<n>MoodSyn is an open-source dataset of 1,173 synthetic psychiatric cases.
  arXiv  Detail & Related papers  (2025-06-04T09:18:25Z)
• MentalArena: Self-play Training of Language Models for Diagnosis and Treatment of Mental Health Disorders [59.515827458631975]
  Mental health disorders are one of the most serious diseases in the world.<n>Privacy concerns limit the accessibility of personalized treatment data.<n>MentalArena is a self-play framework to train language models.
  arXiv  Detail & Related papers  (2024-10-09T13:06:40Z)
• Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosis [9.738105623317601]
  We introduce AN GST, a novel, first-of-its kind benchmark for depression-anxiety comorbidity classification from social media posts. We benchmark AN GST using various state-of-the-art language models, ranging from Mental-BERT to GPT-4. While GPT-4 generally outperforms other models, none achieve an F1 score exceeding 72% in multi-class comorbid classification.
  arXiv  Detail & Related papers  (2024-10-04T20:24:11Z)
• LLM Questionnaire Completion for Automatic Psychiatric Assessment [49.1574468325115]
  We employ a Large Language Model (LLM) to convert unstructured psychological interviews into structured questionnaires spanning various psychiatric and personality domains. The obtained answers are coded as features, which are used to predict standardized psychiatric measures of depression (PHQ-8) and PTSD (PCL-C)
  arXiv  Detail & Related papers  (2024-06-09T09:03:11Z)
• Computational Analysis of Stress, Depression and Engagement in Mental Health: A Survey [62.31381724639944]
  Stress and depression are interrelated and together they impact engagement in daily tasks.<n>This survey is the first to simultaneously explore computational methods for analyzing stress, depression and engagement.
  arXiv  Detail & Related papers  (2024-03-09T11:16:09Z)
• Exploring Hybrid and Ensemble Models for Multiclass Prediction of Mental Health Status on Social Media [27.799032561722893]
  We report on experiments aimed at predicting six conditions (anxiety, attention deficit hyperactivity disorder, bipolar disorder, post-traumatic stress disorder, depression, and psychological stress) from Reddit social media posts. We explore and compare the performance of hybrid and ensemble models leveraging transformer-based architectures (BERT and RoBERTa) and BiLSTM neural networks trained on within-text distributions of a diverse set of linguistic features. In addition, we conduct feature ablation experiments to investigate which types of features are most indicative of particular mental health conditions.
  arXiv  Detail & Related papers  (2022-12-19T20:31:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.