Explaining GPTs' Schema of Depression: A Machine Behavior Analysis

• URL: http://arxiv.org/abs/2411.13800v2
• Date: Tue, 07 Oct 2025 05:25:18 GMT
• Title: Explaining GPTs' Schema of Depression: A Machine Behavior Analysis
• Abstract summary: We have a limited understanding of language models' schema of mental disorders.<n>We leveraged contemporary measurement theory to decode how GPT-4 and GPT-5 interrelate depressive symptoms.
• Score: 17.00942006304631
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Use of large language models such as ChatGPT (GPT-4/GPT-5) for mental health support has grown rapidly, emerging as a promising route to assess and help people with mood disorders like depression. However, we have a limited understanding of these language models' schema of mental disorders, that is, how they internally associate and interpret symptoms of such disorders. In this work, we leveraged contemporary measurement theory to decode how GPT-4 and GPT-5 interrelate depressive symptoms, providing an explanation of how LLMs apply what they learn and informing clinical applications. We found that GPT-4 (a) had strong convergent validity with standard instruments and expert judgments $(r = 0.70 - 0.81)$, and (b) behaviorally linked depression symptoms with each other (symptom inter-correlates $r = 0.23 - 0.78$) in accordance with established literature on depression; however, it (c) underemphasized the relationship between $\textit{suicidality}$ and other symptoms while overemphasizing $\textit{psychomotor symptoms}$; and (d) suggested novel hypotheses of symptom mechanisms, for instance, indicating that $\textit{sleep}$ and $\textit{fatigue}$ are broadly influenced by other depressive symptoms, while $\textit{worthlessness/guilt}$ is only tied to $\textit{depressed mood}$. GPT-5 showed a slightly lower convergence with self-report, a difference our machine-behavior analysis makes interpretable through shifts in symptom-symptom relationships. These insights provide an empirical foundation for understanding language models' mental health assessments and demonstrate a generalizable approach for explainability in other models and disorders. Our findings can guide key stakeholders to make informed decisions for effectively situating these technologies in the care system.

Related papers

• Interpretable Symptom Vectors for Depression in a Large Language Model [1.3546242205182983]
  We analyzed the residual stream of Gemma-3-27B-PT using mechanistic interpretability techniques.<n>Recording activations across symptom descriptions drawn from validated clinical instruments, we found that symptom groups geometrically separated the most.<n>Using Semantic Projection, we then projected held-out naturalistic text onto Symptom Vectors constructed from these instruments.
  arXiv  Detail & Related papers  (2026-09-01T20:07:03Z)
• Psychologically-Grounded Graph Modeling for Interpretable Depression Detection [36.72827968050813]
  We propose PsyGAT, a framework that models conversational sessions as dynamic temporal graphs.<n>We also introduce Causal-PsyGAT, an interpretability module that identifies symptom triggers.<n> Experiments show a 20% improvement in MRR for identifying causal indicators.
  arXiv  Detail & Related papers  (2026-04-27T07:27:45Z)
• DepFlow: Disentangled Speech Generation to Mitigate Semantic Bias in Depression Detection [54.209716321122194]
  We present DepFlow, a depression-conditioned text-to-speech framework.<n>A Depression Acoustic Camouflage learns speaker- and content-invariant depression embeddings through adversarial training.<n>A flow-matching TTS model with FiLM modulation injects these embeddings into synthesis, enabling control over depressive severity.<n>A prototype-based severity mapping mechanism provides smooth and interpretable manipulation across the depression continuum.
  arXiv  Detail & Related papers  (2026-01-01T10:44:38Z)
• Interpretable Neuropsychiatric Diagnosis via Concept-Guided Graph Neural Networks [56.75602443936853]
  One in five adolescents currently live with a diagnosed mental or behavioral health condition, such as anxiety, depression, or conduct disorder.<n>While prior works use graph neural network (GNN) approaches for disorder prediction, they remain black-boxes, limiting their reliability and clinical translation.<n>In this work, we propose a concept-based diagnosis framework that that encodes interpretable functional connectivity concepts.<n>Our design ensures predictions through clinically meaningful connectivity patterns, enabling both interpretability and strong predictive performance.
  arXiv  Detail & Related papers  (2025-10-02T19:38:46Z)
• ReDSM5: A Reddit Dataset for DSM-5 Depression Detection [2.677715367737641]
  Depression is a pervasive mental health condition that affects hundreds of millions of individuals worldwide.<n>ReDSM5 is a novel Reddit corpus comprising 1484 long-form posts, each exhaustively annotated at the sentence level by a licensed psychologist for the nine DSM-5 depression symptoms.<n>We conduct an exploratory analysis of the collection, examining lexical, syntactic, and emotional patterns that characterize symptom expression in social media narratives.
  arXiv  Detail & Related papers  (2025-08-05T12:48:06Z)
• Investigating Large Language Models in Inferring Personality Traits from User Conversations [5.705775078773656]
  Large Language Models (LLMs) are demonstrating remarkable human like capabilities across diverse domains. This study evaluates whether GPT-4o and GPT-4o mini, can infer Big Five personality traits and generate BFI-10 item scores from user conversations.
  arXiv  Detail & Related papers  (2025-01-13T18:09:58Z)
• MentalArena: Self-play Training of Language Models for Diagnosis and Treatment of Mental Health Disorders [59.515827458631975]
  Mental health disorders are one of the most serious diseases in the world. Privacy concerns limit the accessibility of personalized treatment data. MentalArena is a self-play framework to train language models.
  arXiv  Detail & Related papers  (2024-10-09T13:06:40Z)
• Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosis [9.738105623317601]
  We introduce AN GST, a novel, first-of-its kind benchmark for depression-anxiety comorbidity classification from social media posts. We benchmark AN GST using various state-of-the-art language models, ranging from Mental-BERT to GPT-4. While GPT-4 generally outperforms other models, none achieve an F1 score exceeding 72% in multi-class comorbid classification.
  arXiv  Detail & Related papers  (2024-10-04T20:24:11Z)
• WellDunn: On the Robustness and Explainability of Language Models and Large Language Models in Identifying Wellness Dimensions [46.60244609728416]
  Language Models (LMs) are being proposed for mental health applications where the heightened risk of adverse outcomes means predictive performance may not be a litmus test of a model's utility in clinical practice. We introduce an evaluation design that focuses on the robustness and explainability of LMs in identifying Wellness Dimensions (WDs) We reveal four surprising results about LMs/LLMs.
  arXiv  Detail & Related papers  (2024-06-17T19:50:40Z)
• Enhancing Depression-Diagnosis-Oriented Chat with Psychological State Tracking [27.96718892323191]
  Depression-diagnosis-oriented chat aims to guide patients in self-expression to collect key symptoms for depression detection.<n>Recent work focuses on combining task-oriented dialogue and chitchat to simulate the interview-based depression diagnosis.<n>No explicit framework has been explored to guide the dialogue, which results in some useless communications.
  arXiv  Detail & Related papers  (2024-03-12T07:17:01Z)
• Predicting Depression and Anxiety: A Multi-Layer Perceptron for Analyzing the Mental Health Impact of COVID-19 [1.9809980686152868]
  We introduce a multi-layer perceptron (MLP) called the COVID-19 Depression and Anxiety Predictor (CoDAP) to predict mental health trends during the COVID-19 pandemic. Our method utilizes a comprehensive dataset, which tracked mental health symptoms weekly over ten weeks during the initial COVID-19 wave (April to June 2020) in a diverse cohort of U.S. adults. This model not only predicts patterns of anxiety and depression during the pandemic but also unveils key insights into the interplay of demographic factors, behavioral changes, and social determinants of mental health.
  arXiv  Detail & Related papers  (2024-03-09T22:49:04Z)
• Computational Analysis of Stress, Depression and Engagement in Mental Health: A Survey [62.31381724639944]
  Stress and depression are interrelated and together they impact engagement in daily tasks. This survey is the first to simultaneously explore computational methods for analyzing stress, depression and engagement.
  arXiv  Detail & Related papers  (2024-03-09T11:16:09Z)
• Illuminate: A novel approach for depression detection with explainable analysis and proactive therapy using prompt engineering [0.0]
  This paper introduces a novel paradigm for depression detection and treatment using advanced Large Language Models (LLMs): Generative Pre-trained Transformer 4 (GPT-4), Llama 2 chat, and Gemini. LLMs are fine-tuned with specialized prompts to diagnose, explain, and suggest therapeutic interventions for depression.
  arXiv  Detail & Related papers  (2024-02-05T06:08:06Z)
• MASON-NLP at eRisk 2023: Deep Learning-Based Detection of Depression Symptoms from Social Media Texts [0.0]
  Depression is a mental health disorder that has a profound impact on people's lives. Recent research suggests that signs of depression can be detected in the way individuals communicate. Social media posts are a rich and convenient text source that we may examine for depressive symptoms.
  arXiv  Detail & Related papers  (2023-10-17T02:34:34Z)
• A Study on the Performance of Generative Pre-trained Transformer (GPT) in Simulating Depressed Individuals on the Standardized Depressive Symptom Scale [1.764742340693894]
  Depression is a common mental disorder with societal and economic burden. Three depression-related assessment tools (HAMD-17, SDS, GDS-15) were used. Two experiments simulated GPT responses to normal individuals and individuals with depression.
  arXiv  Detail & Related papers  (2023-07-17T15:44:13Z)
• The Relationship Between Speech Features Changes When You Get Depressed: Feature Correlations for Improving Speed and Performance of Depression Detection [69.88072583383085]
  This work shows that depression changes the correlation between features extracted from speech. Using such an insight can improve the training speed and performance of depression detectors based on SVMs and LSTMs.
  arXiv  Detail & Related papers  (2023-07-06T09:54:35Z)
• What Symptoms and How Long? An Interpretable AI Approach for Depression Detection in Social Media [0.5156484100374058]
  Depression is the most prevalent and serious mental illness, which induces grave financial and societal ramifications. This study contributes to IS literature with a novel interpretable deep learning model for depression detection in social media.
  arXiv  Detail & Related papers  (2023-05-18T20:15:04Z)
• Depression detection in social media posts using affective and social norm features [84.12658971655253]
  We propose a deep architecture for depression detection from social media posts. We incorporate profanity and morality features of posts and words in our architecture using a late fusion scheme. The inclusion of the proposed features yields state-of-the-art results in both settings.
  arXiv  Detail & Related papers  (2023-03-24T21:26:27Z)
• Handwriting and Drawing for Depression Detection: A Preliminary Study [53.11777541341063]
  Short-term covid effects on mental health were a significant increase in anxiety and depressive symptoms. The aim of this study is to use a new tool, the online handwriting and drawing analysis, to discriminate between healthy individuals and depressed patients.
  arXiv  Detail & Related papers  (2023-02-05T22:33:49Z)
• Semantic Similarity Models for Depression Severity Estimation [53.72188878602294]
  This paper presents an efficient semantic pipeline to study depression severity in individuals based on their social media writings. We use test user sentences for producing semantic rankings over an index of representative training sentences corresponding to depressive symptoms and severity levels. We evaluate our methods on two Reddit-based benchmarks, achieving 30% improvement over state of the art in terms of measuring depression severity.
  arXiv  Detail & Related papers  (2022-11-14T18:47:26Z)
• Deep Multi-task Learning for Depression Detection and Prediction in Longitudinal Data [50.02223091927777]
  Depression is among the most prevalent mental disorders, affecting millions of people of all ages globally. Machine learning techniques have shown effective in enabling automated detection and prediction of depression for early intervention and treatment. We introduce a novel deep multi-task recurrent neural network to tackle this challenge, in which depression classification is jointly optimized with two auxiliary tasks.
  arXiv  Detail & Related papers  (2020-12-05T05:14:14Z)
• Examining the Role of Mood Patterns in Predicting Self-Reported Depressive symptoms [4.564132389935269]
  Depression is the leading cause of disability worldwide. Initial efforts to detect depression signals from social media posts have shown promising results. In this work, we attempt to enrich current technology for detecting symptoms of potential depression by constructing a'mood profile' for social media users.
  arXiv  Detail & Related papers  (2020-06-14T12:48:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.