We Care: Multimodal Depression Detection and Knowledge Infused Mental Health Therapeutic Response Generation

• URL: http://arxiv.org/abs/2406.10561v1
• Date: Sat, 15 Jun 2024 08:41:46 GMT
• Title: We Care: Multimodal Depression Detection and Knowledge Infused Mental Health Therapeutic Response Generation
• Abstract summary: We present the Extended D-vlog dataset, encompassing a collection of 1, 261 YouTube vlogs. We introduce a virtual agent serving as an initial contact for mental health patients, offering Cognitive Behavioral Therapy (CBT)-based responses. Our Mistral model achieved impressive scores of 70.1% and 30.9% for distortion assessment and classification, along with a Bert score of 88.7%.
• Score: 41.09752906121257
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The detection of depression through non-verbal cues has gained significant attention. Previous research predominantly centred on identifying depression within the confines of controlled laboratory environments, often with the supervision of psychologists or counsellors. Unfortunately, datasets generated in such controlled settings may struggle to account for individual behaviours in real-life situations. In response to this limitation, we present the Extended D-vlog dataset, encompassing a collection of 1, 261 YouTube vlogs. Additionally, the emergence of large language models (LLMs) like GPT3.5, and GPT4 has sparked interest in their potential they can act like mental health professionals. Yet, the readiness of these LLM models to be used in real-life settings is still a concern as they can give wrong responses that can harm the users. We introduce a virtual agent serving as an initial contact for mental health patients, offering Cognitive Behavioral Therapy (CBT)-based responses. It comprises two core functions: 1. Identifying depression in individuals, and 2. Delivering CBT-based therapeutic responses. Our Mistral model achieved impressive scores of 70.1% and 30.9% for distortion assessment and classification, along with a Bert score of 88.7%. Moreover, utilizing the TVLT model on our Multimodal Extended D-vlog Dataset yielded outstanding results, with an impressive F1-score of 67.8%

Related papers

• Reading between the Lines: Leveraging Large Language Models for Global Dementia and Depression Assessment from Clinical Interviews [17.404708771543188]
  Dementia and depression are the most prevalent neuropsychiatric disorders in geriatric populations.<n>We introduce an observer-based Global Depression Scale (GDS-D) aligned with the established Global Deterioration Scale (GDS)
  arXiv  Detail & Related papers  (2026-06-16T15:01:30Z)
• Fine-tuning LLMs for Passive Depression Severity Estimation from AI Mental Health Dialogue [4.051184721197422]
  Depression is the leading cause of disability worldwide, and early detection of symptom change is essential for timely intervention.<n>We propose a passive, continuous symptom monitoring in AI mental health platforms without requiring users to complete self-report measures.
  arXiv  Detail & Related papers  (2026-06-16T14:28:47Z)
• Predicting Neuromodulation Outcome for Parkinson's Disease with Generative Virtual Brain Model [95.41752463487008]
  Parkinson's disease affects over ten million people worldwide.<n>Inter-individual variability limits empirical treatment selection, increasing non-negligible surgical risk and cost.<n>We bridge this gap with a pretraining-finetuning framework to predict outcomes directly from resting-state fMRI.
  arXiv  Detail & Related papers  (2026-03-31T02:36:10Z)
• Depression Detection at the Point of Care: Automated Analysis of Linguistic Signals from Routine Primary Care Encounters [13.125686189457369]
  Depression is underdiagnosed in primary care, yet timely identification remains critical.<n>We investigated automated depression detection from 1,108 audio-recorded primary care encounters.
  arXiv  Detail & Related papers  (2026-03-11T21:08:55Z)
• AI-Powered Early Diagnosis of Mental Health Disorders from Real-World Clinical Conversations [7.061237517845673]
  Mental health disorders remain among the leading cause of disability worldwide.<n>Conditions such as depression, anxiety, and Post-Traumatic Stress Disorder (PTSD) are frequently underdiagnosed or misdiagnosed.<n>In primary care settings, studies show that providers misidentify depression or anxiety in over 60% of cases.
  arXiv  Detail & Related papers  (2025-10-16T17:50:04Z)
• ReDepress: A Cognitive Framework for Detecting Depression Relapse from Social Media [48.56586765769052]
  We present ReDepress, the first clinically validated social media dataset focused on relapse.<n>Our framework draws on cognitive theories of depression, incorporating constructs such as attention bias, interpretation bias, memory bias and rumination.<n>Our findings validate psychological theories in real-world textual data and underscore the potential of cognitive-informed computational methods for early relapse detection.
  arXiv  Detail & Related papers  (2025-09-22T16:33:59Z)
• DepressLLM: Interpretable domain-adapted language model for depression detection from real-world narratives [6.1211540596331755]
  This study introduces DepressLLM, trained and evaluated on a novel corpus of 3,699 autobiographical narratives reflecting both happiness and distress.<n>DepressLLM provides interpretable depression predictions and, via its Score-guided Token Probability Summation (SToPS) module, delivers both improved classification performance and reliable confidence estimates.
  arXiv  Detail & Related papers  (2025-08-12T03:12:55Z)
• A Gold Standard Dataset and Evaluation Framework for Depression Detection and Explanation in Social Media using LLMs [0.0]
  Early detection of depression from online social media posts holds promise for providing timely mental health interventions.<n>We present a high-quality, expert-annotated dataset of 1,017 social media posts labeled with depressive spans and mapped to 12 depression symptom categories.
  arXiv  Detail & Related papers  (2025-07-26T10:01:55Z)
• MoodAngels: A Retrieval-augmented Multi-agent Framework for Psychiatry Diagnosis [58.67342568632529]
  MoodAngels is the first specialized multi-agent framework for mood disorder diagnosis.<n>MoodSyn is an open-source dataset of 1,173 synthetic psychiatric cases.
  arXiv  Detail & Related papers  (2025-06-04T09:18:25Z)
• Predicting Human Depression with Hybrid Data Acquisition utilizing Physical Activity Sensing and Social Media Feeds [2.526063342028482]
  Mental disorders including depression, anxiety, and other neurological disorders pose a significant global challenge.<n>This study proposes a hybrid approach by leveraging smartphone sensor data measuring daily physical activities and analyzing their social media (Twitter) interactions.
  arXiv  Detail & Related papers  (2025-05-28T18:47:34Z)
• CBT-Bench: Evaluating Large Language Models on Assisting Cognitive Behavior Therapy [67.23830698947637]
  We propose a new benchmark, CBT-BENCH, for the systematic evaluation of cognitive behavioral therapy (CBT) assistance. We include three levels of tasks in CBT-BENCH: I: Basic CBT knowledge acquisition, with the task of multiple-choice questions; II: Cognitive model understanding, with the tasks of cognitive distortion classification, primary core belief classification, and fine-grained core belief classification; III: Therapeutic response generation, with the task of generating responses to patient speech in CBT therapy sessions. Experimental results indicate that while LLMs perform well in reciting CBT knowledge, they fall short in complex real-world scenarios
  arXiv  Detail & Related papers  (2024-10-17T04:52:57Z)
• MentalArena: Self-play Training of Language Models for Diagnosis and Treatment of Mental Health Disorders [59.515827458631975]
  Mental health disorders are one of the most serious diseases in the world. Privacy concerns limit the accessibility of personalized treatment data. MentalArena is a self-play framework to train language models.
  arXiv  Detail & Related papers  (2024-10-09T13:06:40Z)
• AI-Driven Early Mental Health Screening with Limited Data: Analyzing Selfies of Pregnant Women [32.514036618021244]
  Major Depressive Disorder and anxiety disorders affect millions globally, contributing significantly to the burden of mental health issues. Early screening is crucial for effective intervention, as timely identification of mental health issues can significantly improve treatment outcomes. This study explores the potential of AI models for ubiquitous depression-anxiety screening given face-centric selfies.
  arXiv  Detail & Related papers  (2024-10-07T19:34:25Z)
• Mental-Perceiver: Audio-Textual Multi-Modal Learning for Estimating Mental Disorders [9.222458475626652]
  Mental disorders, such as anxiety and depression, have become a global concern that affects people of all ages. Although AI-based detection methods show promise, progress is hindered by the lack of publicly available large-scale datasets. We propose Mental-Perceiver, a deep learning model for estimating mental disorders from audio and textual data.
  arXiv  Detail & Related papers  (2024-08-22T02:54:52Z)
• LMVD: A Large-Scale Multimodal Vlog Dataset for Depression Detection in the Wild [35.64843242574305]
  Large-scale multimodal vlog dataset (LMVD) for depression recognition in the wild is built. A novel architecture termed MDDformer to learn the non-verbal behaviors of individuals is proposed.
  arXiv  Detail & Related papers  (2024-05-09T01:27:10Z)
• Assessing ML Classification Algorithms and NLP Techniques for Depression Detection: An Experimental Case Study [0.6524460254566905]
  Depression has affected millions of people worldwide and has become one of the most common mental disorders. Recent research has evidenced that machine learning (ML) and Natural Language Processing (NLP) tools and techniques have significantly been used to diagnose depression. However, there are still several challenges in the assessment of depression detection approaches in which other conditions such as post-traumatic stress disorder (PTSD) are present.
  arXiv  Detail & Related papers  (2024-04-03T19:45:40Z)
• Detecting the Clinical Features of Difficult-to-Treat Depression using Synthetic Data from Large Language Models [0.20971479389679337]
  We seek to develop a Large Language Model (LLM)-based tool capable of interrogating routinely-collected, narrative (free-text) electronic health record data. We use LLM-generated synthetic data (GPT3.5) and a Non-Maximum Suppression (NMS) algorithm to train a BERT-based span extraction model. We show it is possible to obtain good overall performance (0.70 F1 across polarity) on real clinical data on a set of as many as 20 different factors, and high performance (0.85 F1 with 0.95 precision) on a subset of important DTD
  arXiv  Detail & Related papers  (2024-02-12T13:34:33Z)
• Mental Health Diagnosis in the Digital Age: Harnessing Sentiment Analysis on Social Media Platforms upon Ultra-Sparse Feature Content [3.6195994708545016]
  We propose a novel semantic feature preprocessing technique with a three-folded structure. With enhanced semantic features, we train a machine learning model to predict and classify mental disorders. Our methods, when compared to seven benchmark models, demonstrate significant performance improvements.
  arXiv  Detail & Related papers  (2023-11-09T00:15:06Z)
• Designing A Clinically Applicable Deep Recurrent Model to Identify Neuropsychiatric Symptoms in People Living with Dementia Using In-Home Monitoring Data [52.40058724040671]
  Agitation is one of the neuropsychiatric symptoms with high prevalence in dementia. Detecting agitation episodes can assist in providing People Living with Dementia (PLWD) with early and timely interventions. This preliminary study presents a supervised learning model to analyse the risk of agitation in PLWD using in-home monitoring data.
  arXiv  Detail & Related papers  (2021-10-19T11:45:01Z)
• Deep Multi-task Learning for Depression Detection and Prediction in Longitudinal Data [50.02223091927777]
  Depression is among the most prevalent mental disorders, affecting millions of people of all ages globally. Machine learning techniques have shown effective in enabling automated detection and prediction of depression for early intervention and treatment. We introduce a novel deep multi-task recurrent neural network to tackle this challenge, in which depression classification is jointly optimized with two auxiliary tasks.
  arXiv  Detail & Related papers  (2020-12-05T05:14:14Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.