Self-Supervised Embeddings for Detecting Individual Symptoms of Depression

• URL: http://arxiv.org/abs/2406.17229v1
• Date: Tue, 25 Jun 2024 02:35:37 GMT
• Title: Self-Supervised Embeddings for Detecting Individual Symptoms of Depression
• Authors: Sri Harsha Dumpala, Katerina Dikaios, Abraham Nunes, Frank Rudzicz, Rudolf Uher, Sageev Oore,
• Abstract summary: Depression, a prevalent mental health disorder impacting millions globally, demands reliable assessment systems. We leverage self-supervised learning (SSL)-based speech models to better utilize the small-sized datasets that are frequently encountered in this task. We show the significance of multi-task learning for identifying depressive symptoms effectively.
• Score: 18.43207977841643
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Depression, a prevalent mental health disorder impacting millions globally, demands reliable assessment systems. Unlike previous studies that focus solely on either detecting depression or predicting its severity, our work identifies individual symptoms of depression while also predicting its severity using speech input. We leverage self-supervised learning (SSL)-based speech models to better utilize the small-sized datasets that are frequently encountered in this task. Our study demonstrates notable performance improvements by utilizing SSL embeddings compared to conventional speech features. We compare various types of SSL pretrained models to elucidate the type of speech information (semantic, speaker, or prosodic) that contributes the most in identifying different symptoms. Additionally, we evaluate the impact of combining multiple SSL embeddings on performance. Furthermore, we show the significance of multi-task learning for identifying depressive symptoms effectively.

Related papers

• They Look Like Each Other: Case-based Reasoning for Explainable Depression Detection on Twitter using Large Language Models [3.5904920375592098]
  We introduce ProtoDep, a novel, explainable framework for Twitter-based depression detection. ProtoDep provides transparent explanations at three levels: (i) symptom-level explanations for each tweet and user, (ii) case-based explanations comparing the user to similar individuals, and (iii) transparent decision-making through classification weights.
  arXiv  Detail & Related papers  (2024-07-21T20:13:50Z)
• Exploring the Task-agnostic Trait of Self-supervised Learning in the Context of Detecting Mental Disorders [2.314534951601432]
  Self-supervised learning (SSL) has been investigated to generate task-agnostic representations across various domains. This study employs SSL models trained by predicting multiple fixed targets or masked frames. We propose a list of fixed targets to make the generated representation more efficient for detecting MDD and PTSD.
  arXiv  Detail & Related papers  (2024-03-22T12:46:58Z)
• Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting [64.80538055623842]
  sociodemographic prompting is a technique that steers the output of prompt-based models towards answers that humans with specific sociodemographic profiles would give. We show that sociodemographic information affects model predictions and can be beneficial for improving zero-shot learning in subjective NLP tasks.
  arXiv  Detail & Related papers  (2023-09-13T15:42:06Z)
• DEPAC: a Corpus for Depression and Anxiety Detection from Speech [3.2154432166999465]
  We introduce a novel mental distress analysis audio dataset DEPAC, labeled based on established thresholds on depression and anxiety screening tools. This large dataset comprises multiple speech tasks per individual, as well as relevant demographic information. We present a feature set consisting of hand-curated acoustic and linguistic features, which were found effective in identifying signs of mental illnesses in human speech.
  arXiv  Detail & Related papers  (2023-06-20T12:21:06Z)
• Handwriting and Drawing for Depression Detection: A Preliminary Study [53.11777541341063]
  Short-term covid effects on mental health were a significant increase in anxiety and depressive symptoms. The aim of this study is to use a new tool, the online handwriting and drawing analysis, to discriminate between healthy individuals and depressed patients.
  arXiv  Detail & Related papers  (2023-02-05T22:33:49Z)
• Semantic Similarity Models for Depression Severity Estimation [53.72188878602294]
  This paper presents an efficient semantic pipeline to study depression severity in individuals based on their social media writings. We use test user sentences for producing semantic rankings over an index of representative training sentences corresponding to depressive symptoms and severity levels. We evaluate our methods on two Reddit-based benchmarks, achieving 30% improvement over state of the art in terms of measuring depression severity.
  arXiv  Detail & Related papers  (2022-11-14T18:47:26Z)
• Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition? [86.53044183309824]
  We study which factor leads to the success of self-supervised learning on speaker-related tasks. Our empirical results on the Voxceleb-1 dataset suggest that the benefit of SSL to SV task is from a combination of mask speech prediction loss, data scale, and model size.
  arXiv  Detail & Related papers  (2022-04-27T08:35:57Z)
• Speech and the n-Back task as a lens into depression. How combining both may allow us to isolate different core symptoms of depression [12.251313610613693]
  We show that speech alterations are more strongly associated with subsets of key depression symptoms. We present a novel large, cross-sectional, multi-modal dataset collected at Thymia. We then present a set of experiments that highlight the association between different speech and n-Back markers at the PHQ-8 item level.
  arXiv  Detail & Related papers  (2022-03-30T09:12:59Z)
• Membership Inference Attacks Against Self-supervised Speech Models [62.73937175625953]
  Self-supervised learning (SSL) on continuous speech has started gaining attention. We present the first privacy analysis on several SSL speech models using Membership Inference Attacks (MIA) under black-box access.
  arXiv  Detail & Related papers  (2021-11-09T13:00:24Z)
• Deep Multi-task Learning for Depression Detection and Prediction in Longitudinal Data [50.02223091927777]
  Depression is among the most prevalent mental disorders, affecting millions of people of all ages globally. Machine learning techniques have shown effective in enabling automated detection and prediction of depression for early intervention and treatment. We introduce a novel deep multi-task recurrent neural network to tackle this challenge, in which depression classification is jointly optimized with two auxiliary tasks.
  arXiv  Detail & Related papers  (2020-12-05T05:14:14Z)
• Identifying Depressive Symptoms from Tweets: Figurative Language Enabled Multitask Learning Framework [6.306293318976695]
  This study aims to design and evaluate a decision support system (DSS) to reliably determine the depressive triage level. The reliable detection of depressive symptoms from tweets is challenging because the 280-character limit on tweets incentivizes the use of creative artifacts in the utterances. We propose a novel BERT based robust multi-task learning framework to accurately identify the depressive symptoms using the auxiliary task of figurative usage detection.
  arXiv  Detail & Related papers  (2020-11-12T01:17:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.