Mental-Perceiver: Audio-Textual Multimodal Learning for Mental Health Assessment

• URL: http://arxiv.org/abs/2408.12088v1
• Date: Thu, 22 Aug 2024 02:54:52 GMT
• Title: Mental-Perceiver: Audio-Textual Multimodal Learning for Mental Health Assessment
• Authors: Jinghui Qin, Changsong Liu, Tianchi Tang, Dahuang Liu, Minghao Wang, Qianying Huang, Yang Xu, Rumin Zhang,
• Abstract summary: Mental disorders, such as anxiety and depression, have become a global issue that affects the regular lives of people across different ages. We have constructed a new large-scale textbfMulti-textbfModal textbfPsychological assessment corpus (MMPsy) on anxiety and depression assessment of Mandarin-speaking adolescents. Our dataset contains over 7,700 post-processed recordings of interviews for anxiety assessment and over 4,200 recordings for depression assessment.
• Score: 10.584792972403596
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Mental disorders, such as anxiety and depression, have become a global issue that affects the regular lives of people across different ages. Without proper detection and treatment, anxiety and depression can hinder the sufferer's study, work, and daily life. Fortunately, recent advancements of digital and AI technologies provide new opportunities for better mental health care and many efforts have been made in developing automatic anxiety and depression assessment techniques. However, this field still lacks a publicly available large-scale dataset that can facilitate the development and evaluation of AI-based techniques. To address this limitation, we have constructed a new large-scale \textbf{M}ulti-\textbf{M}odal \textbf{Psy}chological assessment corpus (MMPsy) on anxiety and depression assessment of Mandarin-speaking adolescents. The MMPsy contains audios and extracted transcripts of responses from automated anxiety or depression assessment interviews along with the self-reported anxiety or depression evaluations of the participants using standard mental health assessment questionnaires. Our dataset contains over 7,700 post-processed recordings of interviews for anxiety assessment and over 4,200 recordings for depression assessment. Using this dataset, we have developed a novel deep-learning based mental disorder estimation model, named \textbf{Mental-Perceiver}, to detect anxious/depressive mental states from recorded audio and transcript data. Extensive experiments on our MMPsy and the commonly-used DAIC-WOZ datasets have shown the effectiveness and superiority of our proposed Mental-Perceiver model in anxiety and depression detection. The MMPsy dataset will be made publicly available later to facilitate the research and development of AI-based techniques in the mental health care field.

Related papers

• MentalArena: Self-play Training of Language Models for Diagnosis and Treatment of Mental Health Disorders [59.515827458631975]
  Mental health disorders are one of the most serious diseases in the world. Privacy concerns limit the accessibility of personalized treatment data. MentalArena is a self-play framework to train language models.
  arXiv  Detail & Related papers  (2024-10-09T13:06:40Z)
• Depression Detection and Analysis using Large Language Models on Textual and Audio-Visual Modalities [25.305909441170993]
  Depression has proven to be a significant public health issue, profoundly affecting the psychological well-being of individuals. If it remains undiagnosed, depression can lead to severe health issues, which can manifest physically and even lead to suicide.
  arXiv  Detail & Related papers  (2024-07-08T17:00:51Z)
• EmoScan: Automatic Screening of Depression Symptoms in Romanized Sinhala Tweets [0.0]
  This work explores the utilization of Romanized Sinhala social media data to identify individuals at risk of depression. A machine learning-based framework is presented for the automatic screening of depression symptoms by analyzing language patterns, sentiment, and behavioural cues.
  arXiv  Detail & Related papers  (2024-03-28T10:31:09Z)
• A Hybrid Approach for Depression Classification: Random Forest-ANN Ensemble on Motor Activity Signals [4.798808180453298]
  Wearable sensors provide a potential way to track and comprehend mental health issues. Recent research has used these sensors in conjunction with machine learning methods to identify patterns relating to different mental health conditions. We present a novel algorithm called the Hybrid Random forest - Neural network that has been tailored to evaluate sensor data from depressed patients.
  arXiv  Detail & Related papers  (2023-10-13T17:39:35Z)
• DEPAC: a Corpus for Depression and Anxiety Detection from Speech [3.2154432166999465]
  We introduce a novel mental distress analysis audio dataset DEPAC, labeled based on established thresholds on depression and anxiety screening tools. This large dataset comprises multiple speech tasks per individual, as well as relevant demographic information. We present a feature set consisting of hand-curated acoustic and linguistic features, which were found effective in identifying signs of mental illnesses in human speech.
  arXiv  Detail & Related papers  (2023-06-20T12:21:06Z)
• Handwriting and Drawing for Depression Detection: A Preliminary Study [53.11777541341063]
  Short-term covid effects on mental health were a significant increase in anxiety and depressive symptoms. The aim of this study is to use a new tool, the online handwriting and drawing analysis, to discriminate between healthy individuals and depressed patients.
  arXiv  Detail & Related papers  (2023-02-05T22:33:49Z)
• Semantic Similarity Models for Depression Severity Estimation [53.72188878602294]
  This paper presents an efficient semantic pipeline to study depression severity in individuals based on their social media writings. We use test user sentences for producing semantic rankings over an index of representative training sentences corresponding to depressive symptoms and severity levels. We evaluate our methods on two Reddit-based benchmarks, achieving 30% improvement over state of the art in terms of measuring depression severity.
  arXiv  Detail & Related papers  (2022-11-14T18:47:26Z)
• Mental Illness Classification on Social Media Texts using Deep Learning and Transfer Learning [55.653944436488786]
  According to the World health organization (WHO), approximately 450 million people are affected. Mental illnesses, such as depression, anxiety, bipolar disorder, ADHD, and PTSD. This study analyzes unstructured user data on Reddit platform and classifies five common mental illnesses: depression, anxiety, bipolar disorder, ADHD, and PTSD.
  arXiv  Detail & Related papers  (2022-07-03T11:33:52Z)
• Data set creation and empirical analysis for detecting signs of depression from social media postings [0.0]
  Depression is a common mental illness that has to be detected and treated at an early stage to avoid serious consequences. We developed a gold standard data set that detects the levels of depression as not depressed', moderately depressed' and severely depressed' from the social media postings.
  arXiv  Detail & Related papers  (2022-02-07T10:24:33Z)
• Deep Multi-task Learning for Depression Detection and Prediction in Longitudinal Data [50.02223091927777]
  Depression is among the most prevalent mental disorders, affecting millions of people of all ages globally. Machine learning techniques have shown effective in enabling automated detection and prediction of depression for early intervention and treatment. We introduce a novel deep multi-task recurrent neural network to tackle this challenge, in which depression classification is jointly optimized with two auxiliary tasks.
  arXiv  Detail & Related papers  (2020-12-05T05:14:14Z)
• Anxiety Detection Leveraging Mobile Passive Sensing [53.11661460916551]
  Anxiety disorders are the most common class of psychiatric problems affecting both children and adults. Leveraging passive and unobtrusive data collection from smartphones could be a viable alternative to classical methods. eWellness is an experimental mobile application designed to track a full-suite of sensor and user-log data off an individual's device in a continuous and passive manner.
  arXiv  Detail & Related papers  (2020-08-09T20:22:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.