SERCNN: Stacked Embedding Recurrent Convolutional Neural Network in Detecting Depression on Twitter

• URL: http://arxiv.org/abs/2207.14535v1
• Date: Fri, 29 Jul 2022 08:08:15 GMT
• Title: SERCNN: Stacked Embedding Recurrent Convolutional Neural Network in Detecting Depression on Twitter
• Authors: Heng Ee Tay, Mei Kuan Lim, Chun Yong Chong
• Abstract summary: We propose SERCNN, which improves user representation by stacking two pretrained embeddings from different domains. Our SERCNN shows great performance over state-of-the-art and other baselines, achieving 93.7% accuracy in a 5-fold cross-validation setting. With as minimal as 10 posts per user, SERCNN performed exceptionally well with an 87% accuracy, which is on par with the BERT model.
• Score: 2.535271349350579
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Conventional approaches to identify depression are not scalable, and the public has limited awareness of mental health, especially in developing countries. As evident by recent studies, social media has the potential to complement mental health screening on a greater scale. The vast amount of first-person narrative posts in chronological order can provide insights into one's thoughts, feelings, behavior, or mood for some time, enabling a better understanding of depression symptoms reflected in the online space. In this paper, we propose SERCNN, which improves the user representation by (1) stacking two pretrained embeddings from different domains and (2) reintroducing the embedding context to the MLP classifier. Our SERCNN shows great performance over state-of-the-art and other baselines, achieving 93.7% accuracy in a 5-fold cross-validation setting. Since not all users share the same level of online activity, we introduced the concept of a fixed observation window that quantifies the observation period in a predefined number of posts. With as minimal as 10 posts per user, SERCNN performed exceptionally well with an 87% accuracy, which is on par with the BERT model, while having 98% less in the number of parameters. Our findings open up a promising direction for detecting depression on social media with a smaller number of posts for inference, towards creating solutions for a cost-effective and timely intervention. We hope that our work can bring this research area closer to real-world adoption in existing clinical practice.

Related papers

• Your Model Is Not Predicting Depression Well And That Is Why: A Case Study of PRIMATE Dataset [0.0]
  This paper addresses the quality of annotations in mental health datasets used for NLP-based depression level estimation from social media texts. Our study reveals concerns regarding annotation validity, particularly for the lack of interest or pleasure symptom. Our refined annotations, to be released under a Data Use Agreement, offer a higher-quality test set for anhedonia detection.
  arXiv  Detail & Related papers  (2024-03-01T10:47:02Z)
• Mental Health Diagnosis in the Digital Age: Harnessing Sentiment Analysis on Social Media Platforms upon Ultra-Sparse Feature Content [3.6195994708545016]
  We propose a novel semantic feature preprocessing technique with a three-folded structure. With enhanced semantic features, we train a machine learning model to predict and classify mental disorders. Our methods, when compared to seven benchmark models, demonstrate significant performance improvements.
  arXiv  Detail & Related papers  (2023-11-09T00:15:06Z)
• What Symptoms and How Long? An Interpretable AI Approach for Depression Detection in Social Media [0.5156484100374058]
  Depression is the most prevalent and serious mental illness, which induces grave financial and societal ramifications. This study contributes to IS literature with a novel interpretable deep learning model for depression detection in social media.
  arXiv  Detail & Related papers  (2023-05-18T20:15:04Z)
• Depression detection in social media posts using affective and social norm features [84.12658971655253]
  We propose a deep architecture for depression detection from social media posts. We incorporate profanity and morality features of posts and words in our architecture using a late fusion scheme. The inclusion of the proposed features yields state-of-the-art results in both settings.
  arXiv  Detail & Related papers  (2023-03-24T21:26:27Z)
• Detecting Reddit Users with Depression Using a Hybrid Neural Network SBERT-CNN [18.32536789799511]
  Depression is a widespread mental health issue, affecting an estimated 3.8% of the global population. We propose a hybrid deep learning model which combines a pretrained sentence BERT (SBERT) and convolutional neural network (CNN) to detect individuals with depression with their Reddit posts. The model achieved an accuracy of 0.86 and an F1 score of 0.86 and outperformed the state-of-the-art documented result (F1 score of 0.79) by other machine learning models in the literature.
  arXiv  Detail & Related papers  (2023-02-03T06:22:18Z)
• Semantic Similarity Models for Depression Severity Estimation [53.72188878602294]
  This paper presents an efficient semantic pipeline to study depression severity in individuals based on their social media writings. We use test user sentences for producing semantic rankings over an index of representative training sentences corresponding to depressive symptoms and severity levels. We evaluate our methods on two Reddit-based benchmarks, achieving 30% improvement over state of the art in terms of measuring depression severity.
  arXiv  Detail & Related papers  (2022-11-14T18:47:26Z)
• Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data [74.60507696087966]
  Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care. One promising data source to help monitor human behavior is daily smartphone usage. We study behavioral markers of daily mood using a recent dataset of mobile behaviors from adolescent populations at high risk of suicidal behaviors.
  arXiv  Detail & Related papers  (2021-06-24T17:46:03Z)
• Deep Multi-task Learning for Depression Detection and Prediction in Longitudinal Data [50.02223091927777]
  Depression is among the most prevalent mental disorders, affecting millions of people of all ages globally. Machine learning techniques have shown effective in enabling automated detection and prediction of depression for early intervention and treatment. We introduce a novel deep multi-task recurrent neural network to tackle this challenge, in which depression classification is jointly optimized with two auxiliary tasks.
  arXiv  Detail & Related papers  (2020-12-05T05:14:14Z)
• MET: Multimodal Perception of Engagement for Telehealth [52.54282887530756]
  We present MET, a learning-based algorithm for perceiving a human's level of engagement from videos. We release a new dataset, MEDICA, for mental health patient engagement detection.
  arXiv  Detail & Related papers  (2020-11-17T15:18:38Z)
• DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction Detection [53.40028068801092]
  We propose a novel one-stage HOI detection approach based on a new concept called interaction region for the HOI problem. Unlike previous methods, our approach concentrates on the densely sampled interaction regions across different scales for each human-object pair. In order to compensate for the detection flaws of a single interaction region, we introduce a novel voting strategy.
  arXiv  Detail & Related papers  (2020-10-02T13:57:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.