Multitask learning for recognizing stress and depression in social media

• URL: http://arxiv.org/abs/2305.18907v2
• Date: Sun, 8 Oct 2023 13:05:26 GMT
• Title: Multitask learning for recognizing stress and depression in social media
• Authors: Loukas Ilias, Dimitris Askounis
• Abstract summary: We present two multitask learning frameworks, which use depression and stress as the main and auxiliary tasks respectively. Specifically, we use a depression dataset and a stressful dataset including stressful posts from ten subreddits of five domains. In terms of the first approach, each post passes through a shared BERT layer, which is updated by both tasks. Next, two separate BERT encoder layers are exploited, which are updated by each task separately.
• Score: 8.48487186427764
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Stress and depression are prevalent nowadays across people of all ages due to the quick paces of life. People use social media to express their feelings. Thus, social media constitute a valuable form of information for the early detection of stress and depression. Although many research works have been introduced targeting the early recognition of stress and depression, there are still limitations. There have been proposed multi-task learning settings, which use depression and emotion (or figurative language) as the primary and auxiliary tasks respectively. However, although stress is inextricably linked with depression, researchers face these two tasks as two separate tasks. To address these limitations, we present the first study, which exploits two different datasets collected under different conditions, and introduce two multitask learning frameworks, which use depression and stress as the main and auxiliary tasks respectively. Specifically, we use a depression dataset and a stressful dataset including stressful posts from ten subreddits of five domains. In terms of the first approach, each post passes through a shared BERT layer, which is updated by both tasks. Next, two separate BERT encoder layers are exploited, which are updated by each task separately. Regarding the second approach, it consists of shared and task-specific layers weighted by attention fusion networks. We conduct a series of experiments and compare our approaches with existing research initiatives, single-task learning, and transfer learning. Experiments show multiple advantages of our approaches over state-of-the-art ones.

Related papers

• Measuring Non-Typical Emotions for Mental Health: A Survey of Computational Approaches [57.486040830365646]
  Stress and depression impact the engagement in daily tasks, highlighting the need to understand their interplay. This survey is the first to simultaneously explore computational methods for analyzing stress, depression, and engagement.
  arXiv  Detail & Related papers  (2024-03-09T11:16:09Z)
• DeepLearningBrasil@LT-EDI-2023: Exploring Deep Learning Techniques for Detecting Depression in Social Media Text [0.0]
  We achieve a 47.0% Macro F1-Score and a notable 2.4% advantage in the shared task DepSign-LT-EDI@RANLP-2023. The task was to classify social media texts into three distinct levels of depression - "not depressed," "moderately depressed," and "severely depressed"
  arXiv  Detail & Related papers  (2023-11-08T22:42:31Z)
• Multitask Learning with No Regret: from Improved Confidence Bounds to Active Learning [79.07658065326592]
  Quantifying uncertainty in the estimated tasks is of pivotal importance for many downstream applications, such as online or active learning. We provide novel multitask confidence intervals in the challenging setting when neither the similarity between tasks nor the tasks' features are available to the learner. We propose a novel online learning algorithm that achieves such improved regret without knowing this parameter in advance.
  arXiv  Detail & Related papers  (2023-08-03T13:08:09Z)
• Employing Multimodal Machine Learning for Stress Detection [8.430502131775722]
  Mental wellness is one of the most neglected but crucial aspects of today's world. In this work, a multimodal AI-based framework is proposed to monitor a person's working behavior and stress levels.
  arXiv  Detail & Related papers  (2023-06-15T14:34:16Z)
• Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding [52.723297744257536]
  Pre-trained language models (LMs) have shown effectiveness in scientific literature understanding tasks. We propose a multi-task contrastive learning framework, SciMult, to facilitate common knowledge sharing across different literature understanding tasks.
  arXiv  Detail & Related papers  (2023-05-23T16:47:22Z)
• Dynamic Graph Representation Learning for Depression Screening with Transformer [13.551342607089184]
  Social media platforms present research opportunities to investigate mental health and potentially detect instances of mental illness. Existing depression detection methods are constrained due to the reliance on feature engineering and the lack of consideration for time-varying factors. We propose ContrastEgo, which treats each user as a dynamic time-evolving attributed graph (ego-network) We show that ContrastEgo significantly outperforms the state-of-the-art methods in terms of all the effectiveness metrics in various experimental settings.
  arXiv  Detail & Related papers  (2023-05-10T20:34:40Z)
• Exploring Hybrid and Ensemble Models for Multiclass Prediction of Mental Health Status on Social Media [27.799032561722893]
  We report on experiments aimed at predicting six conditions (anxiety, attention deficit hyperactivity disorder, bipolar disorder, post-traumatic stress disorder, depression, and psychological stress) from Reddit social media posts. We explore and compare the performance of hybrid and ensemble models leveraging transformer-based architectures (BERT and RoBERTa) and BiLSTM neural networks trained on within-text distributions of a diverse set of linguistic features. In addition, we conduct feature ablation experiments to investigate which types of features are most indicative of particular mental health conditions.
  arXiv  Detail & Related papers  (2022-12-19T20:31:47Z)
• Continual learning in cross-modal retrieval [47.73014647702813]
  We study how the interference caused by new tasks impacts the embedding spaces and their cross-modal alignment required for effective retrieval. We propose a general framework that decouples the training, indexing and querying stages. We also identify and study different factors that may lead to forgetting, and propose tools to alleviate it.
  arXiv  Detail & Related papers  (2021-04-14T12:13:39Z)
• Deep Multi-task Learning for Depression Detection and Prediction in Longitudinal Data [50.02223091927777]
  Depression is among the most prevalent mental disorders, affecting millions of people of all ages globally. Machine learning techniques have shown effective in enabling automated detection and prediction of depression for early intervention and treatment. We introduce a novel deep multi-task recurrent neural network to tackle this challenge, in which depression classification is jointly optimized with two auxiliary tasks.
  arXiv  Detail & Related papers  (2020-12-05T05:14:14Z)
• Continual Learning in Low-rank Orthogonal Subspaces [86.36417214618575]
  In continual learning (CL), a learner is faced with a sequence of tasks, arriving one after the other, and the goal is to remember all the tasks once the learning experience is finished. The prior art in CL uses episodic memory, parameter regularization or network structures to reduce interference among tasks, but in the end, all the approaches learn different tasks in a joint vector space. We propose to learn tasks in different (low-rank) vector subspaces that are kept orthogonal to each other in order to minimize interference.
  arXiv  Detail & Related papers  (2020-10-22T12:07:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.