Detection of depression on social networks using transformers and ensembles

• URL: http://arxiv.org/abs/2305.05325v1
• Date: Tue, 9 May 2023 10:21:14 GMT
• Title: Detection of depression on social networks using transformers and ensembles
• Authors: Ilija Tavchioski, Marko Robnik-\v{S}ikonja, Senja Pollak
• Abstract summary: We build several large pre-trained language model based classifiers for depression detection from social media posts. We analyze the performance of our models on two data sets of posts from social platforms Reddit and Twitter.
• Score: 3.997016051942249
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: As the impact of technology on our lives is increasing, we witness increased use of social media that became an essential tool not only for communication but also for sharing information with community about our thoughts and feelings. This can be observed also for people with mental health disorders such as depression where they use social media for expressing their thoughts and asking for help. This opens a possibility to automatically process social media posts and detect signs of depression. We build several large pre-trained language model based classifiers for depression detection from social media posts. Besides fine-tuning BERT, RoBERTA, BERTweet, and mentalBERT were also construct two types of ensembles. We analyze the performance of our models on two data sets of posts from social platforms Reddit and Twitter, and investigate also the performance of transfer learning across the two data sets. The results show that transformer ensembles improve over the single transformer-based classifiers.

Related papers

• SocialBench: Sociality Evaluation of Role-Playing Conversational Agents [85.6641890712617]
  Large language models (LLMs) have advanced the development of various AI conversational agents. SocialBench is the first benchmark designed to evaluate the sociality of role-playing conversational agents at both individual and group levels. We find that agents excelling in individual level does not imply their proficiency in group level.
  arXiv  Detail & Related papers  (2024-03-20T15:38:36Z)
• ManiTweet: A New Benchmark for Identifying Manipulation of News on Social Media [74.93847489218008]
  We present a novel task, identifying manipulation of news on social media, which aims to detect manipulation in social media posts and identify manipulated or inserted information. To study this task, we have proposed a data collection schema and curated a dataset called ManiTweet, consisting of 3.6K pairs of tweets and corresponding articles. Our analysis demonstrates that this task is highly challenging, with large language models (LLMs) yielding unsatisfactory performance.
  arXiv  Detail & Related papers  (2023-05-23T16:40:07Z)
• Depression detection in social media posts using affective and social norm features [84.12658971655253]
  We propose a deep architecture for depression detection from social media posts. We incorporate profanity and morality features of posts and words in our architecture using a late fusion scheme. The inclusion of the proposed features yields state-of-the-art results in both settings.
  arXiv  Detail & Related papers  (2023-03-24T21:26:27Z)
• Machine Learning Algorithms for Depression Detection and Their Comparison [0.0]
  We have designed an automatic depression detection of online social media users by analyzing their social media behavior. The underlying classifier is made using state-of-art technology in emotional artificial intelligence.
  arXiv  Detail & Related papers  (2023-01-09T09:34:38Z)
• Semantic Similarity Models for Depression Severity Estimation [53.72188878602294]
  This paper presents an efficient semantic pipeline to study depression severity in individuals based on their social media writings. We use test user sentences for producing semantic rankings over an index of representative training sentences corresponding to depressive symptoms and severity levels. We evaluate our methods on two Reddit-based benchmarks, achieving 30% improvement over state of the art in terms of measuring depression severity.
  arXiv  Detail & Related papers  (2022-11-14T18:47:26Z)
• Adherence to Misinformation on Social Media Through Socio-Cognitive and Group-Based Processes [79.79659145328856]
  We argue that when misinformation proliferates, this happens because the social media environment enables adherence to misinformation. We make the case that polarization and misinformation adherence are closely tied.
  arXiv  Detail & Related papers  (2022-06-30T12:34:24Z)
• Data set creation and empirical analysis for detecting signs of depression from social media postings [0.0]
  Depression is a common mental illness that has to be detected and treated at an early stage to avoid serious consequences. We developed a gold standard data set that detects the levels of depression as not depressed', moderately depressed' and severely depressed' from the social media postings.
  arXiv  Detail & Related papers  (2022-02-07T10:24:33Z)
• A Psychologically Informed Part-of-Speech Analysis of Depression in Social Media [1.7188280334580193]
  We use the depression dataset from the Early Risk Prediction on the Internet Workshop (eRisk) 2018. Our results reveal statistically significant differences between the depressed and non-depressed individuals. Our work provides insights regarding the way in which depressed individuals are expressing themselves on social media platforms.
  arXiv  Detail & Related papers  (2021-07-31T16:23:22Z)
• Detection and Classification of mental illnesses on social media using RoBERTa [0.3753841394482697]
  In this work, we detect and classify five prominent kinds of mental illnesses: depression, anxiety, bipolar disorder, ADHD and PTSD. We believe that our work is the first multi-class model that uses a Transformer-based architecture such as RoBERTa to analyze people's emotions and psychology.
  arXiv  Detail & Related papers  (2020-11-23T05:54:46Z)
• Echo Chambers on Social Media: A comparative analysis [64.2256216637683]
  We introduce an operational definition of echo chambers and perform a massive comparative analysis on 1B pieces of contents produced by 1M users on four social media platforms. We infer the leaning of users about controversial topics and reconstruct their interaction networks by analyzing different features. We find support for the hypothesis that platforms implementing news feed algorithms like Facebook may elicit the emergence of echo-chambers.
  arXiv  Detail & Related papers  (2020-04-20T20:00:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.