Faces of the Mind: Unveiling Mental Health States Through Facial Expressions in 11,427 Adolescents

• URL: http://arxiv.org/abs/2405.20072v2
• Date: Sun, 15 Jun 2025 09:59:54 GMT
• Title: Faces of the Mind: Unveiling Mental Health States Through Facial Expressions in 11,427 Adolescents
• Authors: Xiao Xu, Xizhe Zhang, Yan Zhang,
• Abstract summary: Mood disorders such as depression and anxiety often manifest through facial expressions.<n>Existing machine learning algorithms designed to assess these disorders have been hindered by small datasets and limited real-world applicability.
• Score: 6.403533696512409
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Mood disorders such as depression and anxiety often manifest through facial expressions, but existing machine learning algorithms designed to assess these disorders have been hindered by small datasets and limited real-world applicability. To address this gap, we analyzed facial videos of 11,427 participants - a dataset two orders of magnitude larger than those used in previous studies - including standardized facial expression videos and psychological assessments of depression, anxiety, and stress. However, scaling up the dataset introduces significant challenges due to increased symptom heterogeneity, making it difficult for models to learn accurate representations. To address this, we introduced the Symptom Discrepancy Index (SDI), a novel metric for quantifying dataset heterogeneity caused by variability in individual symptoms among samples with identical total scores. By removing the 10% most heterogeneous cases as identified by the SDI, we raised the F1 scores of all models from approximately 50% to 80%. Notably, comparable performance gains were observed within both the retained and excluded subsets. These findings demonstrate symptom heterogeneity, not model capacity, as the principal bottleneck in large scale automated assessment and provide a general solution that is readily applicable to other psychometric data sets.

Related papers

• SynPAIN: A Synthetic Dataset of Pain and Non-Pain Facial Expressions [3.0806468055954737]
  Existing pain detection datasets suffer from limited ethnic/racial diversity, privacy constraints, and underrepresentation of older adults.<n>We present SynPAIN, a large-scale synthetic dataset containing 10,710 facial expression images.<n>Using commercial generative AI tools, we created demographically balanced synthetic identities with clinically meaningful pain expressions.
  arXiv  Detail & Related papers  (2025-07-25T20:54:04Z)
• Semi-supervised Clustering Through Representation Learning of Large-scale EHR Data [5.591260685112265]
  SCORE is a semi-supervised representation learning framework that captures multi-domain disease profiles through patient embeddings.<n>To handle the computational challenges of large-scale data, it introduces a hybrid Expectation-Maximization (EM) and Gaussian Variational Approximation (GVA) algorithm.<n>Our analysis shows that incorporating unlabeled data enhances accuracy and reduces sensitivity to label scarcity.
  arXiv  Detail & Related papers  (2025-05-27T05:20:17Z)
• A digital eye-fixation biomarker using a deep anomaly scheme to classify Parkisonian patterns [0.6249768559720122]
  Oculomotor alterations constitute a promising biomarker to detect and characterize Parkinson's disease (PD)<n>Recent advances on machine learning and video analysis have encouraged novel characterizations of eye movement patterns.<n>This work introduces a novel video analysis scheme to quantify Parkinsonian eye fixation patterns with an anomaly detection framework.
  arXiv  Detail & Related papers  (2025-02-25T01:34:08Z)
• Leaving Some Facial Features Behind [0.0]
  This study examines how specific facial features influence emotion classification, using facial perturbations on the Fer2013 dataset. Models trained on data with the removal of some important facial feature experienced up to an 85% accuracy drop when compared to baseline for emotions like happy and surprise.
  arXiv  Detail & Related papers  (2024-10-29T02:28:53Z)
• Large-scale digital phenotyping: identifying depression and anxiety indicators in a general UK population with over 10,000 participants [2.2909783327197393]
  We conducted a cross-sectional analysis of data from 10,129 participants recruited from a UK-based general population. Participants shared wearable (Fitbit) data and self-reported questionnaires on depression (PHQ-8), anxiety (GAD-7), and mood via a study app. We observed significant associations between the severity of depression and anxiety with several factors, including mood, age, gender, BMI, sleep patterns, physical activity, and heart rate.
  arXiv  Detail & Related papers  (2024-09-24T16:05:17Z)
• Exploring Facial Biomarkers for Depression through Temporal Analysis of Action Units [0.0]
  We analyzed facial expressions from video data of participants classified with or without depression. Results indicate significant differences in the intensities of AUs associated with sadness and happiness between the groups.
  arXiv  Detail & Related papers  (2024-07-18T17:55:01Z)
• EmoScan: Automatic Screening of Depression Symptoms in Romanized Sinhala Tweets [0.0]
  This work explores the utilization of Romanized Sinhala social media data to identify individuals at risk of depression. A machine learning-based framework is presented for the automatic screening of depression symptoms by analyzing language patterns, sentiment, and behavioural cues.
  arXiv  Detail & Related papers  (2024-03-28T10:31:09Z)
• Measuring Non-Typical Emotions for Mental Health: A Survey of Computational Approaches [57.486040830365646]
  Stress and depression impact the engagement in daily tasks, highlighting the need to understand their interplay. This survey is the first to simultaneously explore computational methods for analyzing stress, depression, and engagement.
  arXiv  Detail & Related papers  (2024-03-09T11:16:09Z)
• Mental Health Diagnosis in the Digital Age: Harnessing Sentiment Analysis on Social Media Platforms upon Ultra-Sparse Feature Content [3.6195994708545016]
  We propose a novel semantic feature preprocessing technique with a three-folded structure. With enhanced semantic features, we train a machine learning model to predict and classify mental disorders. Our methods, when compared to seven benchmark models, demonstrate significant performance improvements.
  arXiv  Detail & Related papers  (2023-11-09T00:15:06Z)
• Dynamic Graph Representation Learning for Depression Screening with Transformer [13.551342607089184]
  Social media platforms present research opportunities to investigate mental health and potentially detect instances of mental illness. Existing depression detection methods are constrained due to the reliance on feature engineering and the lack of consideration for time-varying factors. We propose ContrastEgo, which treats each user as a dynamic time-evolving attributed graph (ego-network) We show that ContrastEgo significantly outperforms the state-of-the-art methods in terms of all the effectiveness metrics in various experimental settings.
  arXiv  Detail & Related papers  (2023-05-10T20:34:40Z)
• Handwriting and Drawing for Depression Detection: A Preliminary Study [53.11777541341063]
  Short-term covid effects on mental health were a significant increase in anxiety and depressive symptoms. The aim of this study is to use a new tool, the online handwriting and drawing analysis, to discriminate between healthy individuals and depressed patients.
  arXiv  Detail & Related papers  (2023-02-05T22:33:49Z)
• Pain level and pain-related behaviour classification using GRU-based sparsely-connected RNNs [61.080598804629375]
  People with chronic pain unconsciously adapt specific body movements to protect themselves from injury or additional pain. Because there is no dedicated benchmark database to analyse this correlation, we considered one of the specific circumstances that potentially influence a person's biometrics during daily activities. We proposed a sparsely-connected recurrent neural networks (s-RNNs) ensemble with the gated recurrent unit (GRU) that incorporates multiple autoencoders. We conducted several experiments which indicate that the proposed method outperforms the state-of-the-art approaches in classifying both pain level and pain-related behaviour.
  arXiv  Detail & Related papers  (2022-12-20T12:56:28Z)
• Improving Deep Facial Phenotyping for Ultra-rare Disorder Verification Using Model Ensembles [52.77024349608834]
  We analyze the influence of replacing a DCNN with a state-of-the-art face recognition approach, iResNet with ArcFace. Our proposed ensemble model achieves state-of-the-art performance on both seen and unseen disorders.
  arXiv  Detail & Related papers  (2022-11-12T23:28:54Z)
• Bayesian Networks for the robust and unbiased prediction of depression and its symptoms utilizing speech and multimodal data [65.28160163774274]
  We apply a Bayesian framework to capture the relationships between depression, depression symptoms, and features derived from speech, facial expression and cognitive game data collected at thymia.
  arXiv  Detail & Related papers  (2022-11-09T14:48:13Z)
• CIAO! A Contrastive Adaptation Mechanism for Non-Universal Facial Expression Recognition [80.07590100872548]
  We propose Contrastive Inhibitory Adaptati On (CIAO), a mechanism that adapts the last layer of facial encoders to depict specific affective characteristics on different datasets. CIAO presents an improvement in facial expression recognition performance over six different datasets with very unique affective representations.
  arXiv  Detail & Related papers  (2022-08-10T15:46:05Z)
• The Face of Affective Disorders [7.4005714204825646]
  We study the statistical properties of facial behaviour altered by the regulation of brain arousal in the clinical domain of psychiatry. We name the presented measurement in the sense of the classical scalp based obtrusive sensors Opto Electronic Encephalography (OEG) which relies solely on modern camera based real-time signal processing and computer vision.
  arXiv  Detail & Related papers  (2022-08-02T11:28:17Z)
• The world seems different in a social context: a neural network analysis of human experimental data [57.729312306803955]
  We show that it is possible to replicate human behavioral data in both individual and social task settings by modifying the precision of prior and sensory signals. An analysis of the neural activation traces of the trained networks provides evidence that information is coded in fundamentally different ways in the network in the individual and in the social conditions.
  arXiv  Detail & Related papers  (2022-03-03T17:19:12Z)
• Bootstrapping Your Own Positive Sample: Contrastive Learning With Electronic Health Record Data [62.29031007761901]
  This paper proposes a novel contrastive regularized clinical classification model. We introduce two unique positive sampling strategies specifically tailored for EHR data. Our framework yields highly competitive experimental results in predicting the mortality risk on real-world COVID-19 EHR data.
  arXiv  Detail & Related papers  (2021-04-07T06:02:04Z)
• Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Framework [83.21732533130846]
  The paper focuses on large in-the-wild databases, i.e., Aff-Wild and Aff-Wild2. It presents the design of two classes of deep neural networks trained with these databases. A novel multi-task and holistic framework is presented which is able to jointly learn and effectively generalize and perform affect recognition.
  arXiv  Detail & Related papers  (2021-03-29T17:36:20Z)
• Deep Multi-task Learning for Depression Detection and Prediction in Longitudinal Data [50.02223091927777]
  Depression is among the most prevalent mental disorders, affecting millions of people of all ages globally. Machine learning techniques have shown effective in enabling automated detection and prediction of depression for early intervention and treatment. We introduce a novel deep multi-task recurrent neural network to tackle this challenge, in which depression classification is jointly optimized with two auxiliary tasks.
  arXiv  Detail & Related papers  (2020-12-05T05:14:14Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)
• 1-D Convlutional Neural Networks for the Analysis of Pupil Size Variations in Scotopic Conditions [79.71065005161566]
  1-D convolutional neural network models are trained for classification of short-range sequences. Model provides prediction with high average accuracy on a hold out test set.
  arXiv  Detail & Related papers  (2020-02-06T17:25:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.