Catching Elusive Depression via Facial Micro-Expression Recognition

• URL: http://arxiv.org/abs/2307.15862v1
• Date: Sat, 29 Jul 2023 01:51:17 GMT
• Title: Catching Elusive Depression via Facial Micro-Expression Recognition
• Authors: Xiaohui Chen and Tie Luo
• Abstract summary: Depression is a common mental health disorder that can cause consequential symptoms with continuously depressed mood. One category of depression is Concealed Depression, where patients intentionally or unintentionally hide their genuine emotions. We propose to diagnose concealed depression by using facial micro-expressions to detect and recognize underlying true emotions.
• Score: 17.236980932143855
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Depression is a common mental health disorder that can cause consequential symptoms with continuously depressed mood that leads to emotional distress. One category of depression is Concealed Depression, where patients intentionally or unintentionally hide their genuine emotions through exterior optimism, thereby complicating and delaying diagnosis and treatment and leading to unexpected suicides. In this paper, we propose to diagnose concealed depression by using facial micro-expressions (FMEs) to detect and recognize underlying true emotions. However, the extremely low intensity and subtle nature of FMEs make their recognition a tough task. We propose a facial landmark-based Region-of-Interest (ROI) approach to address the challenge, and describe a low-cost and privacy-preserving solution that enables self-diagnosis using portable mobile devices in a personal setting (e.g., at home). We present results and findings that validate our method, and discuss other technical challenges and future directions in applying such techniques to real clinical settings.

Related papers

• READ-Net: Clarifying Emotional Ambiguity via Adaptive Feature Recalibration for Audio-Visual Depression Detection [44.6096152592417]
  Depression is a severe global mental health issue that impairs daily functioning and overall quality of life.<n>We propose READ-Net, the first audio-visual depression detection framework explicitly designed to resolve Emotional Ambiguity.<n> READ-Net innovatively identifies and preserves depressive-relevant cues within emotional features, while adaptively filtering out irrelevant emotional noise.
  arXiv  Detail & Related papers  (2026-01-21T04:55:10Z)
• DepFlow: Disentangled Speech Generation to Mitigate Semantic Bias in Depression Detection [54.209716321122194]
  We present DepFlow, a depression-conditioned text-to-speech framework.<n>A Depression Acoustic Camouflage learns speaker- and content-invariant depression embeddings through adversarial training.<n>A flow-matching TTS model with FiLM modulation injects these embeddings into synthesis, enabling control over depressive severity.<n>A prototype-based severity mapping mechanism provides smooth and interpretable manipulation across the depression continuum.
  arXiv  Detail & Related papers  (2026-01-01T10:44:38Z)
• ReDepress: A Cognitive Framework for Detecting Depression Relapse from Social Media [48.56586765769052]
  We present ReDepress, the first clinically validated social media dataset focused on relapse.<n>Our framework draws on cognitive theories of depression, incorporating constructs such as attention bias, interpretation bias, memory bias and rumination.<n>Our findings validate psychological theories in real-world textual data and underscore the potential of cognitive-informed computational methods for early relapse detection.
  arXiv  Detail & Related papers  (2025-09-22T16:33:59Z)
• CAST-Phys: Contactless Affective States Through Physiological signals Database [74.28082880875368]
  The lack of affective multi-modal datasets remains a major bottleneck in developing accurate emotion recognition systems.<n>We present the Contactless Affective States Through Physiological Signals Database (CAST-Phys), a novel high-quality dataset capable of remote physiological emotion recognition.<n>Our analysis highlights the crucial role of physiological signals in realistic scenarios where facial expressions alone may not provide sufficient emotional information.
  arXiv  Detail & Related papers  (2025-07-08T15:20:24Z)
• Neural Responses to Affective Sentences Reveal Signatures of Depression [18.304785509577766]
  Major Depressive Disorder (MDD) is a highly prevalent mental health condition, and a deeper understanding of its neurocognitive foundations is essential.<n>We investigate how depression alters the temporal dynamics of emotional processing by measuring neural responses to self-referential affective sentences.<n>Our results reveal significant group-level differences in neural activity during sentence viewing, suggesting disrupted integration of emotional and self-referential information in depression.
  arXiv  Detail & Related papers  (2025-06-06T17:09:08Z)
• Disentangle Identity, Cooperate Emotion: Correlation-Aware Emotional Talking Portrait Generation [63.94836524433559]
  DICE-Talk is a framework for disentangling identity with emotion and cooperating emotions with similar characteristics. We develop a disentangled emotion embedder that jointly models audio-visual emotional cues through cross-modal attention. Second, we introduce a correlation-enhanced emotion conditioning module with learnable Emotion Banks. Third, we design an emotion discrimination objective that enforces affective consistency during the diffusion process.
  arXiv  Detail & Related papers  (2025-04-25T05:28:21Z)
• Towards Privacy-aware Mental Health AI Models: Advances, Challenges, and Opportunities [61.633126163190724]
  Mental illness is a widespread and debilitating condition with substantial societal and personal costs. Recent advances in Artificial Intelligence (AI) hold great potential for recognizing and addressing conditions such as depression, anxiety disorder, bipolar disorder, schizophrenia, and post-traumatic stress disorder. Privacy concerns, including the risk of sensitive data leakage from datasets and trained models, remain a critical barrier to deploying these AI systems in real-world clinical settings.
  arXiv  Detail & Related papers  (2025-02-01T15:10:02Z)
• Investigating Acoustic-Textual Emotional Inconsistency Information for Automatic Depression Detection [18.797661194307683]
  Previous studies have demonstrated that emotional features from a single acoustic sentiment label can enhance depression diagnosis accuracy. Individuals with depression might convey negative emotional content in an unexpectedly calm manner. This work is the first to incorporate emotional expression inconsistency information into depression detection.
  arXiv  Detail & Related papers  (2024-12-09T02:52:52Z)
• Enhancing Depression-Diagnosis-Oriented Chat with Psychological State Tracking [27.96718892323191]
  Depression-diagnosis-oriented chat aims to guide patients in self-expression to collect key symptoms for depression detection. Recent work focuses on combining task-oriented dialogue and chitchat to simulate the interview-based depression diagnosis. No explicit framework has been explored to guide the dialogue, which results in some useless communications.
  arXiv  Detail & Related papers  (2024-03-12T07:17:01Z)
• Measuring Non-Typical Emotions for Mental Health: A Survey of Computational Approaches [57.486040830365646]
  Stress and depression impact the engagement in daily tasks, highlighting the need to understand their interplay. This survey is the first to simultaneously explore computational methods for analyzing stress, depression, and engagement.
  arXiv  Detail & Related papers  (2024-03-09T11:16:09Z)
• CauESC: A Causal Aware Model for Emotional Support Conversation [79.4451588204647]
  Existing approaches ignore the emotion causes of the distress. They focus on the seeker's own mental state rather than the emotional dynamics during interaction between speakers. We propose a novel framework CauESC, which firstly recognizes the emotion causes of the distress, as well as the emotion effects triggered by the causes.
  arXiv  Detail & Related papers  (2024-01-31T11:30:24Z)
• Empowering Psychotherapy with Large Language Models: Cognitive Distortion Detection through Diagnosis of Thought Prompting [82.64015366154884]
  We study the task of cognitive distortion detection and propose the Diagnosis of Thought (DoT) prompting. DoT performs diagnosis on the patient's speech via three stages: subjectivity assessment to separate the facts and the thoughts; contrastive reasoning to elicit the reasoning processes supporting and contradicting the thoughts; and schema analysis to summarize the cognition schemas. Experiments demonstrate that DoT obtains significant improvements over ChatGPT for cognitive distortion detection, while generating high-quality rationales approved by human experts.
  arXiv  Detail & Related papers  (2023-10-11T02:47:21Z)
• Handwriting and Drawing for Depression Detection: A Preliminary Study [53.11777541341063]
  Short-term covid effects on mental health were a significant increase in anxiety and depressive symptoms. The aim of this study is to use a new tool, the online handwriting and drawing analysis, to discriminate between healthy individuals and depressed patients.
  arXiv  Detail & Related papers  (2023-02-05T22:33:49Z)
• Climate and Weather: Inspecting Depression Detection via Emotion Recognition [25.290414205116107]
  This paper uses pretrained features extracted from the emotion recognition model for depression detection to form multimodal depression detection. The proposed emotion transfer improves depression detection performance on DAIC-WOZ as well as increases the training stability.
  arXiv  Detail & Related papers  (2022-04-29T13:44:22Z)
• Emotion pattern detection on facial videos using functional statistics [62.997667081978825]
  We propose a technique based on Functional ANOVA to extract significant patterns of face muscles movements. We determine if there are time-related differences on expressions among emotional groups by using a functional F-test.
  arXiv  Detail & Related papers  (2021-03-01T08:31:08Z)
• Deep Multi-task Learning for Depression Detection and Prediction in Longitudinal Data [50.02223091927777]
  Depression is among the most prevalent mental disorders, affecting millions of people of all ages globally. Machine learning techniques have shown effective in enabling automated detection and prediction of depression for early intervention and treatment. We introduce a novel deep multi-task recurrent neural network to tackle this challenge, in which depression classification is jointly optimized with two auxiliary tasks.
  arXiv  Detail & Related papers  (2020-12-05T05:14:14Z)
• Examining the Role of Mood Patterns in Predicting Self-Reported Depressive symptoms [4.564132389935269]
  Depression is the leading cause of disability worldwide. Initial efforts to detect depression signals from social media posts have shown promising results. In this work, we attempt to enrich current technology for detecting symptoms of potential depression by constructing a'mood profile' for social media users.
  arXiv  Detail & Related papers  (2020-06-14T12:48:43Z)
• Affective Conditioning on Hierarchical Networks applied to Depression Detection from Transcribed Clinical Interviews [0.0]
  Depression is a mental disorder that impacts not only the subject's mood but also the use of language. We use a Hierarchical Attention Network to classify interviews of depressed subjects. We augment the attention layer of our model with a conditioning mechanism on linguistic features, extracted from affective lexica.
  arXiv  Detail & Related papers  (2020-06-04T20:55:22Z)
• Depressed individuals express more distorted thinking on social media [0.0]
  Depression is a leading cause of disability worldwide, but is often under-diagnosed and under-treated. Here, we show that individuals with a self-reported diagnosis of depression express higher levels of distorted thinking than a random sample. Some types of distorted thinking were found to be more than twice as prevalent in our depressed cohort, in particular Personalizing and Emotional Reasoning.
  arXiv  Detail & Related papers  (2020-02-07T14:18:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.