Expresso-AI: Explainable Video-Based Deep Learning Models for Depression Diagnosis

• URL: http://arxiv.org/abs/2606.25606v1
• Date: Wed, 24 Jun 2026 09:14:53 GMT
• Title: Expresso-AI: Explainable Video-Based Deep Learning Models for Depression Diagnosis
• Abstract summary: We present a novel framework for analyzing Deep Neural Networks' decisions when trained on facial videos.<n>Our framework is able to interpret the model's saliency maps by examining face regions and temporal expression semantics.
• Score: 16.226234971636636
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Given the widespread prevalence of depression and its consequential impact on individuals and society, it is crucial to obtain objective measures for early diagnosis and intervention. As a multidisciplinary topic, these objective measures should be interpretable and accessible to health care professionals, ensuring effective collaboration and treatment planning in the realm of mental health care. Even though current automated depression diagnosis approaches improved over the last decade, a critical gap exists as they often lack affect-specificity and interpretability, limiting their practical application and potential impact on mental health care. In particular, interpretability from temporal activities from videos when deep models are used is not fully explored. In this study, we present a novel framework for analyzing Deep Neural Networks' decisions when trained on facial videos, specifically focusing on automatic depression severity diagnosis. By fine-tuning Deep Convolutional Neural Networks (DCNN) pre-trained on Action Recognition datasets on depression severity facial videos from AVEC depression dataset, our framework is able to interpret the model's saliency maps by examining face regions and temporal expression semantics. Our approach generates both visual and quantitative explanations for the model's decisions, providing greater insight into its reasoning. In addition to this interpretability, our video-based modeling has improved upon previous single-face benchmarks for visual depression diagnosis, resulting in enhanced predictive performance. Overall, our work demonstrates the successful development of a framework capable of generating hypotheses from a facial model's decisions while simultaneously improving depression's predictive capabilities.

Related papers

• Psychologically-Grounded Graph Modeling for Interpretable Depression Detection [36.72827968050813]
  We propose PsyGAT, a framework that models conversational sessions as dynamic temporal graphs.<n>We also introduce Causal-PsyGAT, an interpretability module that identifies symptom triggers.<n> Experiments show a 20% improvement in MRR for identifying causal indicators.
  arXiv  Detail & Related papers  (2026-04-27T07:27:45Z)
• Predicting Neuromodulation Outcome for Parkinson's Disease with Generative Virtual Brain Model [95.41752463487008]
  Parkinson's disease affects over ten million people worldwide.<n>Inter-individual variability limits empirical treatment selection, increasing non-negligible surgical risk and cost.<n>We bridge this gap with a pretraining-finetuning framework to predict outcomes directly from resting-state fMRI.
  arXiv  Detail & Related papers  (2026-03-31T02:36:10Z)
• Depression Detection Based on Electroencephalography Using a Hybrid Deep Neural Network CNN-GRU and MRMR Feature Selection [0.0]
  This study investigates the detection and classification of depressive and non-depressive states using deep learning approaches.<n>The proposed framework combines convolutional neural networks (CNNs) and gated recurrent units (GRUs) to jointly extract spatial and temporal features from EEG recordings.<n>The results demonstrate that the proposed model achieves high performance in accurately identifying depressive states, with an overall accuracy of 98.74%.
  arXiv  Detail & Related papers  (2026-01-16T02:58:17Z)
• Interpretable Neuropsychiatric Diagnosis via Concept-Guided Graph Neural Networks [56.75602443936853]
  One in five adolescents currently live with a diagnosed mental or behavioral health condition, such as anxiety, depression, or conduct disorder.<n>While prior works use graph neural network (GNN) approaches for disorder prediction, they remain black-boxes, limiting their reliability and clinical translation.<n>In this work, we propose a concept-based diagnosis framework that that encodes interpretable functional connectivity concepts.<n>Our design ensures predictions through clinically meaningful connectivity patterns, enabling both interpretability and strong predictive performance.
  arXiv  Detail & Related papers  (2025-10-02T19:38:46Z)
• ReDepress: A Cognitive Framework for Detecting Depression Relapse from Social Media [48.56586765769052]
  We present ReDepress, the first clinically validated social media dataset focused on relapse.<n>Our framework draws on cognitive theories of depression, incorporating constructs such as attention bias, interpretation bias, memory bias and rumination.<n>Our findings validate psychological theories in real-world textual data and underscore the potential of cognitive-informed computational methods for early relapse detection.
  arXiv  Detail & Related papers  (2025-09-22T16:33:59Z)
• AI Models for Depressive Disorder Detection and Diagnosis: A Review [0.9012198585960441]
  Major Depressive Disorder is one of the leading causes of disability worldwide, yet its diagnosis still depends largely on subjective clinical assessments.<n>In this paper, we present a comprehensive survey of state-of-the-art AI methods for detection and diagnosis, based on a systematic review of 55 key studies.
  arXiv  Detail & Related papers  (2025-08-16T11:46:48Z)
• GEMeX-RMCoT: An Enhanced Med-VQA Dataset for Region-Aware Multimodal Chain-of-Thought Reasoning [60.03671205298294]
  Medical visual question answering aims to support clinical decision-making by enabling models to answer natural language questions based on medical images.<n>Current methods still suffer from limited answer reliability and poor interpretability.<n>This work first proposes a Region-Aware Multimodal Chain-of-Thought dataset, in which the process of producing an answer is preceded by a sequence of intermediate reasoning steps.
  arXiv  Detail & Related papers  (2025-06-22T08:09:58Z)
• AI-Driven Early Mental Health Screening: Analyzing Selfies of Pregnant Women [32.514036618021244]
  Major Depressive Disorder and anxiety disorders affect millions globally, contributing significantly to the burden of mental health issues.<n>Early screening is crucial for effective intervention, as timely identification of mental health issues can significantly improve treatment outcomes.<n>This study explores the potential of AI models for ubiquitous depression-anxiety screening given face-centric selfies.
  arXiv  Detail & Related papers  (2024-10-07T19:34:25Z)
• EmoScan: Automatic Screening of Depression Symptoms in Romanized Sinhala Tweets [0.0]
  This work explores the utilization of Romanized Sinhala social media data to identify individuals at risk of depression. A machine learning-based framework is presented for the automatic screening of depression symptoms by analyzing language patterns, sentiment, and behavioural cues.
  arXiv  Detail & Related papers  (2024-03-28T10:31:09Z)
• Empowering Psychotherapy with Large Language Models: Cognitive Distortion Detection through Diagnosis of Thought Prompting [82.64015366154884]
  We study the task of cognitive distortion detection and propose the Diagnosis of Thought (DoT) prompting. DoT performs diagnosis on the patient's speech via three stages: subjectivity assessment to separate the facts and the thoughts; contrastive reasoning to elicit the reasoning processes supporting and contradicting the thoughts; and schema analysis to summarize the cognition schemas. Experiments demonstrate that DoT obtains significant improvements over ChatGPT for cognitive distortion detection, while generating high-quality rationales approved by human experts.
  arXiv  Detail & Related papers  (2023-10-11T02:47:21Z)
• Bayesian Networks for the robust and unbiased prediction of depression and its symptoms utilizing speech and multimodal data [65.28160163774274]
  We apply a Bayesian framework to capture the relationships between depression, depression symptoms, and features derived from speech, facial expression and cognitive game data collected at thymia.
  arXiv  Detail & Related papers  (2022-11-09T14:48:13Z)
• Deep Multi-task Learning for Depression Detection and Prediction in Longitudinal Data [50.02223091927777]
  Depression is among the most prevalent mental disorders, affecting millions of people of all ages globally. Machine learning techniques have shown effective in enabling automated detection and prediction of depression for early intervention and treatment. We introduce a novel deep multi-task recurrent neural network to tackle this challenge, in which depression classification is jointly optimized with two auxiliary tasks.
  arXiv  Detail & Related papers  (2020-12-05T05:14:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.