Exploring Facial Expressions and Affective Domains for Parkinson Detection

• URL: http://arxiv.org/abs/2012.06563v1
• Date: Fri, 11 Dec 2020 18:48:53 GMT
• Title: Exploring Facial Expressions and Affective Domains for Parkinson Detection
• Authors: Luis Felipe Gomez-Gomez and Aythami Morales and Julian Fierrez and Juan Rafael Orozco-Arroyave
• Abstract summary: Parkinson's Disease (PD) is a neurological disorder that affects facial movements and non-verbal communication. We propose to use facial expression analysis from face images based on affective domains to improve PD detection.
• Score: 17.244432348845034
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Parkinson's Disease (PD) is a neurological disorder that affects facial movements and non-verbal communication. Patients with PD present a reduction in facial movements called hypomimia which is evaluated in item 3.2 of the MDS-UPDRS-III scale. In this work, we propose to use facial expression analysis from face images based on affective domains to improve PD detection. We propose different domain adaptation techniques to exploit the latest advances in face recognition and Face Action Unit (FAU) detection. The principal contributions of this work are: (1) a novel framework to exploit deep face architectures to model hypomimia in PD patients; (2) we experimentally compare PD detection based on single images vs. image sequences while the patients are evoked various face expressions; (3) we explore different domain adaptation techniques to exploit existing models initially trained either for Face Recognition or to detect FAUs for the automatic discrimination between PD patients and healthy subjects; and (4) a new approach to use triplet-loss learning to improve hypomimia modeling and PD detection. The results on real face images from PD patients show that we are able to properly model evoked emotions using image sequences (neutral, onset-transition, apex, offset-transition, and neutral) with accuracy improvements up to 5.5% (from 72.9% to 78.4%) with respect to single-image PD detection. We also show that our proposed affective-domain adaptation provides improvements in PD detection up to 8.9% (from 78.4% to 87.3% detection accuracy).

Related papers

• OpticalDR: A Deep Optical Imaging Model for Privacy-Protective Depression Recognition [66.91236298878383]
  Depression Recognition (DR) poses a considerable challenge, especially in the context of privacy concerns. We design a new imaging system to erase the identity information of captured facial images while retain disease-relevant features. It is irreversible for identity information recovery while preserving essential disease-related characteristics necessary for accurate DR.
  arXiv  Detail & Related papers  (2024-02-29T01:20:29Z)
• PAD-Phys: Exploiting Physiology for Presentation Attack Detection in Face Biometrics [48.683457383784145]
  Three approaches to presentation attack detection based on r: (i) the physiological domain, (ii) the Deepfakes domain, and (iii) a new Presentation Attack domain. Results show a 21.70% decrease in average classification error rate (ACER) when the presentation attack domain is compared to the physiological and Deepfakes domains. Experiments highlight the efficiency of transfer learning in r-based models and perform well in presentation attack detection in instruments that do not allow copying of this physiological feature.
  arXiv  Detail & Related papers  (2023-10-03T15:24:15Z)
• Unmasking Parkinson's Disease with Smile: An AI-enabled Screening Framework [3.673889641081601]
  We collected 3,871 videos from 1,059 unique participants, including 256 self-reported PD patients. We extracted features relevant to Hypomimia, a prominent symptom of PD characterized by reduced facial expressions. An ensemble of AI models trained on these features achieved an accuracy of 89.7% and an Area Under the Receiver Operating Characteristic (AUROC) of 89.3%.
  arXiv  Detail & Related papers  (2023-08-03T18:23:37Z)
• Fast refacing of MR images with a generative neural network lowers re-identification risk and preserves volumetric consistency [5.040145546652933]
  We propose a novel method for anonymised face generation for 3D T1-weighted scans based on a 3D conditional generative adversarial network. The proposed method takes 9 seconds for face generation and is suitable for recovering consistent post-processing results after defacing.
  arXiv  Detail & Related papers  (2023-05-26T13:34:14Z)
• Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cues [81.15465149555864]
  We establish the first joint face spoofing and detection benchmark using both visual appearance and physiological r cues. To enhance the r periodicity discrimination, we design a two-branch physiological network using both facial powerful rtemporal signal map and its continuous wavelet transformed counterpart as inputs.
  arXiv  Detail & Related papers  (2022-08-10T15:41:48Z)
• Automated Parkinson's Disease Detection and Affective Analysis from Emotional EEG Signals [4.23779873473242]
  This study examines the utility of affective Electroencephalography (EEG) signals to understand emotional differences between PD vs Healthy Controls (HC) Using traditional machine learning and deep learning methods, we explore (a) dimensional and categorical emotion recognition, and (b) PD vs HC classification from emotional EEG signals.
  arXiv  Detail & Related papers  (2022-02-21T00:34:34Z)
• Spatiotemporal Ground Reaction Force Analysis using Convolutional Neural Networks to Analyze Parkinsonian Gait [0.0]
  Parkinsons disease (PD) is a non-curable disease that commonly found among elders that greatly reduce their quality of life. The present paper has identified raw ground reaction force (GRF) as a key parameter to identify changes in human gait patterns associated with PD. The proposed algorithm is capable of identifying the severity of the PD and distinguishing the parkinsonian gait from the healthy gait.
  arXiv  Detail & Related papers  (2021-02-01T04:30:34Z)
• Facial expressions can detect Parkinson's disease: preliminary evidence from videos collected online [0.6004833598578182]
  One of the symptoms of Parkinson's disease (PD) is hypomimia or reduced facial expressions. We analyzed the facial action units (AU) from videos of 604 individuals. Individuals with PD had less variance in AU6 (cheek raiser), AU12 (lip corner puller), and AU4 (brow lowerer) than non-PD individuals.
  arXiv  Detail & Related papers  (2020-12-09T23:53:32Z)
• Unsupervised Learning Facial Parameter Regressor for Action Unit Intensity Estimation via Differentiable Renderer [51.926868759681014]
  We present a framework to predict the facial parameters based on a bone-driven face model (BDFM) under different views. The proposed framework consists of a feature extractor, a generator, and a facial parameter regressor.
  arXiv  Detail & Related papers  (2020-08-20T09:49:13Z)
• Face Anti-Spoofing by Learning Polarization Cues in a Real-World Scenario [50.36920272392624]
  Face anti-spoofing is the key to preventing security breaches in biometric recognition applications. Deep learning method using RGB and infrared images demands a large amount of training data for new attacks. We present a face anti-spoofing method in a real-world scenario by automatic learning the physical characteristics in polarization images of a real face.
  arXiv  Detail & Related papers  (2020-03-18T03:04:03Z)
• It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation [82.16380486281108]
  We propose an appearance-based method that only takes the full face image as input. Our method encodes the face image using a convolutional neural network with spatial weights applied on the feature maps. We show that our full-face method significantly outperforms the state of the art for both 2D and 3D gaze estimation.
  arXiv  Detail & Related papers  (2016-11-27T15:00:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.