Exploring Facial Expressions and Affective Domains for Parkinson
Detection
- URL: http://arxiv.org/abs/2012.06563v1
- Date: Fri, 11 Dec 2020 18:48:53 GMT
- Title: Exploring Facial Expressions and Affective Domains for Parkinson
Detection
- Authors: Luis Felipe Gomez-Gomez and Aythami Morales and Julian Fierrez and
Juan Rafael Orozco-Arroyave
- Abstract summary: Parkinson's Disease (PD) is a neurological disorder that affects facial movements and non-verbal communication.
We propose to use facial expression analysis from face images based on affective domains to improve PD detection.
- Score: 17.244432348845034
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Parkinson's Disease (PD) is a neurological disorder that affects facial
movements and non-verbal communication. Patients with PD present a reduction in
facial movements called hypomimia which is evaluated in item 3.2 of the
MDS-UPDRS-III scale. In this work, we propose to use facial expression analysis
from face images based on affective domains to improve PD detection. We propose
different domain adaptation techniques to exploit the latest advances in face
recognition and Face Action Unit (FAU) detection. The principal contributions
of this work are: (1) a novel framework to exploit deep face architectures to
model hypomimia in PD patients; (2) we experimentally compare PD detection
based on single images vs. image sequences while the patients are evoked
various face expressions; (3) we explore different domain adaptation techniques
to exploit existing models initially trained either for Face Recognition or to
detect FAUs for the automatic discrimination between PD patients and healthy
subjects; and (4) a new approach to use triplet-loss learning to improve
hypomimia modeling and PD detection. The results on real face images from PD
patients show that we are able to properly model evoked emotions using image
sequences (neutral, onset-transition, apex, offset-transition, and neutral)
with accuracy improvements up to 5.5% (from 72.9% to 78.4%) with respect to
single-image PD detection. We also show that our proposed affective-domain
adaptation provides improvements in PD detection up to 8.9% (from 78.4% to
87.3% detection accuracy).
Related papers
- OpticalDR: A Deep Optical Imaging Model for Privacy-Protective
Depression Recognition [66.91236298878383]
Depression Recognition (DR) poses a considerable challenge, especially in the context of privacy concerns.
We design a new imaging system to erase the identity information of captured facial images while retain disease-relevant features.
It is irreversible for identity information recovery while preserving essential disease-related characteristics necessary for accurate DR.
arXiv Detail & Related papers (2024-02-29T01:20:29Z) - PAD-Phys: Exploiting Physiology for Presentation Attack Detection in
Face Biometrics [48.683457383784145]
Three approaches to presentation attack detection based on r: (i) the physiological domain, (ii) the Deepfakes domain, and (iii) a new Presentation Attack domain.
Results show a 21.70% decrease in average classification error rate (ACER) when the presentation attack domain is compared to the physiological and Deepfakes domains.
Experiments highlight the efficiency of transfer learning in r-based models and perform well in presentation attack detection in instruments that do not allow copying of this physiological feature.
arXiv Detail & Related papers (2023-10-03T15:24:15Z) - Fast refacing of MR images with a generative neural network lowers
re-identification risk and preserves volumetric consistency [5.040145546652933]
We propose a novel method for anonymised face generation for 3D T1-weighted scans based on a 3D conditional generative adversarial network.
The proposed method takes 9 seconds for face generation and is suitable for recovering consistent post-processing results after defacing.
arXiv Detail & Related papers (2023-05-26T13:34:14Z) - Pain Detection in Masked Faces during Procedural Sedation [0.0]
Pain monitoring is essential to the quality of care for patients undergoing a medical procedure with sedation.
Previous studies have shown the viability of computer vision methods in detecting pain in unoccluded faces.
This study has collected video data from masked faces of 14 patients undergoing procedures in an interventional radiology department.
arXiv Detail & Related papers (2022-11-12T15:55:33Z) - Benchmarking Joint Face Spoofing and Forgery Detection with Visual and
Physiological Cues [81.15465149555864]
We establish the first joint face spoofing and detection benchmark using both visual appearance and physiological r cues.
To enhance the r periodicity discrimination, we design a two-branch physiological network using both facial powerful rtemporal signal map and its continuous wavelet transformed counterpart as inputs.
arXiv Detail & Related papers (2022-08-10T15:41:48Z) - Automated Parkinson's Disease Detection and Affective Analysis from
Emotional EEG Signals [4.23779873473242]
This study examines the utility of affective Electroencephalography (EEG) signals to understand emotional differences between PD vs Healthy Controls (HC)
Using traditional machine learning and deep learning methods, we explore (a) dimensional and categorical emotion recognition, and (b) PD vs HC classification from emotional EEG signals.
arXiv Detail & Related papers (2022-02-21T00:34:34Z) - Spatiotemporal Ground Reaction Force Analysis using Convolutional Neural
Networks to Analyze Parkinsonian Gait [0.0]
Parkinsons disease (PD) is a non-curable disease that commonly found among elders that greatly reduce their quality of life.
The present paper has identified raw ground reaction force (GRF) as a key parameter to identify changes in human gait patterns associated with PD.
The proposed algorithm is capable of identifying the severity of the PD and distinguishing the parkinsonian gait from the healthy gait.
arXiv Detail & Related papers (2021-02-01T04:30:34Z) - Facial expressions can detect Parkinson's disease: preliminary evidence
from videos collected online [0.6004833598578182]
One of the symptoms of Parkinson's disease (PD) is hypomimia or reduced facial expressions.
We analyzed the facial action units (AU) from videos of 604 individuals.
Individuals with PD had less variance in AU6 (cheek raiser), AU12 (lip corner puller), and AU4 (brow lowerer) than non-PD individuals.
arXiv Detail & Related papers (2020-12-09T23:53:32Z) - Unsupervised Learning Facial Parameter Regressor for Action Unit
Intensity Estimation via Differentiable Renderer [51.926868759681014]
We present a framework to predict the facial parameters based on a bone-driven face model (BDFM) under different views.
The proposed framework consists of a feature extractor, a generator, and a facial parameter regressor.
arXiv Detail & Related papers (2020-08-20T09:49:13Z) - Face Anti-Spoofing by Learning Polarization Cues in a Real-World
Scenario [50.36920272392624]
Face anti-spoofing is the key to preventing security breaches in biometric recognition applications.
Deep learning method using RGB and infrared images demands a large amount of training data for new attacks.
We present a face anti-spoofing method in a real-world scenario by automatic learning the physical characteristics in polarization images of a real face.
arXiv Detail & Related papers (2020-03-18T03:04:03Z) - It's Written All Over Your Face: Full-Face Appearance-Based Gaze
Estimation [82.16380486281108]
We propose an appearance-based method that only takes the full face image as input.
Our method encodes the face image using a convolutional neural network with spatial weights applied on the feature maps.
We show that our full-face method significantly outperforms the state of the art for both 2D and 3D gaze estimation.
arXiv Detail & Related papers (2016-11-27T15:00:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.