Unmasking Parkinson's Disease with Smile: An AI-enabled Screening Framework

• URL: http://arxiv.org/abs/2308.02588v1
• Date: Thu, 3 Aug 2023 18:23:37 GMT
• Title: Unmasking Parkinson's Disease with Smile: An AI-enabled Screening Framework
• Authors: Tariq Adnan, Md Saiful Islam, Wasifur Rahman, Sangwu Lee, Sutapa Dey Tithi, Kazi Noshin, Imran Sarker, M Saifur Rahman, Ehsan Hoque
• Abstract summary: We collected 3,871 videos from 1,059 unique participants, including 256 self-reported PD patients. We extracted features relevant to Hypomimia, a prominent symptom of PD characterized by reduced facial expressions. An ensemble of AI models trained on these features achieved an accuracy of 89.7% and an Area Under the Receiver Operating Characteristic (AUROC) of 89.3%.
• Score: 3.673889641081601
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Parkinson's disease (PD) diagnosis remains challenging due to lacking a reliable biomarker and limited access to clinical care. In this study, we present an analysis of the largest video dataset containing micro-expressions to screen for PD. We collected 3,871 videos from 1,059 unique participants, including 256 self-reported PD patients. The recordings are from diverse sources encompassing participants' homes across multiple countries, a clinic, and a PD care facility in the US. Leveraging facial landmarks and action units, we extracted features relevant to Hypomimia, a prominent symptom of PD characterized by reduced facial expressions. An ensemble of AI models trained on these features achieved an accuracy of 89.7% and an Area Under the Receiver Operating Characteristic (AUROC) of 89.3% while being free from detectable bias across population subgroups based on sex and ethnicity on held-out data. Further analysis reveals that features from the smiling videos alone lead to comparable performance, even on two external test sets the model has never seen during training, suggesting the potential for PD risk assessment from smiling selfie videos.

Related papers

• Your Turn: At Home Turning Angle Estimation for Parkinson's Disease Severity Assessment [42.449532608247935]
  This paper presents a deep learning-based approach to automatically quantify turning angles by extracting 3D skeletons from videos. We utilise state-of-the-art human pose estimation models, Fastpose and Strided Transformer, on a total of 1386 turning video clips from 24 subjects. This is the first work to explore the use of single monocular camera data to quantify turns by PD patients in a home setting.
  arXiv  Detail & Related papers  (2024-08-15T14:36:07Z)
• Accessible, At-Home Detection of Parkinson's Disease via Multi-task Video Analysis [3.1851272788128644]
  Existing AI-based Parkinson's Disease detection methods primarily focus on unimodal analysis of motor or speech tasks. We propose a novel Uncertainty-calibrated Fusion Network (UFNet) that leverages this multimodal data to enhance diagnostic accuracy. UFNet significantly outperformed single-task models in terms of accuracy, area under the ROC curve (AUROC), and sensitivity while maintaining non-inferior specificity.
  arXiv  Detail & Related papers  (2024-06-21T04:02:19Z)
• OpticalDR: A Deep Optical Imaging Model for Privacy-Protective Depression Recognition [66.91236298878383]
  Depression Recognition (DR) poses a considerable challenge, especially in the context of privacy concerns. We design a new imaging system to erase the identity information of captured facial images while retain disease-relevant features. It is irreversible for identity information recovery while preserving essential disease-related characteristics necessary for accurate DR.
  arXiv  Detail & Related papers  (2024-02-29T01:20:29Z)
• PULSAR: Graph based Positive Unlabeled Learning with Multi Stream Adaptive Convolutions for Parkinson's Disease Recognition [1.9482539692051932]
  Parkinsons disease (PD) is a neuro-degenerative disorder that affects movement, speech, and coordination. We present PULSAR, a novel method to screen for PD from webcam-recorded videos of finger-tapping. We used an adaptive graph convolutional neural network to dynamically learn the temporal graph specific to the finger-tapping task.
  arXiv  Detail & Related papers  (2023-12-10T05:56:20Z)
• Subgroup discovery of Parkinson's Disease by utilizing a multi-modal smart device system [63.20765930558542]
  We used smartwatches and smartphones to collect multi-modal data from 504 participants, including PD patients, DD and HC. We were able to show that by combining various modalities, classification accuracy improved and further PD clusters were discovered.
  arXiv  Detail & Related papers  (2022-05-12T08:59:57Z)
• Intelligent Sight and Sound: A Chronic Cancer Pain Dataset [74.77784420691937]
  This paper introduces the first chronic cancer pain dataset, collected as part of the Intelligent Sight and Sound (ISS) clinical trial. The data collected to date consists of 29 patients, 509 smartphone videos, 189,999 frames, and self-reported affective and activity pain scores. Using static images and multi-modal data to predict self-reported pain levels, early models show significant gaps between current methods available to predict pain.
  arXiv  Detail & Related papers  (2022-04-07T22:14:37Z)
• Advancing COVID-19 Diagnosis with Privacy-Preserving Collaboration in Artificial Intelligence [79.038671794961]
  We launch the Unified CT-COVID AI Diagnostic Initiative (UCADI), where the AI model can be distributedly trained and independently executed at each host institution. Our study is based on 9,573 chest computed tomography scans (CTs) from 3,336 patients collected from 23 hospitals located in China and the UK.
  arXiv  Detail & Related papers  (2021-11-18T00:43:41Z)
• Exploring Facial Expressions and Affective Domains for Parkinson Detection [17.244432348845034]
  Parkinson's Disease (PD) is a neurological disorder that affects facial movements and non-verbal communication. We propose to use facial expression analysis from face images based on affective domains to improve PD detection.
  arXiv  Detail & Related papers  (2020-12-11T18:48:53Z)
• Facial expressions can detect Parkinson's disease: preliminary evidence from videos collected online [0.6004833598578182]
  One of the symptoms of Parkinson's disease (PD) is hypomimia or reduced facial expressions. We analyzed the facial action units (AU) from videos of 604 individuals. Individuals with PD had less variance in AU6 (cheek raiser), AU12 (lip corner puller), and AU4 (brow lowerer) than non-PD individuals.
  arXiv  Detail & Related papers  (2020-12-09T23:53:32Z)
• Integrative Analysis for COVID-19 Patient Outcome Prediction [53.11258640541513]
  We combine radiomics of lung opacities and non-imaging features from demographic data, vital signs, and laboratory findings to predict need for intensive care unit admission. Our methods may also be applied to other lung diseases including but not limited to community acquired pneumonia.
  arXiv  Detail & Related papers  (2020-07-20T19:08:50Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.