Your Turn: At Home Turning Angle Estimation for Parkinson's Disease Severity Assessment
- URL: http://arxiv.org/abs/2408.08182v2
- Date: Sat, 24 Aug 2024 16:18:50 GMT
- Title: Your Turn: At Home Turning Angle Estimation for Parkinson's Disease Severity Assessment
- Authors: Qiushuo Cheng, Catherine Morgan, Arindam Sikdar, Alessandro Masullo, Alan Whone, Majid Mirmehdi,
- Abstract summary: This paper presents a deep learning-based approach to automatically quantify turning angles by extracting 3D skeletons from videos.
We utilise state-of-the-art human pose estimation models, Fastpose and Strided Transformer, on a total of 1386 turning video clips from 24 subjects.
This is the first work to explore the use of single monocular camera data to quantify turns by PD patients in a home setting.
- Score: 42.449532608247935
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: People with Parkinson's Disease (PD) often experience progressively worsening gait, including changes in how they turn around, as the disease progresses. Existing clinical rating tools are not capable of capturing hour-by-hour variations of PD symptoms, as they are confined to brief assessments within clinic settings. Measuring gait turning angles continuously and passively is a component step towards using gait characteristics as sensitive indicators of disease progression in PD. This paper presents a deep learning-based approach to automatically quantify turning angles by extracting 3D skeletons from videos and calculating the rotation of hip and knee joints. We utilise state-of-the-art human pose estimation models, Fastpose and Strided Transformer, on a total of 1386 turning video clips from 24 subjects (12 people with PD and 12 healthy control volunteers), trimmed from a PD dataset of unscripted free-living videos in a home-like setting (Turn-REMAP). We also curate a turning video dataset, Turn-H3.6M, from the public Human3.6M human pose benchmark with 3D ground truth, to further validate our method. Previous gait research has primarily taken place in clinics or laboratories evaluating scripted gait outcomes, but this work focuses on free-living home settings where complexities exist, such as baggy clothing and poor lighting. Due to difficulties in obtaining accurate ground truth data in a free-living setting, we quantise the angle into the nearest bin $45^\circ$ based on the manual labelling of expert clinicians. Our method achieves a turning calculation accuracy of 41.6%, a Mean Absolute Error (MAE) of 34.7{\deg}, and a weighted precision WPrec of 68.3% for Turn-REMAP. This is the first work to explore the use of single monocular camera data to quantify turns by PD patients in a home setting.
Related papers
- PULSAR: Graph based Positive Unlabeled Learning with Multi Stream
Adaptive Convolutions for Parkinson's Disease Recognition [1.9482539692051932]
Parkinsons disease (PD) is a neuro-degenerative disorder that affects movement, speech, and coordination.
We present PULSAR, a novel method to screen for PD from webcam-recorded videos of finger-tapping.
We used an adaptive graph convolutional neural network to dynamically learn the temporal graph specific to the finger-tapping task.
arXiv Detail & Related papers (2023-12-10T05:56:20Z) - An experimental study for early diagnosing Parkinson's disease using
machine learning [1.534667887016089]
This experimental work used Machine Learning techniques to automate the early detection of Parkinson's Disease.
In this study, we develop ML models utilizing a public dataset of 130 individuals.
We obtain 100% accuracy in classifying PD and RBD patients, as well as 92% accuracy in classifying PD and HC individuals.
arXiv Detail & Related papers (2023-10-20T16:59:18Z) - Coordinate Transformer: Achieving Single-stage Multi-person Mesh
Recovery from Videos [91.44553585470688]
Multi-person 3D mesh recovery from videos is a critical first step towards automatic perception of group behavior in virtual reality, physical therapy and beyond.
We propose the Coordinate transFormer (CoordFormer) that directly models multi-person spatial-temporal relations and simultaneously performs multi-mesh recovery in an end-to-end manner.
Experiments on the 3DPW dataset demonstrate that CoordFormer significantly improves the state-of-the-art, outperforming the previously best results by 4.2%, 8.8% and 4.7% according to the MPJPE, PAMPJPE, and PVE metrics, respectively.
arXiv Detail & Related papers (2023-08-20T18:23:07Z) - Unmasking Parkinson's Disease with Smile: An AI-enabled Screening
Framework [3.673889641081601]
We collected 3,871 videos from 1,059 unique participants, including 256 self-reported PD patients.
We extracted features relevant to Hypomimia, a prominent symptom of PD characterized by reduced facial expressions.
An ensemble of AI models trained on these features achieved an accuracy of 89.7% and an Area Under the Receiver Operating Characteristic (AUROC) of 89.3%.
arXiv Detail & Related papers (2023-08-03T18:23:37Z) - Multimodal Indoor Localisation in Parkinson's Disease for Detecting
Medication Use: Observational Pilot Study in a Free-Living Setting [2.1726452647707792]
Parkinson's disease (PD) is a slowly progressive, neurodegenerative disease which causes motor symptoms including gait dysfunction.
Motor fluctuations are alterations between periods with a positive response to levodopa therapy ("on") and periods marked by re-emergency of PD symptoms ("off") as the response to medication wears off.
These fluctuations often affect gait speed and they increase in their disabling impact as PD progresses.
A sub-objective aims to evaluate whether indoor localisation, including its in-home gait speed features, could be used to evaluate motor fluctuations by detecting whether the person with PD is taking levodopa medications or withholding them
arXiv Detail & Related papers (2023-08-03T08:55:21Z) - Remote Medication Status Prediction for Individuals with Parkinson's
Disease using Time-series Data from Smartphones [75.23250968928578]
We present a method for predicting the medication status of Parkinson's disease patients using the public mPower dataset.
The proposed method shows promising results in predicting three medication statuses objectively.
arXiv Detail & Related papers (2022-07-26T02:08:08Z) - FedMed-ATL: Misaligned Unpaired Brain Image Synthesis via Affine
Transform Loss [58.58979566599889]
We propose a novel self-supervised learning (FedMed) for brain image synthesis.
An affine transform loss (ATL) was formulated to make use of severely distorted images without violating privacy legislation.
The proposed method demonstrates advanced performance in both the quality of synthesized results under a severely misaligned and unpaired data setting.
arXiv Detail & Related papers (2022-01-29T13:45:39Z) - Facial expressions can detect Parkinson's disease: preliminary evidence
from videos collected online [0.6004833598578182]
One of the symptoms of Parkinson's disease (PD) is hypomimia or reduced facial expressions.
We analyzed the facial action units (AU) from videos of 604 individuals.
Individuals with PD had less variance in AU6 (cheek raiser), AU12 (lip corner puller), and AU4 (brow lowerer) than non-PD individuals.
arXiv Detail & Related papers (2020-12-09T23:53:32Z) - Appearance Learning for Image-based Motion Estimation in Tomography [60.980769164955454]
In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals.
Patient motion corrupts the geometry alignment in the reconstruction process resulting in motion artifacts.
We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object.
arXiv Detail & Related papers (2020-06-18T09:49:11Z) - Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using
Deep Multiple-Instance Learning [59.74684475991192]
Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old.
PD symptoms include tremor, rigidity and braykinesia.
We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
arXiv Detail & Related papers (2020-05-06T09:02:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.