Exploring Motion Boundaries in an End-to-End Network for Vision-based Parkinson's Severity Assessment

• URL: http://arxiv.org/abs/2012.09890v2
• Date: Thu, 24 Dec 2020 17:07:52 GMT
• Title: Exploring Motion Boundaries in an End-to-End Network for Vision-based Parkinson's Severity Assessment
• Authors: Amirhossein Dadashzadeh, Alan Whone, Michal Rolinski, Majid Mirmehdi
• Abstract summary: We present an end-to-end deep learning framework to measure Parkinson's disease severity in two important components, hand movement and gait. Our method leverages on an Inflated 3D CNN trained by a temporal segment framework to learn spatial and long temporal structure in video data. We evaluate our proposed method on a dataset of 25 PD patients, obtaining 72.3% and 77.1% top-1 accuracy on hand movement and gait tasks respectively.
• Score: 2.359557447960552
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Evaluating neurological disorders such as Parkinson's disease (PD) is a challenging task that requires the assessment of several motor and non-motor functions. In this paper, we present an end-to-end deep learning framework to measure PD severity in two important components, hand movement and gait, of the Unified Parkinson's Disease Rating Scale (UPDRS). Our method leverages on an Inflated 3D CNN trained by a temporal segment framework to learn spatial and long temporal structure in video data. We also deploy a temporal attention mechanism to boost the performance of our model. Further, motion boundaries are explored as an extra input modality to assist in obfuscating the effects of camera motion for better movement assessment. We ablate the effects of different data modalities on the accuracy of the proposed network and compare with other popular architectures. We evaluate our proposed method on a dataset of 25 PD patients, obtaining 72.3% and 77.1% top-1 accuracy on hand movement and gait tasks respectively.

Related papers

• Deep learning for objective estimation of Parkinsonian tremor severity [0.0]
  We introduce a pixel-based deep learning model designed to analyse postural tremor in Parkinson's disease. It was trained on 2,742 assessments from five specialised movement disorder centres across two continents. It detected lateral asymmetry of symptoms, and differentiated between different tremor severities.
  arXiv  Detail & Related papers  (2024-09-03T16:00:34Z)
• AI WALKUP: A Computer-Vision Approach to Quantifying MDS-UPDRS in Parkinson's Disease [26.404367811027996]
  Parkinson's Disease (PD) is the second most common neurodegenerative disorder. The existing assessment method for PD is usually the Movement Disorder Society - Unified Parkinson's Disease Rating Scale (MDS-UPDRS) to assess the severity of various types of motor symptoms and disease progression. We want to use a computer vision based solution to capture human pose images based on a camera, reconstruct and perform motion analysis using algorithms, and extract the features of the amount of motion through feature engineering.
  arXiv  Detail & Related papers  (2024-04-02T05:53:34Z)
• Auxiliary Tasks Benefit 3D Skeleton-based Human Motion Prediction [106.06256351200068]
  This paper introduces a model learning framework with auxiliary tasks. In our auxiliary tasks, partial body joints' coordinates are corrupted by either masking or adding noise. We propose a novel auxiliary-adapted transformer, which can handle incomplete, corrupted motion data.
  arXiv  Detail & Related papers  (2023-08-17T12:26:11Z)
• Automatic diagnosis of knee osteoarthritis severity using Swin transformer [55.01037422579516]
  Knee osteoarthritis (KOA) is a widespread condition that can cause chronic pain and stiffness in the knee joint. We propose an automated approach that employs the Swin Transformer to predict the severity of KOA.
  arXiv  Detail & Related papers  (2023-07-10T09:49:30Z)
• Motion-Scenario Decoupling for Rat-Aware Video Position Prediction: Strategy and Benchmark [49.58762201363483]
  We introduce RatPose, a bio-robot motion prediction dataset constructed by considering the influence factors of individuals and environments. We propose a Dual-stream Motion-Scenario Decoupling framework that effectively separates scenario-oriented and motion-oriented features. We demonstrate significant performance improvements of the proposed textitDMSD framework on different difficulty-level tasks.
  arXiv  Detail & Related papers  (2023-05-17T14:14:31Z)
• Time Series Classification for Detecting Parkinson's Disease from Wrist Motions [4.1125736844411644]
  We investigate InceptionTime and RandOm Convolutional KErnel Transform as promising for Parkinson's disease symptom monitoring. InceptionTime's high learning capacity is well-suited to modeling complex movement patterns while ROCKET is suited to small datasets. ROCKET demonstrates superior performance in identifying dyskinesia, whereas InceptionTime exhibits slightly better performance in tremor and bradykinesia detection.
  arXiv  Detail & Related papers  (2023-04-21T22:38:44Z)
• Multimodal Indoor Localisation for Measuring Mobility in Parkinson's Disease using Transformers [2.683727984711853]
  We use data collected from 10 people with Parkinson's, and 10 controls, each of whom lived for five days in a smart home with various sensors. In order to more effectively localise them indoors, we propose a transformer-based approach utilizing two data modalities. Our approach makes asymmetric and dynamic correlations by a) learning temporal correlations at different scales and levels, and b. utilizing various gating mechanisms to select relevant features within modality and suppress unnecessary modalities.
  arXiv  Detail & Related papers  (2022-05-12T15:05:57Z)
• Vision-based Estimation of MDS-UPDRS Gait Scores for Assessing Parkinson's Disease Motor Severity [39.51722822896373]
  Parkinson's disease (PD) is a progressive neurological disorder affecting motor function. Physical severity of PD impairments can be quantified through the Movement Disorder Society Unified Parkinson's Disease Rating Scale. We propose a computer vision-based model that observes non-intrusive video recordings of individuals, extracts their 3D body skeletons, tracks them through time, and classifies the movements according to the MDS-UPDRS gait scores.
  arXiv  Detail & Related papers  (2020-07-17T11:49:30Z)
• Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimation [51.72616167073565]
  We propose Motion Pyramid Networks, a novel deep learning-based approach for accurate and efficient cardiac motion estimation. We predict and fuse a pyramid of motion fields from multiple scales of feature representations to generate a more refined motion field. We then use a novel cyclic teacher-student training strategy to make the inference end-to-end and further improve the tracking performance.
  arXiv  Detail & Related papers  (2020-06-28T21:03:19Z)
• AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching [76.4844593082362]
  We investigate the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong baseline for remote HR measurement with architecture search (NAS) Comprehensive experiments are performed on three benchmark datasets on both intra-temporal and cross-dataset testing.
  arXiv  Detail & Related papers  (2020-04-26T05:43:21Z)
• A Deep Learning Approach for Motion Forecasting Using 4D OCT Data [69.62333053044712]
  We propose 4D-temporal deep learning for end-to-end motion forecasting and estimation using a stream of OCT volumes. Our best performing 4D method achieves motion forecasting with an overall average correlation of 97.41%, while also improving motion estimation performance by a factor of 2.5 compared to a previous 3D approach.
  arXiv  Detail & Related papers  (2020-04-21T15:59:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.