Multimodal Gait Recognition for Neurodegenerative Diseases
- URL: http://arxiv.org/abs/2101.02469v1
- Date: Thu, 7 Jan 2021 10:17:11 GMT
- Title: Multimodal Gait Recognition for Neurodegenerative Diseases
- Authors: Aite Zhao, Jianbo Li, Junyu Dong, Lin Qi, Qianni Zhang, Ning Li, Xin
Wang, Huiyu Zhou
- Abstract summary: We propose a novel hybrid model to learn the gait differences between three neurodegenerative diseases.
A new correlative memory neural network architecture is designed for extracting temporal features.
Compared with several state-of-the-art techniques, our proposed framework shows more accurate classification results.
- Score: 38.06704951209703
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In recent years, single modality based gait recognition has been extensively
explored in the analysis of medical images or other sensory data, and it is
recognised that each of the established approaches has different strengths and
weaknesses. As an important motor symptom, gait disturbance is usually used for
diagnosis and evaluation of diseases; moreover, the use of multi-modality
analysis of the patient's walking pattern compensates for the one-sidedness of
single modality gait recognition methods that only learn gait changes in a
single measurement dimension. The fusion of multiple measurement resources has
demonstrated promising performance in the identification of gait patterns
associated with individual diseases. In this paper, as a useful tool, we
propose a novel hybrid model to learn the gait differences between three
neurodegenerative diseases, between patients with different severity levels of
Parkinson's disease and between healthy individuals and patients, by fusing and
aggregating data from multiple sensors. A spatial feature extractor (SFE) is
applied to generating representative features of images or signals. In order to
capture temporal information from the two modality data, a new correlative
memory neural network (CorrMNN) architecture is designed for extracting
temporal features. Afterwards, we embed a multi-switch discriminator to
associate the observations with individual state estimations. Compared with
several state-of-the-art techniques, our proposed framework shows more accurate
classification results.
Related papers
- Benchmarking Reliability of Deep Learning Models for Pathological Gait Classification [2.1548132286330453]
Researchers have recently sought to leverage advances in machine learning algorithms to detect symptoms of altered gait.
This paper analyzes existing approaches to identify gaps inhibiting translation.
We propose our strong baseline called Asynchronous Multi-Stream Graph Convolutional Network (AMS-GCN) that can reliably differentiate multiple categories of pathological gaits.
arXiv Detail & Related papers (2024-09-20T16:47:45Z) - Individualized multi-horizon MRI trajectory prediction for Alzheimer's Disease [0.0]
We train a novel architecture to build a latent space distribution which can be sampled from to generate future predictions of changing anatomy.
By comparing to several alternatives, we show that our model produces more individualized images with higher resolution.
arXiv Detail & Related papers (2024-08-04T13:09:06Z) - MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning [31.21351373001379]
We introduce a novel prompt learning model by learning graph prompts during the fine-tuning process of multimodal large models for diagnosing neurological disorders.
Specifically, we first leverage GPT-4 to obtain relevant disease concepts and compute semantic similarity between these concepts and all patches.
Secondly, we reduce the weight of irrelevant patches according to the semantic similarity between each patch and disease-related concepts.
arXiv Detail & Related papers (2023-12-22T10:10:50Z) - Pain level and pain-related behaviour classification using GRU-based
sparsely-connected RNNs [61.080598804629375]
People with chronic pain unconsciously adapt specific body movements to protect themselves from injury or additional pain.
Because there is no dedicated benchmark database to analyse this correlation, we considered one of the specific circumstances that potentially influence a person's biometrics during daily activities.
We proposed a sparsely-connected recurrent neural networks (s-RNNs) ensemble with the gated recurrent unit (GRU) that incorporates multiple autoencoders.
We conducted several experiments which indicate that the proposed method outperforms the state-of-the-art approaches in classifying both pain level and pain-related behaviour.
arXiv Detail & Related papers (2022-12-20T12:56:28Z) - Tensor-Based Multi-Modality Feature Selection and Regression for
Alzheimer's Disease Diagnosis [25.958167380664083]
We propose a novel tensor-based multi-modality feature selection and regression method for diagnosis and biomarker identification of Alzheimer's Disease (AD) and Mild Cognitive Impairment (MCI)
We present the practical advantages of our method for the analysis of ADNI data using three imaging modalities.
arXiv Detail & Related papers (2022-09-23T02:17:27Z) - Differential Diagnosis of Frontotemporal Dementia and Alzheimer's
Disease using Generative Adversarial Network [0.0]
Frontotemporal dementia and Alzheimer's disease are two common forms of dementia and are easily misdiagnosed as each other.
Differentiating between the two dementia types is crucial for determining disease-specific intervention and treatment.
Recent development of Deep-learning-based approaches in the field of medical image computing are delivering some of the best performance for many binary classification tasks.
arXiv Detail & Related papers (2021-09-12T22:40:50Z) - G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for
Biomarker Identification and Disease Classification [49.53651166356737]
We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers.
We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
arXiv Detail & Related papers (2021-01-27T19:28:04Z) - Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype
Prediction [55.94378672172967]
We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients.
We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks.
Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
arXiv Detail & Related papers (2020-09-02T02:50:30Z) - Semi-supervised Medical Image Classification with Relation-driven
Self-ensembling Model [71.80319052891817]
We present a relation-driven semi-supervised framework for medical image classification.
It exploits the unlabeled data by encouraging the prediction consistency of given input under perturbations.
Our method outperforms many state-of-the-art semi-supervised learning methods on both single-label and multi-label image classification scenarios.
arXiv Detail & Related papers (2020-05-15T06:57:54Z) - Learning Dynamic and Personalized Comorbidity Networks from Event Data
using Deep Diffusion Processes [102.02672176520382]
Comorbid diseases co-occur and progress via complex temporal patterns that vary among individuals.
In electronic health records we can observe the different diseases a patient has, but can only infer the temporal relationship between each co-morbid condition.
We develop deep diffusion processes to model "dynamic comorbidity networks"
arXiv Detail & Related papers (2020-01-08T15:47:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.