Predicting Brain Degeneration with a Multimodal Siamese Neural Network

• URL: http://arxiv.org/abs/2011.00840v1
• Date: Mon, 2 Nov 2020 09:21:47 GMT
• Title: Predicting Brain Degeneration with a Multimodal Siamese Neural Network
• Authors: Cecilia Ostertag, Marie Beurton-Aimar, Muriel Visani, Thierry Urruty, Karell Bertet
• Abstract summary: We present a neural network architecture for multimodal learning to predict the evolution of a neurodegenerative disease. Our network achieves 92.5% accuracy and an AUC score of 0.978 over a test set of 57 subjects.
• Score: 3.114884650164508
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: To study neurodegenerative diseases, longitudinal studies are carried on volunteer patients. During a time span of several months to several years, they go through regular medical visits to acquire data from different modalities, such as biological samples, cognitive tests, structural and functional imaging. These variables are heterogeneous but they all depend on the patient's health condition, meaning that there are possibly unknown relationships between all modalities. Some information may be specific to some modalities, others may be complementary, and others may be redundant. Some data may also be missing. In this work we present a neural network architecture for multimodal learning, able to use imaging and clinical data from two time points to predict the evolution of a neurodegenerative disease, and robust to missing values. Our multimodal network achieves 92.5\% accuracy and an AUC score of 0.978 over a test set of 57 subjects. We also show the superiority of the multimodal architecture, for up to 37.5\% of missing values in test set subjects' clinical measurements, compared to a model using only the clinical modality.

Related papers

• UNICORN: A Deep Learning Model for Integrating Multi-Stain Data in Histopathology [2.9389205138207277]
  UNICORN is a multi-modal transformer capable of processing multi-stain histopathology for atherosclerosis severity class prediction. The architecture comprises a two-stage, end-to-end trainable model with specialized modules utilizing transformer self-attention blocks. UNICORN achieved a classification accuracy of 0.67, outperforming other state-of-the-art models.
  arXiv  Detail & Related papers  (2024-09-26T12:13:52Z)
• Individualized multi-horizon MRI trajectory prediction for Alzheimer's Disease [0.0]
  We train a novel architecture to build a latent space distribution which can be sampled from to generate future predictions of changing anatomy. By comparing to several alternatives, we show that our model produces more individualized images with higher resolution.
  arXiv  Detail & Related papers  (2024-08-04T13:09:06Z)
• Incomplete Multimodal Learning for Complex Brain Disorders Prediction [65.95783479249745]
  We propose a new incomplete multimodal data integration approach that employs transformers and generative adversarial networks. We apply our new method to predict cognitive degeneration and disease outcomes using the multimodal imaging genetic data from Alzheimer's Disease Neuroimaging Initiative cohort.
  arXiv  Detail & Related papers  (2023-05-25T16:29:16Z)
• Continuous time recurrent neural networks: overview and application to forecasting blood glucose in the intensive care unit [56.801856519460465]
  Continuous time autoregressive recurrent neural networks (CTRNNs) are a deep learning model that account for irregular observations. We demonstrate the application of these models to probabilistic forecasting of blood glucose in a critical care setting.
  arXiv  Detail & Related papers  (2023-04-14T09:39:06Z)
• Predicting Brain Age using Transferable coVariance Neural Networks [119.45320143101381]
  We have recently studied covariance neural networks (VNNs) that operate on sample covariance matrices. In this paper, we demonstrate the utility of VNNs in inferring brain age using cortical thickness data. Our results show that VNNs exhibit multi-scale and multi-site transferability for inferring brain age In the context of brain age in Alzheimer's disease (AD), our experiments show that i) VNN outputs are interpretable as brain age predicted using VNNs is significantly elevated for AD with respect to healthy subjects.
  arXiv  Detail & Related papers  (2022-10-28T18:58:34Z)
• Evaluating U-net Brain Extraction for Multi-site and Longitudinal Preclinical Stroke Imaging [0.4310985013483366]
  Convolutional neural networks (CNNs) can improve accuracy and reduce operator time. We developed a deep-learning mouse brain extraction tool by using a U-net CNN. We trained, validated, and tested a typical U-net model on 240 multimodal MRI datasets.
  arXiv  Detail & Related papers  (2022-03-11T02:00:27Z)
• Relational Subsets Knowledge Distillation for Long-tailed Retinal Diseases Recognition [65.77962788209103]
  We propose class subset learning by dividing the long-tailed data into multiple class subsets according to prior knowledge. It enforces the model to focus on learning the subset-specific knowledge. The proposed framework proved to be effective for the long-tailed retinal diseases recognition task.
  arXiv  Detail & Related papers  (2021-04-22T13:39:33Z)
• Multimodal Gait Recognition for Neurodegenerative Diseases [38.06704951209703]
  We propose a novel hybrid model to learn the gait differences between three neurodegenerative diseases. A new correlative memory neural network architecture is designed for extracting temporal features. Compared with several state-of-the-art techniques, our proposed framework shows more accurate classification results.
  arXiv  Detail & Related papers  (2021-01-07T10:17:11Z)
• Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype Prediction [55.94378672172967]
  We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients. We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks. Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
  arXiv  Detail & Related papers  (2020-09-02T02:50:30Z)
• Modeling Shared Responses in Neuroimaging Studies through MultiView ICA [94.31804763196116]
  Group studies involving large cohorts of subjects are important to draw general conclusions about brain functional organization. We propose a novel MultiView Independent Component Analysis model for group studies, where data from each subject are modeled as a linear combination of shared independent sources plus noise. We demonstrate the usefulness of our approach first on fMRI data, where our model demonstrates improved sensitivity in identifying common sources among subjects.
  arXiv  Detail & Related papers  (2020-06-11T17:29:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.