Self-pruning Graph Neural Network for Predicting Inflammatory Disease Activity in Multiple Sclerosis from Brain MR Images

• URL: http://arxiv.org/abs/2308.16863v1
• Date: Thu, 31 Aug 2023 17:05:14 GMT
• Title: Self-pruning Graph Neural Network for Predicting Inflammatory Disease Activity in Multiple Sclerosis from Brain MR Images
• Authors: Chinmay Prabhakar, Hongwei Bran Li, Johannes C. Paetzold, Timo Loehr, Chen Niu, Mark M\"uhlau, Daniel Rueckert, Benedikt Wiestler, Bjoern Menze
• Abstract summary: Multiple Sclerosis (MS) is a severe neurological disease characterized by inflammatory lesions in the central nervous system. We propose a two-stage MS inflammatory disease activity prediction approach. First, a 3D segmentation network detects lesions, and a self-supervised algorithm extracts their image features. Second, the detected lesions are used to build a patient graph. The lesions are connected based on their spatial proximity and the inflammatory disease activity prediction is formulated as a graph classification task.
• Score: 10.312631192694479
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multiple Sclerosis (MS) is a severe neurological disease characterized by inflammatory lesions in the central nervous system. Hence, predicting inflammatory disease activity is crucial for disease assessment and treatment. However, MS lesions can occur throughout the brain and vary in shape, size and total count among patients. The high variance in lesion load and locations makes it challenging for machine learning methods to learn a globally effective representation of whole-brain MRI scans to assess and predict disease. Technically it is non-trivial to incorporate essential biomarkers such as lesion load or spatial proximity. Our work represents the first attempt to utilize graph neural networks (GNN) to aggregate these biomarkers for a novel global representation. We propose a two-stage MS inflammatory disease activity prediction approach. First, a 3D segmentation network detects lesions, and a self-supervised algorithm extracts their image features. Second, the detected lesions are used to build a patient graph. The lesions act as nodes in the graph and are initialized with image features extracted in the first stage. Finally, the lesions are connected based on their spatial proximity and the inflammatory disease activity prediction is formulated as a graph classification task. Furthermore, we propose a self-pruning strategy to auto-select the most critical lesions for prediction. Our proposed method outperforms the existing baseline by a large margin (AUCs of 0.67 vs. 0.61 and 0.66 vs. 0.60 for one-year and two-year inflammatory disease activity, respectively). Finally, our proposed method enjoys inherent explainability by assigning an importance score to each lesion for the overall prediction. Code is available at https://github.com/chinmay5/ms_ida.git

Related papers

• How Does Pruning Impact Long-Tailed Multi-Label Medical Image Classifiers? [49.35105290167996]
  Pruning has emerged as a powerful technique for compressing deep neural networks, reducing memory usage and inference time without significantly affecting overall performance. This work represents a first step toward understanding the impact of pruning on model behavior in deep long-tailed, multi-label medical image classification.
  arXiv  Detail & Related papers  (2023-08-17T20:40:30Z)
• Towards Tumour Graph Learning for Survival Prediction in Head & Neck Cancer Patients [0.0]
  Nearly one million new cases of head & neck cancer diagnosed worldwide in 2020. automated segmentation and prognosis estimation approaches can help ensure each patient gets the most effective treatment. This paper presents a framework to perform these functions on arbitrary field of view (FoV) PET and CT registered scans.
  arXiv  Detail & Related papers  (2023-04-17T09:32:06Z)
• Automated SSIM Regression for Detection and Quantification of Motion Artefacts in Brain MR Images [54.739076152240024]
  Motion artefacts in magnetic resonance brain images are a crucial issue. The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis. An automated image quality assessment based on the structural similarity index (SSIM) regression has been proposed here.
  arXiv  Detail & Related papers  (2022-06-14T10:16:54Z)
• Domain Invariant Model with Graph Convolutional Network for Mammogram Classification [49.691629817104925]
  We propose a novel framework, namely Domain Invariant Model with Graph Convolutional Network (DIM-GCN) We first propose a Bayesian network, which explicitly decomposes the latent variables into disease-related and other disease-irrelevant parts that are provable to be disentangled from each other. To better capture the macroscopic features, we leverage the observed clinical attributes as a goal for reconstruction, via Graph Convolutional Network (GCN)
  arXiv  Detail & Related papers  (2022-04-21T08:23:44Z)
• Identifying Autism Spectrum Disorder Based on Individual-Aware Down-Sampling and Multi-Modal Learning [4.310840361752551]
  We propose a novel feature extraction method for fMRI that can learn a personalized lowe-resolution representation of the entire brain networking. The present model has achieved a mean classification accuracy of 85.95% and a mean AUC of 0.92, which is better than the state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-09-19T14:22:55Z)
• Sickle Cell Disease Severity Prediction from Percoll Gradient Images using Graph Convolutional Networks [38.27767684024691]
  Sickle cell disease (SCD) is a severe genetic hemoglobin disorder that results in premature destruction of red blood cells. Our proposed method is the first computational approach for the difficult task of SCD severity prediction.
  arXiv  Detail & Related papers  (2021-09-11T21:09:50Z)
• Knee Osteoarthritis Severity Prediction using an Attentive Multi-Scale Deep Convolutional Neural Network [8.950918531231158]
  This paper presents a deep learning-based framework, namely OsteoHRNet, that automatically assesses the Knee Osteoarthritis severity in terms of Kellgren and Lawrence grade classification from X-rays. Our proposed model has achieved the best multiclass accuracy of 71.74% and MAE of 0.311 on the baseline cohort of the OAI dataset.
  arXiv  Detail & Related papers  (2021-06-27T17:29:46Z)
• Multiple Sclerosis Lesion Activity Segmentation with Attention-Guided Two-Path CNNs [49.32653090178743]
  convolutional neural networks (CNNs) are studied for lesion activity segmentation from two time points. CNNs are designed and evaluated that combine the information from two points in different ways. It is demonstrated that deep learning-based methods outperform classic approaches.
  arXiv  Detail & Related papers  (2020-08-05T08:49:20Z)
• Dynamic Graph Correlation Learning for Disease Diagnosis with Incomplete Labels [66.57101219176275]
  Disease diagnosis on chest X-ray images is a challenging multi-label classification task. We propose a Disease Diagnosis Graph Convolutional Network (DD-GCN) that presents a novel view of investigating the inter-dependency among different diseases. Our method is the first to build a graph over the feature maps with a dynamic adjacency matrix for correlation learning.
  arXiv  Detail & Related papers  (2020-02-26T17:10:48Z)
• Disease State Prediction From Single-Cell Data Using Graph Attention Networks [7.314729122296431]
  We present a graph attention model for predicting disease state from single-cell data on a large dataset of Multiple Sclerosis (MS) patients. We achieve 92 % accuracy in predicting MS, outperforming other state-of-the-art methods such as a graph convolutional network and a random forest classifier. To the best of our knowledge, this is the first effort to use graph attention, and deep learning in general, to predict disease state from single-cell data.
  arXiv  Detail & Related papers  (2020-02-14T16:08:30Z)
• 1-D Convlutional Neural Networks for the Analysis of Pupil Size Variations in Scotopic Conditions [79.71065005161566]
  1-D convolutional neural network models are trained for classification of short-range sequences. Model provides prediction with high average accuracy on a hold out test set.
  arXiv  Detail & Related papers  (2020-02-06T17:25:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.