Longformer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIs

• URL: http://arxiv.org/abs/2302.00901v4
• Date: Fri, 15 Dec 2023 03:44:59 GMT
• Title: Longformer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIs
• Authors: Qiuhui Chen, Yi Hong
• Abstract summary: We propose a novel model Longformer, a transformer network that performs attention mechanisms spatially on sMRIs at each time point. Our Longformer achieves state-of-the-art performance on two binary classification tasks of separating different stages of Alzheimer's disease (AD) using the AD dataset.
• Score: 1.9450973046619378
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Structural magnetic resonance imaging (sMRI) is widely used for brain neurological disease diagnosis; while longitudinal MRIs are often collected to monitor and capture disease progression, as clinically used in diagnosing Alzheimer's disease (AD). However, most current methods neglect AD's progressive nature and only take a single sMRI for recognizing AD. In this paper, we consider the problem of leveraging the longitudinal MRIs of a subject for AD identification. To capture longitudinal changes in sMRIs, we propose a novel model Longformer, a spatiotemporal transformer network that performs attention mechanisms spatially on sMRIs at each time point and integrates brain region features over time to obtain longitudinal embeddings for classification. Our Longformer achieves state-of-the-art performance on two binary classification tasks of separating different stages of AD using the ADNI dataset. Our source code is available at https://github.com/Qybc/LongFormer.

Related papers

• Individualized multi-horizon MRI trajectory prediction for Alzheimer's Disease [0.0]
  We train a novel architecture to build a latent space distribution which can be sampled from to generate future predictions of changing anatomy. By comparing to several alternatives, we show that our model produces more individualized images with higher resolution.
  arXiv  Detail & Related papers  (2024-08-04T13:09:06Z)
• Cross-modality Guidance-aided Multi-modal Learning with Dual Attention for MRI Brain Tumor Grading [47.50733518140625]
  Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly. We propose a novel cross-modality guidance-aided multi-modal learning with dual attention for addressing the task of MRI brain tumor grading.
  arXiv  Detail & Related papers  (2024-01-17T07:54:49Z)
• Volumetric Reconstruction Resolves Off-Resonance Artifacts in Static and Dynamic PROPELLER MRI [76.60362295758596]
  Off-resonance artifacts in magnetic resonance imaging (MRI) are visual distortions that occur when the actual resonant frequencies of spins within the imaging volume differ from the expected frequencies used to encode spatial information. We propose to resolve these artifacts by lifting the 2D MRI reconstruction problem to 3D, introducing an additional "spectral" dimension to model this off-resonance.
  arXiv  Detail & Related papers  (2023-11-22T05:44:51Z)
• fMRI-PTE: A Large-scale fMRI Pretrained Transformer Encoder for Multi-Subject Brain Activity Decoding [54.17776744076334]
  We propose fMRI-PTE, an innovative auto-encoder approach for fMRI pre-training. Our approach involves transforming fMRI signals into unified 2D representations, ensuring consistency in dimensions and preserving brain activity patterns. Our contributions encompass introducing fMRI-PTE, innovative data transformation, efficient training, a novel learning strategy, and the universal applicability of our approach.
  arXiv  Detail & Related papers  (2023-11-01T07:24:22Z)
• Multi-Dimension-Embedding-Aware Modality Fusion Transformer for Psychiatric Disorder Clasification [13.529183496842819]
  We construct a deep learning architecture that takes as input 2D time series of rs-fMRI and 3D volumes T1w. We show that our proposed MFFormer performs better than that using a single modality or multi-modality MRI on schizophrenia and bipolar disorder diagnosis.
  arXiv  Detail & Related papers  (2023-10-04T10:02:04Z)
• Regional Deep Atrophy: a Self-Supervised Learning Method to Automatically Identify Regions Associated With Alzheimer's Disease Progression From Longitudinal MRI [1.465540676497032]
  We propose Regional Deep Atrophy, which combines the temporal inference approach from DeepAtrophy with a deformable registration neural network and attention mechanism. DeepAtrophy has high accuracy in inferring temporal information from longitudinal MRI scans, such as temporal order or relative inter-scan interval. RDA has similar prediction accuracy as DeepAtrophy, but its additional interpretability makes it more acceptable for use in clinical settings.
  arXiv  Detail & Related papers  (2023-04-10T15:50:19Z)
• Temporally Adjustable Longitudinal Fluid-Attenuated Inversion Recovery MRI Estimation / Synthesis for Multiple Sclerosis [0.0]
  Multiple Sclerosis (MS) is a chronic progressive neurological disease characterized by the development of lesions in the white matter of the brain. FLAIR brain magnetic resonance imaging (MRI) provides superior visualization and characterization of MS lesions, relative to other MRI modalities. Longitudinal brain FLAIR MRI in MS, involving repetitively imaging a patient over time, provides helpful information for clinicians towards monitoring disease progression. Predicting future whole brain MRI examinations with variable time lag has only been attempted in limited applications, such as healthy aging and structural degeneration in Alzheimer's Disease.
  arXiv  Detail & Related papers  (2022-09-09T12:42:00Z)
• Input Agnostic Deep Learning for Alzheimer's Disease Classification Using Multimodal MRI Images [1.4848525762485871]
  Alzheimer's disease (AD) is a progressive brain disorder that causes memory and functional impairments. In this work, we utilize a multi-modal deep learning approach in classifying normal cognition, mild cognitive impairment and AD classes.
  arXiv  Detail & Related papers  (2021-07-19T08:19:34Z)
• Automatic Assessment of Alzheimer's Disease Diagnosis Based on Deep Learning Techniques [111.165389441988]
  This work is to develop a system that automatically detects the presence of the disease in sagittal magnetic resonance images (MRI) Although sagittal-plane MRIs are not commonly used, this work proved that they were, at least, as effective as MRI from other planes at identifying AD in early stages. This study proved that DL models could be built in these fields, whereas TL is an essential tool for completing the task with fewer examples.
  arXiv  Detail & Related papers  (2021-05-18T11:37:57Z)
• 4D Spatio-Temporal Deep Learning with 4D fMRI Data for Autism Spectrum Disorder Classification [69.62333053044712]
  We propose a 4D convolutional deep learning approach for ASD classification where we jointly learn from spatial and temporal data. We employ 4D neural networks and convolutional-recurrent models which outperform a previous approach with an F1-score of 0.71 compared to an F1-score of 0.65.
  arXiv  Detail & Related papers  (2020-04-21T17:19:06Z)
• Microvascular Dynamics from 4D Microscopy Using Temporal Segmentation [81.30750944868142]
  We are able to track changes in cerebral blood volume over time and identify spontaneous arterial dilations that propagate towards the pial surface. This new imaging capability is a promising step towards characterizing the hemodynamic response function upon which functional magnetic resonance imaging (fMRI) is based.
  arXiv  Detail & Related papers  (2020-01-14T22:55:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.