Alzheimer's Disease Diagnosis using a Multimodal Approach with 3D MRI and PET

• URL: http://arxiv.org/abs/2606.20037v1
• Date: Thu, 18 Jun 2026 10:11:14 GMT
• Title: Alzheimer's Disease Diagnosis using a Multimodal Approach with 3D MRI and PET
• Abstract summary: Alzheimer's disease (AD) is an irreversible neurodegenerative disorder and a leading cause of death worldwide.<n>Neuroimaging data, like Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) scans, can help detect brain changes early by providing structural and functional brain changes related to the disease.<n>Yet, many multimodal models still fuse MRI and PET with static concatenation and apply identical computation to all subjects.<n>We present the first study of combining 3D convolutional feature extractors with three fusion strategies - concatenation, Gated Multimodal Unit (GMU), and gated self-attention.
• Score: 8.600348180154592
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Alzheimer's disease (AD) is an irreversible neurodegenerative disorder and a leading cause of death worldwide. Early diagnosis plays an important part especially at the Mild Cognitive Impairment stage, where timely intervention can help slow its progression before it advances to AD. Neuroimaging data, like Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) scans, can help detect brain changes early by providing structural and functional brain changes related to the disease. Yet, many multimodal models still fuse MRI and PET with static concatenation and apply identical computation to all subjects, which limits robustness to patient/site heterogeneity and can waste computation. To address these limitations, we present the first study of combining 3D convolutional feature extractors with three fusion strategies - concatenation, Gated Multimodal Unit (GMU), and gated self-attention - and a sparsely gated Mixture-of-Experts (MoE) classifier that performs input-adaptive routing, activating only the most informative experts per case. Finally, we utilize Grad-CAM to visualize disease-related regions, ensuring model interpretability. Experiments are performed across three binary classification tasks (NC vs. MCI, MCI vs. AD, and NC vs. AD). Results show that GMU achieves accuracies of 80.46 % (NC vs. MCI) and 95.47 % (NC vs. AD), while gated self-attention attains 82.08 % on MCI vs. AD. Ablations show that removing the MoE consistently degrades accuracy across all tasks. These findings underscore the value of input-adaptive, multimodal modeling for AD diagnosis by leveraging the complementary nature of MRI and PET.

Related papers

• D3Seg: Dependency-Aware Diffusion for Brain Tumor Segmentation with Missing Modalities [54.87947751720332]
  We propose a novel segmentation model D3Seg to maintain stable performance under missing-modality settings.<n>The proposed model achieves approximately 1.5-2.0% Dice improvement on enhancing tumor (ET) and around 1.0% on tumor core (TC) across multiple missing modality configurations.
  arXiv  Detail & Related papers  (2026-05-21T09:55:42Z)
• UniField: A Unified Field-Aware MRI Enhancement Framework [45.03230466428695]
  methodname is a unified framework integrating multiple modalities and enhancement tasks.<n>We exploit comprehensive 3D volumetric information by leveraging pre-trained 3D foundation models.<n>We organize and publicly release a comprehensive paired multi-field MRI dataset.
  arXiv  Detail & Related papers  (2026-03-10T05:45:12Z)
• R-GenIMA: Integrating Neuroimaging and Genetics with Interpretable Multimodal AI for Alzheimer's Disease Progression [63.97617759805451]
  Early detection of Alzheimer's disease requires models capable of integrating macro-scale neuroanatomical alterations with micro-scale genetic susceptibility.<n>We introduce R-GenIMA, an interpretable multimodal large language model that couples a novel ROI-wise vision transformer with genetic prompting.<n>R-GenIMA achieves state-of-the-art performance in four-way classification across normal cognition, subjective memory concerns, mild cognitive impairment, and AD.
  arXiv  Detail & Related papers  (2025-12-22T02:54:10Z)
• EffNetViTLoRA: An Efficient Hybrid Deep Learning Approach for Alzheimer's Disease Diagnosis [2.220152876549942]
  Alzheimer's disease (AD) is one of the most prevalent neurodegenerative disorders worldwide.<n>EffNetViTLoRA is an end-to-end model for AD diagnosis using the Alzheimer's Disease Neuroimaging Initiative (ADNI) Magnetic Resonance Imaging (MRI) dataset.
  arXiv  Detail & Related papers  (2025-08-26T18:22:28Z)
• Cross-Attention Fusion of MRI and Jacobian Maps for Alzheimer's Disease Diagnosis [5.955559082904072]
  We propose a cross-attention fusion framework to model the intrinsic relationship between sMRI intensity and JSM-derived deformations for Alzheimer's disease classification.<n>Cross-attention fusion achieves superior performance, with mean ROC-AUC scores of 0.903 for AD vs. cognitively normal (CN) and 0.692 for mild cognitive impairment (MCI) vs. CN.<n>Despite its strong performance, our model remains highly efficient, with only 1.56 million parameters--over 40 times fewer than ResNet-34 (63M) and Swin UNETR (61.98M)
  arXiv  Detail & Related papers  (2025-03-01T18:50:46Z)
• DiaMond: Dementia Diagnosis with Multi-Modal Vision Transformers Using MRI and PET [9.229658208994675]
  We propose a novel framework, DiaMond, to integrate MRI and PET. DiaMond is equipped with self-attention and a novel bi-attention mechanism that synergistically combine MRI and PET. It significantly outperforms existing multi-modal methods across various datasets.
  arXiv  Detail & Related papers  (2024-10-30T17:11:00Z)
• GFE-Mamba: Mamba-based AD Multi-modal Progression Assessment via Generative Feature Extraction from MCI [5.834776094182435]
  Alzheimer's Disease (AD) is a progressive, irreversible neurodegenerative disorder that often originates from Mild Cognitive Impairment (MCI)<n>The GFE-Mamba model effectively predicts the progression from MCI to AD and surpasses several leading methods in the field.
  arXiv  Detail & Related papers  (2024-07-22T15:22:33Z)
• AXIAL: Attention-based eXplainability for Interpretable Alzheimer's Localized Diagnosis using 2D CNNs on 3D MRI brain scans [43.06293430764841]
  This study presents an innovative method for Alzheimer's disease diagnosis using 3D MRI designed to enhance the explainability of model decisions. Our approach adopts a soft attention mechanism, enabling 2D CNNs to extract volumetric representations. With voxel-level precision, our method identified which specific areas are being paid attention to, identifying these predominant brain regions.
  arXiv  Detail & Related papers  (2024-07-02T16:44:00Z)
• Cross-modality Guidance-aided Multi-modal Learning with Dual Attention for MRI Brain Tumor Grading [47.50733518140625]
  Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly. We propose a novel cross-modality guidance-aided multi-modal learning with dual attention for addressing the task of MRI brain tumor grading.
  arXiv  Detail & Related papers  (2024-01-17T07:54:49Z)
• Unsupervised Anomaly Detection using Aggregated Normative Diffusion [46.24703738821696]
  Unsupervised anomaly detection has the potential to identify a broader spectrum of anomalies. Existing state-of-the-art UAD approaches do not generalise well to diverse types of anomalies. We introduce a new UAD method named Aggregated Normative Diffusion (ANDi)
  arXiv  Detail & Related papers  (2023-12-04T14:02:56Z)
• Is a PET all you need? A multi-modal study for Alzheimer's disease using 3D CNNs [3.678164468512092]
  Alzheimer's Disease (AD) is the most common form of dementia and often difficult to diagnose due to the multifactorial etiology of dementia. Recent works on neuroimaging-based computer-aided diagnosis with deep neural networks (DNNs) showed that fusing structural magnetic resonance images (sMRI) and fluorodeoxyglucose positron emission tomography (FDG-PET) leads to improved accuracy in a study population of healthy controls and subjects with AD. We argue that future work on multi-modal fusion should systematically assess the contribution of individual modalities following our proposed evaluation framework.
  arXiv  Detail & Related papers  (2022-07-05T14:55:56Z)
• Automatic Assessment of Alzheimer's Disease Diagnosis Based on Deep Learning Techniques [111.165389441988]
  This work is to develop a system that automatically detects the presence of the disease in sagittal magnetic resonance images (MRI) Although sagittal-plane MRIs are not commonly used, this work proved that they were, at least, as effective as MRI from other planes at identifying AD in early stages. This study proved that DL models could be built in these fields, whereas TL is an essential tool for completing the task with fewer examples.
  arXiv  Detail & Related papers  (2021-05-18T11:37:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.