HA-HI: Synergising fMRI and DTI through Hierarchical Alignments and
Hierarchical Interactions for Mild Cognitive Impairment Diagnosis
- URL: http://arxiv.org/abs/2401.06780v1
- Date: Tue, 2 Jan 2024 12:46:02 GMT
- Title: HA-HI: Synergising fMRI and DTI through Hierarchical Alignments and
Hierarchical Interactions for Mild Cognitive Impairment Diagnosis
- Authors: Xiongri Shen, Zhenxi Song, Linling Li, Min Zhang, Lingyan Liang
Honghai Liu, Demao Deng, Zhiguo Zhang
- Abstract summary: We introduce a novel Hierarchical Alignments and Hierarchical Interactions (HA-HI) method for diagnosis of mild cognitive impairment (MCI) and subjective cognitive decline (SCD)
HA-HI efficiently learns significant MCI- or SCD- related regional and connectivity features by aligning various feature types and hierarchically maximizing their interactions.
To enhance the interpretability of our approach, we have developed the Synergistic Activation Map (SAM) technique, revealing the critical brain regions and connections that are indicative of MCI/SCD.
- Score: 10.028997265879598
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Early diagnosis of mild cognitive impairment (MCI) and subjective cognitive
decline (SCD) utilizing multi-modal magnetic resonance imaging (MRI) is a
pivotal area of research. While various regional and connectivity features from
functional MRI (fMRI) and diffusion tensor imaging (DTI) have been employed to
develop diagnosis models, most studies integrate these features without
adequately addressing their alignment and interactions. This limits the
potential to fully exploit the synergistic contributions of combined features
and modalities. To solve this gap, our study introduces a novel Hierarchical
Alignments and Hierarchical Interactions (HA-HI) method for MCI and SCD
classification, leveraging the combined strengths of fMRI and DTI. HA-HI
efficiently learns significant MCI- or SCD- related regional and connectivity
features by aligning various feature types and hierarchically maximizing their
interactions. Furthermore, to enhance the interpretability of our approach, we
have developed the Synergistic Activation Map (SAM) technique, revealing the
critical brain regions and connections that are indicative of MCI/SCD.
Comprehensive evaluations on the ADNI dataset and our self-collected data
demonstrate that HA-HI outperforms other existing methods in diagnosing MCI and
SCD, making it a potentially vital and interpretable tool for early detection.
The implementation of this method is publicly accessible at
https://github.com/ICI-BCI/Dual-MRI-HA-HI.git.
Related papers
- Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation [56.34634121544929]
In this study, we first construct the brain-effective network via the dynamic causal model.
We then introduce an interpretable graph learning framework termed Spatio-Temporal Embedding ODE (STE-ODE)
This framework incorporates specifically designed directed node embedding layers, aiming at capturing the dynamic interplay between structural and effective networks.
arXiv Detail & Related papers (2024-05-21T20:37:07Z) - An Interpretable Cross-Attentive Multi-modal MRI Fusion Framework for Schizophrenia Diagnosis [46.58592655409785]
We propose a novel Cross-Attentive Multi-modal Fusion framework (CAMF) to capture both intra-modal and inter-modal relationships between fMRI and sMRI.
Our approach significantly improves classification accuracy, as demonstrated by our evaluations on two extensive multi-modal brain imaging datasets.
The gradient-guided Score-CAM is applied to interpret critical functional networks and brain regions involved in schizophrenia.
arXiv Detail & Related papers (2024-03-29T20:32:30Z) - DiffGAN-F2S: Symmetric and Efficient Denoising Diffusion GANs for
Structural Connectivity Prediction from Brain fMRI [15.40111168345568]
It is challenging to bridge the reliable non-linear mapping relations between structural connectivity (SC) and functional magnetic resonance imaging (fMRI)
A novel diffusision generative adversarial network-based fMRI-to-SC model is proposed to predict SC from brain fMRI in an end-to-end manner.
arXiv Detail & Related papers (2023-09-28T06:55:50Z) - UniBrain: Universal Brain MRI Diagnosis with Hierarchical
Knowledge-enhanced Pre-training [66.16134293168535]
We propose a hierarchical knowledge-enhanced pre-training framework for the universal brain MRI diagnosis, termed as UniBrain.
Specifically, UniBrain leverages a large-scale dataset of 24,770 imaging-report pairs from routine diagnostics.
arXiv Detail & Related papers (2023-09-13T09:22:49Z) - Fusing Structural and Functional Connectivities using Disentangled VAE
for Detecting MCI [9.916963496386089]
A novel hierarchical structural-functional connectivity fusing (HSCF) model is proposed to construct brain structural-functional connectivity matrices.
Results from a wide range of tests performed on the public Alzheimer's Disease Neuroimaging Initiative database show that the proposed model performs better than competing approaches.
arXiv Detail & Related papers (2023-06-16T05:22:25Z) - fMRI from EEG is only Deep Learning away: the use of interpretable DL to
unravel EEG-fMRI relationships [68.8204255655161]
We present an interpretable domain grounded solution to recover the activity of several subcortical regions from multichannel EEG data.
We recover individual spatial and time-frequency patterns of scalp EEG predictive of the hemodynamic signal in the subcortical nuclei.
arXiv Detail & Related papers (2022-10-23T15:11:37Z) - Hierarchical Graph Convolutional Network Built by Multiscale Atlases for
Brain Disorder Diagnosis Using Functional Connectivity [48.75665245214903]
We propose a novel framework to perform multiscale FCN analysis for brain disorder diagnosis.
We first use a set of well-defined multiscale atlases to compute multiscale FCNs.
Then, we utilize biologically meaningful brain hierarchical relationships among the regions in multiscale atlases to perform nodal pooling.
arXiv Detail & Related papers (2022-09-22T04:17:57Z) - Cross-Modality Deep Feature Learning for Brain Tumor Segmentation [158.8192041981564]
This paper proposes a novel cross-modality deep feature learning framework to segment brain tumors from the multi-modality MRI data.
The core idea is to mine rich patterns across the multi-modality data to make up for the insufficient data scale.
Comprehensive experiments are conducted on the BraTS benchmarks, which show that the proposed cross-modality deep feature learning framework can effectively improve the brain tumor segmentation performance.
arXiv Detail & Related papers (2022-01-07T07:46:01Z) - Characterization Multimodal Connectivity of Brain Network by Hypergraph
GAN for Alzheimer's Disease Analysis [30.99183477161096]
multimodal neuroimaging data to characterize brain network is currently an advanced technique for Alzheimer's disease(AD) Analysis.
We propose a novel Hypergraph Generative Adversarial Networks(HGGAN) to generate multimodal connectivity of Brain Network from rs-fMRI combination with DTI.
arXiv Detail & Related papers (2021-07-21T09:02:29Z) - Mapping individual differences in cortical architecture using multi-view
representation learning [0.0]
We introduce a novel machine learning method which allows combining the activation-and connectivity-based information respectively measured through task-fMRI and resting-state fMRI.
It combines a multi-view deep autoencoder which is designed to fuse the two fMRI modalities into a joint representation space within which a predictive model is trained to guess a scalar score that characterizes the patient.
arXiv Detail & Related papers (2020-04-01T09:01:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.