BrainNetDiff: Generative AI Empowers Brain Network Generation via Multimodal Diffusion Model

• URL: http://arxiv.org/abs/2311.05199v1
• Date: Thu, 9 Nov 2023 08:27:12 GMT
• Title: BrainNetDiff: Generative AI Empowers Brain Network Generation via Multimodal Diffusion Model
• Authors: Yongcheng Zong, Shuqiang Wang
• Abstract summary: We introduce BrainNetDiff, which combines a multi-head Transformer encoder to extract relevant features from fMRI time series. We validate applicability of this framework in the construction of brain network across healthy and neurologically impaired cohorts.
• Score: 7.894526238189559
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Brain network analysis has emerged as pivotal method for gaining a deeper understanding of brain functions and disease mechanisms. Despite the existence of various network construction approaches, shortcomings persist in the learning of correlations between structural and functional brain imaging data. In light of this, we introduce a novel method called BrainNetDiff, which combines a multi-head Transformer encoder to extract relevant features from fMRI time series and integrates a conditional latent diffusion model for brain network generation. Leveraging a conditional prompt and a fusion attention mechanism, this method significantly improves the accuracy and stability of brain network generation. To the best of our knowledge, this represents the first framework that employs diffusion for the fusion of the multimodal brain imaging and brain network generation from images to graphs. We validate applicability of this framework in the construction of brain network across healthy and neurologically impaired cohorts using the authentic dataset. Experimental results vividly demonstrate the significant effectiveness of the proposed method across the downstream disease classification tasks. These findings convincingly emphasize the prospective value in the field of brain network research, particularly its key significance in neuroimaging analysis and disease diagnosis. This research provides a valuable reference for the processing of multimodal brain imaging data and introduces a novel, efficient solution to the field of neuroimaging.

Related papers

• D-CoRP: Differentiable Connectivity Refinement for Functional Brain Networks [4.675640373196467]
  Existing models for brain networks typically focus on brain regions or overlook the complexity of brain connectivities. We develop a differentiable module for refining brain connectivity. Our experimental results show that the proposed method can significantly improve the performance of various baseline models.
  arXiv  Detail & Related papers  (2024-05-28T23:49:52Z)
• Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation [56.34634121544929]
  In this study, we first construct the brain-effective network via the dynamic causal model. We then introduce an interpretable graph learning framework termed Spatio-Temporal Embedding ODE (STE-ODE) This framework incorporates specifically designed directed node embedding layers, aiming at capturing the dynamic interplay between structural and effective networks.
  arXiv  Detail & Related papers  (2024-05-21T20:37:07Z)
• BrainODE: Dynamic Brain Signal Analysis via Graph-Aided Neural Ordinary Differential Equations [67.79256149583108]
  We propose a novel model called BrainODE to achieve continuous modeling of dynamic brain signals. By learning latent initial values and neural ODE functions from irregular time series, BrainODE effectively reconstructs brain signals at any time point.
  arXiv  Detail & Related papers  (2024-04-30T10:53:30Z)
• Fusing Structural and Functional Connectivities using Disentangled VAE for Detecting MCI [9.916963496386089]
  A novel hierarchical structural-functional connectivity fusing (HSCF) model is proposed to construct brain structural-functional connectivity matrices. Results from a wide range of tests performed on the public Alzheimer's Disease Neuroimaging Initiative database show that the proposed model performs better than competing approaches.
  arXiv  Detail & Related papers  (2023-06-16T05:22:25Z)
• Transformer-Based Hierarchical Clustering for Brain Network Analysis [13.239896897835191]
  We propose a novel interpretable transformer-based model for joint hierarchical cluster identification and brain network classification. With the help of hierarchical clustering, the model achieves increased accuracy and reduced runtime complexity while providing plausible insight into the functional organization of brain regions.
  arXiv  Detail & Related papers  (2023-05-06T22:14:13Z)
• Brain Diffuser: An End-to-End Brain Image to Brain Network Pipeline [54.93591298333767]
  Brain diffuser is a diffusion based end-to-end brain network generative model. It exploits more structural connectivity features and disease-related information by analyzing disparities in structural brain networks across subjects. For the case of Alzheimer's disease, the proposed model performs better than the results from existing toolkits on the Alzheimer's Disease Neuroimaging Initiative database.
  arXiv  Detail & Related papers  (2023-03-11T14:04:58Z)
• Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
  We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy. We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
  arXiv  Detail & Related papers  (2023-03-07T09:40:22Z)
• A Structure-guided Effective and Temporal-lag Connectivity Network for Revealing Brain Disorder Mechanisms [8.459311736323572]
  We propose an effective temporal-lag neural network (termedN) to infer causal relationships and the temporal-lag values between brain regions. The evaluation results on the Alzheimer's Disease Neuroimaging Initiative (ADNI) database demonstrate the effectiveness of the proposed method.
  arXiv  Detail & Related papers  (2022-12-01T15:02:22Z)
• Functional2Structural: Cross-Modality Brain Networks Representation Learning [55.24969686433101]
  Graph mining on brain networks may facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. We propose a novel graph learning framework, known as Deep Signed Brain Networks (DSBN), with a signed graph encoder. We validate our framework on clinical phenotype and neurodegenerative disease prediction tasks using two independent, publicly available datasets.
  arXiv  Detail & Related papers  (2022-05-06T03:45:36Z)
• Deep Reinforcement Learning Guided Graph Neural Networks for Brain Network Analysis [61.53545734991802]
  We propose a novel brain network representation framework, namely BN-GNN, which searches for the optimal GNN architecture for each brain network. Our proposed BN-GNN improves the performance of traditional GNNs on different brain network analysis tasks.
  arXiv  Detail & Related papers  (2022-03-18T07:05:27Z)
• Joint Embedding of Structural and Functional Brain Networks with Graph Neural Networks for Mental Illness Diagnosis [17.48272758284748]
  Graph Neural Networks (GNNs) have become a de facto model for analyzing graph-structured data. We develop a novel multiview GNN for multimodal brain networks. In particular, we regard each modality as a view for brain networks and employ contrastive learning for multimodal fusion.
  arXiv  Detail & Related papers  (2021-07-07T13:49:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.