Deep Representation Learning For Multimodal Brain Networks

• URL: http://arxiv.org/abs/2007.09777v1
• Date: Sun, 19 Jul 2020 20:32:05 GMT
• Title: Deep Representation Learning For Multimodal Brain Networks
• Authors: Wen Zhang, Liang Zhan, Paul Thompson, Yalin Wang
• Abstract summary: We propose a novel end-to-end deep graph representation learning (Deep Multimodal Brain Networks - DMBN) to fuse multimodal brain networks. The higher-order network mappings from brain structural networks to functional networks are learned in the node domain. The experimental results show the superiority of the proposed method over some other state-of-the-art deep brain network models.
• Score: 9.567489601729328
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Applying network science approaches to investigate the functions and anatomy of the human brain is prevalent in modern medical imaging analysis. Due to the complex network topology, for an individual brain, mining a discriminative network representation from the multimodal brain networks is non-trivial. The recent success of deep learning techniques on graph-structured data suggests a new way to model the non-linear cross-modality relationship. However, current deep brain network methods either ignore the intrinsic graph topology or require a network basis shared within a group. To address these challenges, we propose a novel end-to-end deep graph representation learning (Deep Multimodal Brain Networks - DMBN) to fuse multimodal brain networks. Specifically, we decipher the cross-modality relationship through a graph encoding and decoding process. The higher-order network mappings from brain structural networks to functional networks are learned in the node domain. The learned network representation is a set of node features that are informative to induce brain saliency maps in a supervised manner. We test our framework in both synthetic and real image data. The experimental results show the superiority of the proposed method over some other state-of-the-art deep brain network models.

Related papers

• Graph Neural Networks for Brain Graph Learning: A Survey [53.74244221027981]
  Graph neural networks (GNNs) have demonstrated a significant advantage in mining graph-structured data. GNNs to learn brain graph representations for brain disorder analysis has recently gained increasing attention. In this paper, we aim to bridge this gap by reviewing brain graph learning works that utilize GNNs.
  arXiv  Detail & Related papers  (2024-06-01T02:47:39Z)
• Brain Decodes Deep Nets [9.302098067235507]
  We developed a tool for visualizing and analyzing large pre-trained vision models by mapping them onto the brain. Our innovation arises from a surprising usage of brain encoding: predicting brain fMRI measurements in response to images.
  arXiv  Detail & Related papers  (2023-12-03T04:36:04Z)
• Multi-State Brain Network Discovery [37.63826758134553]
  Brain network aims to find nodes and average signals from fMRI scans of human brains. Human brain usually involves multiple activity states, which jointly determine the brain's activities.
  arXiv  Detail & Related papers  (2023-11-04T17:54:15Z)
• Contrastive Brain Network Learning via Hierarchical Signed Graph Pooling Model [64.29487107585665]
  Graph representation learning techniques on brain functional networks can facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. Here, we propose an interpretable hierarchical signed graph representation learning model to extract graph-level representations from brain functional networks. In order to further improve the model performance, we also propose a new strategy to augment functional brain network data for contrastive learning.
  arXiv  Detail & Related papers  (2022-07-14T20:03:52Z)
• Functional2Structural: Cross-Modality Brain Networks Representation Learning [55.24969686433101]
  Graph mining on brain networks may facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. We propose a novel graph learning framework, known as Deep Signed Brain Networks (DSBN), with a signed graph encoder. We validate our framework on clinical phenotype and neurodegenerative disease prediction tasks using two independent, publicly available datasets.
  arXiv  Detail & Related papers  (2022-05-06T03:45:36Z)
• Deep Reinforcement Learning Guided Graph Neural Networks for Brain Network Analysis [61.53545734991802]
  We propose a novel brain network representation framework, namely BN-GNN, which searches for the optimal GNN architecture for each brain network. Our proposed BN-GNN improves the performance of traditional GNNs on different brain network analysis tasks.
  arXiv  Detail & Related papers  (2022-03-18T07:05:27Z)
• Can the brain use waves to solve planning problems? [62.997667081978825]
  We present a neural network model which can solve such tasks. The model is compatible with a broad range of empirical findings about the mammalian neocortex and hippocampus.
  arXiv  Detail & Related papers  (2021-10-11T11:07:05Z)
• A Few-shot Learning Graph Multi-Trajectory Evolution Network for Forecasting Multimodal Baby Connectivity Development from a Baseline Timepoint [53.73316520733503]
  We propose a Graph Multi-Trajectory Evolution Network (GmTE-Net), which adopts a teacher-student paradigm. This is the first teacher-student architecture tailored for brain graph multi-trajectory growth prediction.
  arXiv  Detail & Related papers  (2021-10-06T08:26:57Z)
• Joint Embedding of Structural and Functional Brain Networks with Graph Neural Networks for Mental Illness Diagnosis [17.48272758284748]
  Graph Neural Networks (GNNs) have become a de facto model for analyzing graph-structured data. We develop a novel multiview GNN for multimodal brain networks. In particular, we regard each modality as a view for brain networks and employ contrastive learning for multimodal fusion.
  arXiv  Detail & Related papers  (2021-07-07T13:49:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.