Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attention

• URL: http://arxiv.org/abs/2105.13495v1
• Date: Thu, 27 May 2021 23:06:50 GMT
• Title: Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attention
• Authors: Byung-Hoon Kim, Jong Chul Ye, Jae-Jin Kim
• Abstract summary: We propose STAGIN, a method for learning dynamic graph representation of the brain connectome with temporal attention. Experiments on the HCP-Rest and the HCP-Task datasets demonstrate exceptional performance of our proposed method.
• Score: 33.049423523704824
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Functional connectivity (FC) between regions of the brain can be assessed by the degree of temporal correlation measured with functional neuroimaging modalities. Based on the fact that these connectivities build a network, graph-based approaches for analyzing the brain connectome have provided insights into the functions of the human brain. The development of graph neural networks (GNNs) capable of learning representation from graph structured data has led to increased interest in learning the graph representation of the brain connectome. Although recent attempts to apply GNN to the FC network have shown promising results, there is still a common limitation that they usually do not incorporate the dynamic characteristics of the FC network which fluctuates over time. In addition, a few studies that have attempted to use dynamic FC as an input for the GNN reported a reduction in performance compared to static FC methods, and did not provide temporal explainability. Here, we propose STAGIN, a method for learning dynamic graph representation of the brain connectome with spatio-temporal attention. Specifically, a temporal sequence of brain graphs is input to the STAGIN to obtain the dynamic graph representation, while novel READOUT functions and the Transformer encoder provide spatial and temporal explainability with attention, respectively. Experiments on the HCP-Rest and the HCP-Task datasets demonstrate exceptional performance of our proposed method. Analysis of the spatio-temporal attention also provide concurrent interpretation with the neuroscientific knowledge, which further validates our method. Code is available at https://github.com/egyptdj/stagin

Related papers

• Graph Neural Networks for Brain Graph Learning: A Survey [53.74244221027981]
  Graph neural networks (GNNs) have demonstrated a significant advantage in mining graph-structured data. GNNs to learn brain graph representations for brain disorder analysis has recently gained increasing attention. In this paper, we aim to bridge this gap by reviewing brain graph learning works that utilize GNNs.
  arXiv  Detail & Related papers  (2024-06-01T02:47:39Z)
• JGAT: a joint spatio-temporal graph attention model for brain decoding [8.844033583141039]
  Joint kernel Graph Attention Network (JGAT) is a new multi-modal temporal graph attention network framework. It integrates the data from functional Magnetic Resonance Images (fMRI) and Diffusion Weighted Imaging (DWI) while preserving the dynamic information. We conduct brain-decoding tasks with our JGAT on four independent datasets.
  arXiv  Detail & Related papers  (2023-06-03T02:45:03Z)
• Language Knowledge-Assisted Representation Learning for Skeleton-Based Action Recognition [71.35205097460124]
  How humans understand and recognize the actions of others is a complex neuroscientific problem. LA-GCN proposes a graph convolution network using large-scale language models (LLM) knowledge assistance.
  arXiv  Detail & Related papers  (2023-05-21T08:29:16Z)
• DBGDGM: Dynamic Brain Graph Deep Generative Model [63.23390833353625]
  Graphs are a natural representation of brain activity derived from functional magnetic imaging (fMRI) data. It is well known that clusters of anatomical brain regions, known as functional connectivity networks (FCNs), encode temporal relationships which can serve as useful biomarkers for understanding brain function and dysfunction. Previous works, however, ignore the temporal dynamics of the brain and focus on static graphs. We propose a dynamic brain graph deep generative model (DBGDGM) which simultaneously clusters brain regions into temporally evolving communities and learns dynamic unsupervised node embeddings.
  arXiv  Detail & Related papers  (2023-01-26T20:45:30Z)
• DynDepNet: Learning Time-Varying Dependency Structures from fMRI Data via Dynamic Graph Structure Learning [58.94034282469377]
  We propose DynDepNet, a novel method for learning the optimal time-varying dependency structure of fMRI data induced by downstream prediction tasks. Experiments on real-world fMRI datasets, for the task of sex classification, demonstrate that DynDepNet achieves state-of-the-art results.
  arXiv  Detail & Related papers  (2022-09-27T16:32:11Z)
• Learning to Model the Relationship Between Brain Structural and Functional Connectomes [16.096428756895918]
  We develop a graph representation learning framework to model the relationship between brainobjective connectivity (SC) and functional connectivity (FC) A trainable graph convolutional encoder captures interactions between brain regions-of-interest that mimic actual neural communications. Experiments demonstrate that the learnt representations capture valuable information from the intrinsic properties of the subject's brain networks.
  arXiv  Detail & Related papers  (2021-12-18T11:23:55Z)
• Dynamic Adaptive Spatio-temporal Graph Convolution for fMRI Modelling [0.0]
  We propose a dynamic adaptivetemporal graph convolution (DASTGCN) model to overcome the shortcomings of pre-defined static correlation-based graph structures. The proposed approach allows end-to-end inference of dynamic connections between brain regions via layer-wise graph structure learning module. We evaluate our pipeline on the UKBiobank for age and gender classification tasks from resting-state functional scans.
  arXiv  Detail & Related papers  (2021-09-26T07:19:47Z)
• Graph Structure of Neural Networks [104.33754950606298]
  We show how the graph structure of neural networks affect their predictive performance. A "sweet spot" of relational graphs leads to neural networks with significantly improved predictive performance. Top-performing neural networks have graph structure surprisingly similar to those of real biological neural networks.
  arXiv  Detail & Related papers  (2020-07-13T17:59:31Z)
• Spatio-Temporal Graph Convolution for Resting-State fMRI Analysis [11.85489505372321]
  We train a-temporal graph convolutional network (ST-GCN) on short sub-sequences of the BOLD time series to model the non-stationary nature of functional connectivity. St-GCN is significantly more accurate than common approaches in predicting gender and age based on BOLD signals.
  arXiv  Detail & Related papers  (2020-03-24T01:56:50Z)
• Understanding Graph Isomorphism Network for rs-fMRI Functional Connectivity Analysis [49.05541693243502]
  We develop a framework for analyzing fMRI data using the Graph Isomorphism Network (GIN) One of the important contributions of this paper is the observation that the GIN is a dual representation of convolutional neural network (CNN) in the graph space. We exploit CNN-based saliency map techniques for the GNN, which we tailor to the proposed GIN with one-hot encoding.
  arXiv  Detail & Related papers  (2020-01-10T23:40:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.