Longitudinal Self-Supervised Learning

• URL: http://arxiv.org/abs/2006.06930v2
• Date: Sat, 26 Jun 2021 04:20:17 GMT
• Title: Longitudinal Self-Supervised Learning
• Authors: Qingyu Zhao, Zixuan Liu, Ehsan Adeli, Kilian M. Pohl
• Abstract summary: Ground-truth labels are often missing or expensive to obtain in neuroscience. We propose a new definition of disentanglement by formulating a multivariate mapping between factors associated with an MRI and a latent image representation. We implement this model, named Longitudinal Self-Supervised Learning (LSSL), via a standard autoencoding structure with a cosine loss to disentangle brain age from the image representation.
• Score: 13.094393751939837
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Machine learning analysis of longitudinal neuroimaging data is typically based on supervised learning, which requires a large number of ground-truth labels to be informative. As ground-truth labels are often missing or expensive to obtain in neuroscience, we avoid them in our analysis by combing factor disentanglement with self-supervised learning to identify changes and consistencies across the multiple MRIs acquired of each individual over time. Specifically, we propose a new definition of disentanglement by formulating a multivariate mapping between factors (e.g., brain age) associated with an MRI and a latent image representation. Then, factors that evolve across acquisitions of longitudinal sequences are disentangled from that mapping by self-supervised learning in such a way that changes in a single factor induce change along one direction in the representation space. We implement this model, named Longitudinal Self-Supervised Learning (LSSL), via a standard autoencoding structure with a cosine loss to disentangle brain age from the image representation. We apply LSSL to two longitudinal neuroimaging studies to highlight its strength in extracting the brain-age information from MRI and revealing informative characteristics associated with neurodegenerative and neuropsychological disorders. Moreover, the representations learned by LSSL facilitate supervised classification by recording faster convergence and higher (or similar) prediction accuracy compared to several other representation learning techniques.

Related papers

• Generative forecasting of brain activity enhances Alzheimer's classification and interpretation [16.09844316281377]
  Resting-state functional magnetic resonance imaging (rs-fMRI) offers a non-invasive method to monitor neural activity. Deep learning has shown promise in capturing these representations. In this study, we focus on time series forecasting of independent component networks derived from rs-fMRI as a form of data augmentation.
  arXiv  Detail & Related papers  (2024-10-30T23:51:31Z)
• Brain-Cognition Fingerprinting via Graph-GCCA with Contrastive Learning [28.681229869236393]
  longitudinal neuroimaging studies aim to improve the understanding of brain aging and diseases by studying the dynamic interactions between brain function and cognition. We propose an unsupervised learning model that encodes their relationship via Graph Attention Networks and generalized Correlational Analysis. To create brain-cognition fingerprints reflecting unique neural and cognitive phenotype of each person, the model also relies on individualized and multimodal contrastive learning.
  arXiv  Detail & Related papers  (2024-09-20T20:36:20Z)
• Knowledge-Guided Prompt Learning for Lifespan Brain MR Image Segmentation [53.70131202548981]
  We present a two-step segmentation framework employing Knowledge-Guided Prompt Learning (KGPL) for brain MRI. Specifically, we first pre-train segmentation models on large-scale datasets with sub-optimal labels. The introduction of knowledge-wise prompts captures semantic relationships between anatomical variability and biological processes.
  arXiv  Detail & Related papers  (2024-07-31T04:32:43Z)
• MindFormer: Semantic Alignment of Multi-Subject fMRI for Brain Decoding [50.55024115943266]
  We introduce a novel semantic alignment method of multi-subject fMRI signals using so-called MindFormer. This model is specifically designed to generate fMRI-conditioned feature vectors that can be used for conditioning Stable Diffusion model for fMRI- to-image generation or large language model (LLM) for fMRI-to-text generation. Our experimental results demonstrate that MindFormer generates semantically consistent images and text across different subjects.
  arXiv  Detail & Related papers  (2024-05-28T00:36:25Z)
• Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
  We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy. We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
  arXiv  Detail & Related papers  (2023-03-07T09:40:22Z)
• SF2Former: Amyotrophic Lateral Sclerosis Identification From Multi-center MRI Data Using Spatial and Frequency Fusion Transformer [3.408266725482757]
  Amyotrophic Lateral Sclerosis (ALS) is a complex neurodegenerative disorder involving motor neuron degeneration. Deep learning has turned into a prominent class of machine learning programs in computer vision. This study introduces a framework named SF2Former that leverages vision transformer architecture's power to distinguish the ALS subjects from the control group.
  arXiv  Detail & Related papers  (2023-02-21T18:16:20Z)
• NeuroExplainer: Fine-Grained Attention Decoding to Uncover Cortical Development Patterns of Preterm Infants [73.85768093666582]
  We propose an explainable geometric deep network dubbed NeuroExplainer. NeuroExplainer is used to uncover altered infant cortical development patterns associated with preterm birth.
  arXiv  Detail & Related papers  (2023-01-01T12:48:12Z)
• Predicting Brain Age using Transferable coVariance Neural Networks [119.45320143101381]
  We have recently studied covariance neural networks (VNNs) that operate on sample covariance matrices. In this paper, we demonstrate the utility of VNNs in inferring brain age using cortical thickness data. Our results show that VNNs exhibit multi-scale and multi-site transferability for inferring brain age In the context of brain age in Alzheimer's disease (AD), our experiments show that i) VNN outputs are interpretable as brain age predicted using VNNs is significantly elevated for AD with respect to healthy subjects.
  arXiv  Detail & Related papers  (2022-10-28T18:58:34Z)
• Learning Personal Representations from fMRIby Predicting Neurofeedback Performance [52.77024349608834]
  We present a deep neural network method for learning a personal representation for individuals performing a self neuromodulation task, guided by functional MRI (fMRI) The representation is learned by a self-supervised recurrent neural network, that predicts the Amygdala activity in the next fMRI frame given recent fMRI frames and is conditioned on the learned individual representation.
  arXiv  Detail & Related papers  (2021-12-06T10:16:54Z)
• Self-Supervised Longitudinal Neighbourhood Embedding [13.633165258766418]
  We propose a self-supervised strategy for representation learning named Longitudinal Neighborhood Embedding. Motivated by concepts in contrastive learning, LNE explicitly models the similarity between trajectory vectors across different subjects. We apply LNE to longitudinal T1w MRIs of two neuroimaging studies: a dataset composed of 274 healthy subjects, and Alzheimer's Disease Neuroimaging Initiative.
  arXiv  Detail & Related papers  (2021-03-05T17:55:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.