Longitudinal Self-Supervised Learning
- URL: http://arxiv.org/abs/2006.06930v2
- Date: Sat, 26 Jun 2021 04:20:17 GMT
- Title: Longitudinal Self-Supervised Learning
- Authors: Qingyu Zhao, Zixuan Liu, Ehsan Adeli, Kilian M. Pohl
- Abstract summary: Ground-truth labels are often missing or expensive to obtain in neuroscience.
We propose a new definition of disentanglement by formulating a multivariate mapping between factors associated with an MRI and a latent image representation.
We implement this model, named Longitudinal Self-Supervised Learning (LSSL), via a standard autoencoding structure with a cosine loss to disentangle brain age from the image representation.
- Score: 13.094393751939837
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Machine learning analysis of longitudinal neuroimaging data is typically
based on supervised learning, which requires a large number of ground-truth
labels to be informative. As ground-truth labels are often missing or expensive
to obtain in neuroscience, we avoid them in our analysis by combing factor
disentanglement with self-supervised learning to identify changes and
consistencies across the multiple MRIs acquired of each individual over time.
Specifically, we propose a new definition of disentanglement by formulating a
multivariate mapping between factors (e.g., brain age) associated with an MRI
and a latent image representation. Then, factors that evolve across
acquisitions of longitudinal sequences are disentangled from that mapping by
self-supervised learning in such a way that changes in a single factor induce
change along one direction in the representation space. We implement this
model, named Longitudinal Self-Supervised Learning (LSSL), via a standard
autoencoding structure with a cosine loss to disentangle brain age from the
image representation. We apply LSSL to two longitudinal neuroimaging studies to
highlight its strength in extracting the brain-age information from MRI and
revealing informative characteristics associated with neurodegenerative and
neuropsychological disorders. Moreover, the representations learned by LSSL
facilitate supervised classification by recording faster convergence and higher
(or similar) prediction accuracy compared to several other representation
learning techniques.
Related papers
- MindFormer: A Transformer Architecture for Multi-Subject Brain Decoding via fMRI [50.55024115943266]
We introduce a new Transformer architecture called MindFormer to generate fMRI-conditioned feature vectors.
MindFormer incorporates two key innovations: 1) a novel training strategy based on the IP-Adapter to extract semantically meaningful features from fMRI signals, and 2) a subject specific token and linear layer that effectively capture individual differences in fMRI signals.
arXiv Detail & Related papers (2024-05-28T00:36:25Z) - Neural Latent Aligner: Cross-trial Alignment for Learning
Representations of Complex, Naturalistic Neural Data [0.0]
We propose a novel unsupervised learning framework, Neural Latent Aligner (NLA), to find well-constrained, behaviorally relevant neural representations of complex behaviors.
The proposed framework learns more cross-trial consistent representations than the baselines, and when visualized, the manifold reveals shared neural trajectories across trials.
arXiv Detail & Related papers (2023-08-12T02:35:24Z) - MBrain: A Multi-channel Self-Supervised Learning Framework for Brain
Signals [7.682832730967219]
We study the self-supervised learning framework for brain signals that can be applied to pre-train either SEEG or EEG data.
Inspired by this, we propose MBrain to learn implicit spatial and temporal correlations between different channels.
Our model outperforms several state-of-the-art time series SSL and unsupervised models, and has the ability to be deployed to clinical practice.
arXiv Detail & Related papers (2023-06-15T09:14:26Z) - Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy.
We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
arXiv Detail & Related papers (2023-03-07T09:40:22Z) - SF2Former: Amyotrophic Lateral Sclerosis Identification From
Multi-center MRI Data Using Spatial and Frequency Fusion Transformer [3.408266725482757]
Amyotrophic Lateral Sclerosis (ALS) is a complex neurodegenerative disorder involving motor neuron degeneration.
Deep learning has turned into a prominent class of machine learning programs in computer vision.
This study introduces a framework named SF2Former that leverages vision transformer architecture's power to distinguish the ALS subjects from the control group.
arXiv Detail & Related papers (2023-02-21T18:16:20Z) - NeuroExplainer: Fine-Grained Attention Decoding to Uncover Cortical
Development Patterns of Preterm Infants [73.85768093666582]
We propose an explainable geometric deep network dubbed NeuroExplainer.
NeuroExplainer is used to uncover altered infant cortical development patterns associated with preterm birth.
arXiv Detail & Related papers (2023-01-01T12:48:12Z) - Predicting Brain Age using Transferable coVariance Neural Networks [119.45320143101381]
We have recently studied covariance neural networks (VNNs) that operate on sample covariance matrices.
In this paper, we demonstrate the utility of VNNs in inferring brain age using cortical thickness data.
Our results show that VNNs exhibit multi-scale and multi-site transferability for inferring brain age
In the context of brain age in Alzheimer's disease (AD), our experiments show that i) VNN outputs are interpretable as brain age predicted using VNNs is significantly elevated for AD with respect to healthy subjects.
arXiv Detail & Related papers (2022-10-28T18:58:34Z) - Feature visualization for convolutional neural network models trained on
neuroimaging data [0.0]
We show for the first time results using feature visualization of convolutional neural networks (CNNs)
We have trained CNNs for different tasks including sex classification and artificial lesion classification based on structural magnetic resonance imaging (MRI) data.
The resulting images reveal the learned concepts of the artificial lesions, including their shapes, but remain hard to interpret for abstract features in the sex classification task.
arXiv Detail & Related papers (2022-03-24T15:24:38Z) - Learning Personal Representations from fMRIby Predicting Neurofeedback
Performance [52.77024349608834]
We present a deep neural network method for learning a personal representation for individuals performing a self neuromodulation task, guided by functional MRI (fMRI)
The representation is learned by a self-supervised recurrent neural network, that predicts the Amygdala activity in the next fMRI frame given recent fMRI frames and is conditioned on the learned individual representation.
arXiv Detail & Related papers (2021-12-06T10:16:54Z) - Self-Supervised Longitudinal Neighbourhood Embedding [13.633165258766418]
We propose a self-supervised strategy for representation learning named Longitudinal Neighborhood Embedding.
Motivated by concepts in contrastive learning, LNE explicitly models the similarity between trajectory vectors across different subjects.
We apply LNE to longitudinal T1w MRIs of two neuroimaging studies: a dataset composed of 274 healthy subjects, and Alzheimer's Disease Neuroimaging Initiative.
arXiv Detail & Related papers (2021-03-05T17:55:53Z) - Interpretation of 3D CNNs for Brain MRI Data Classification [56.895060189929055]
We extend the previous findings in gender differences from diffusion-tensor imaging on T1 brain MRI scans.
We provide the voxel-wise 3D CNN interpretation comparing the results of three interpretation methods.
arXiv Detail & Related papers (2020-06-20T17:56:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.