BrainRotViT: Transformer-ResNet Hybrid for Explainable Modeling of Brain Aging from 3D sMRI

• URL: http://arxiv.org/abs/2511.15188v2
• Date: Thu, 20 Nov 2025 02:27:49 GMT
• Title: BrainRotViT: Transformer-ResNet Hybrid for Explainable Modeling of Brain Aging from 3D sMRI
• Authors: Wasif Jalal, Md Nafiu Rahman, Atif Hasan Rahman, M. Sohel Rahman,
• Abstract summary: We propose Brain ResNet over trained Vision Transformer (BrainRotViT), a hybrid architecture that combines the global context modeling of vision transformers (ViT) with the local refinement of residual CNNs.<n>Our method achieves an MAE of 3.34 years on validation across 11 MRI datasets encompassing more than 130 acquisition sites.<n>Analyses on the brain age gap show that aging patterns are associated with Alzheimer's disease, cognitive impairment, and autism spectrum disorder.
• Score: 0.3949853729743116
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Accurate brain age estimation from structural MRI is a valuable biomarker for studying aging and neurodegeneration. Traditional regression and CNN-based methods face limitations such as manual feature engineering, limited receptive fields, and overfitting on heterogeneous data. Pure transformer models, while effective, require large datasets and high computational cost. We propose Brain ResNet over trained Vision Transformer (BrainRotViT), a hybrid architecture that combines the global context modeling of vision transformers (ViT) with the local refinement of residual CNNs. A ViT encoder is first trained on an auxiliary age and sex classification task to learn slice-level features. The frozen encoder is then applied to all sagittal slices to generate a 2D matrix of embedding vectors, which is fed into a residual CNN regressor that incorporates subject sex at the final fully-connected layer to estimate continuous brain age. Our method achieves an MAE of 3.34 years (Pearson $r=0.98$, Spearman $ρ=0.97$, $R^2=0.95$) on validation across 11 MRI datasets encompassing more than 130 acquisition sites, outperforming baseline and state-of-the-art models. It also generalizes well across 4 independent cohorts with MAEs between 3.77 and 5.04 years. Analyses on the brain age gap (the difference between the predicted age and actual age) show that aging patterns are associated with Alzheimer's disease, cognitive impairment, and autism spectrum disorder. Model attention maps highlight aging-associated regions of the brain, notably the cerebellar vermis, precentral and postcentral gyri, temporal lobes, and medial superior frontal gyrus. Our results demonstrate that this method provides an efficient, interpretable, and generalizable framework for brain-age prediction, bridging the gap between CNN- and transformer-based approaches while opening new avenues for aging and neurodegeneration research.

Related papers

• Robust brain age estimation from structural MRI with contrastive learning [8.439245091011358]
  Estimating brain age from structural MRI has emerged as a powerful tool for characterizing normative and pathological aging.<n>We introduce a novel contrastive loss function, $mathcalLexp$, and evaluate it across multiple public neuroimaging datasets.
  arXiv  Detail & Related papers  (2025-07-02T15:18:03Z)
• Voxel-Level Brain States Prediction Using Swin Transformer [65.9194533414066]
  We propose a novel architecture which employs a 4D Shifted Window (Swin) Transformer as encoder to efficiently learn-temporal information and a convolutional decoder to enable brain state prediction at the same spatial and temporal resolution as the input fMRI data.<n>Our model has shown high accuracy when predicting 7.2s resting-state brain activities based on the prior 23.04s fMRI time series.<n>This shows promising evidence that thetemporal organization of the human brain can be learned by a Swin Transformer model, at high resolution, which provides a potential for reducing fMRI scan time and the development of brain-computer interfaces
  arXiv  Detail & Related papers  (2025-06-13T04:14:38Z)
• Explainable Brain Age Gap Prediction in Neurodegenerative Conditions using coVariance Neural Networks [94.06526659234756]
  Black-box machine learning approaches to brain age gap prediction have limited practical utility.<n>We apply the VNN-based approach to study brain age gap using cortical thickness features for various prevalent neurodegenerative conditions.<n>Our results reveal distinct anatomic patterns for brain age gap in Alzheimer's disease, frontotemporal dementia, and atypical Parkinsonian disorders.
  arXiv  Detail & Related papers  (2025-01-02T19:37:09Z)
• Enhancing Brain Age Estimation with a Multimodal 3D CNN Approach Combining Structural MRI and AI-Synthesized Cerebral Blood Volume Data [14.815462507141163]
  Brain Age Gap Estimation (BrainAGE) offers a neuroimaging biomarker for understanding brain age.<n>Current approaches primarily use T1-weighted magnetic resonance imaging (T1w MRI) data, capturing only structural brain information.<n>We developed a deep learning model using a VGG-based architecture for both modalities and combined their predictions using linear regression.<n>Our model achieved a mean absolute error (MAE) of 3.95 years and an $R2$ of 0.943 on the test set, outperforming existing models trained on similar data.
  arXiv  Detail & Related papers  (2024-12-01T21:54:08Z)
• Self-Supervised Pretext Tasks for Alzheimer's Disease Classification using 3D Convolutional Neural Networks on Large-Scale Synthetic Neuroimaging Dataset [11.173478552040441]
  Alzheimer's Disease (AD) induces both localised and widespread neural degenerative changes throughout the brain. In this work, we evaluated several unsupervised methods to train a feature extractor for downstream AD vs. CN classification.
  arXiv  Detail & Related papers  (2024-06-20T11:26:32Z)
• Towards a Foundation Model for Brain Age Prediction using coVariance Neural Networks [102.75954614946258]
  Increasing brain age with respect to chronological age can reflect increased vulnerability to neurodegeneration and cognitive decline. NeuroVNN is pre-trained as a regression model on healthy population to predict chronological age. NeuroVNN adds anatomical interpretability to brain age and has a scale-free' characteristic that allows its transference to datasets curated according to any arbitrary brain atlas.
  arXiv  Detail & Related papers  (2024-02-12T14:46:31Z)
• Triamese-ViT: A 3D-Aware Method for Robust Brain Age Estimation from MRIs [0.7770029179741429]
  This paper introduces Triamese-ViT, an innovative adaptation of the ViT model for brain age estimation. Tested on a dataset of 1351 MRI scans, Triamese-ViT achieves a Mean Absolute Error (MAE) of 3.84, a 0.9 Spearman correlation coefficient with chronological age, and a -0.29 Spearman coefficient correlation between the brain age gap and chronological age.
  arXiv  Detail & Related papers  (2024-01-13T03:29:56Z)
• Infant Brain Age Classification: 2D CNN Outperforms 3D CNN in Small Dataset [0.14063138455565613]
  Brain magnetic resonance imaging (MRI) of infants demonstrates a specific pattern of development beyond myelination. With no standardized criteria, visual estimation of the structural maturity of the brain from MRI before three years of age remains dominated by inter-observer and intra-observer variability. We explore the general feasibility to tackle this task, and the utility of different approaches, including two- and three-dimensional convolutional neural networks (CNN) In the best performing approach, we achieved an accuracy of 0.90 [95% CI:0.86-0.94] using a 2D CNN on a central axial thick slab.
  arXiv  Detail & Related papers  (2021-12-27T18:02:48Z)
• Predi\c{c}\~ao da Idade Cerebral a partir de Imagens de Resson\^ancia Magn\'etica utilizando Redes Neurais Convolucionais [57.52103125083341]
  Deep learning techniques for brain age prediction from magnetic resonance images are investigated. The identification of biomarkers is useful for detecting an early-stage neurodegenerative process, as well as for predicting age-related or non-age-related cognitive decline. The best result was obtained by the 2D model, which achieved a mean absolute error of 3.83 years.
  arXiv  Detail & Related papers  (2021-12-23T14:51:45Z)
• Brain Age Estimation From MRI Using Cascade Networks with Ranking Loss [75.03117866578913]
  A novel 3D convolutional network, called two-stage-age-network (TSAN), is proposed to estimate brain age from T1-weighted MRI data. Experiments with $6586$ MRIs showed that TSAN could provide accurate brain age estimation.
  arXiv  Detail & Related papers  (2021-06-06T07:11:25Z)
• Patch-based Brain Age Estimation from MR Images [64.66978138243083]
  Brain age estimation from Magnetic Resonance Images (MRI) derives the difference between a subject's biological brain age and their chronological age. Early detection of neurodegeneration manifesting as a higher brain age can potentially facilitate better medical care and planning for affected individuals. We develop a new deep learning approach that uses 3D patches of the brain as well as convolutional neural networks (CNNs) to develop a localised brain age estimator.
  arXiv  Detail & Related papers  (2020-08-29T11:50:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.