CLIMB: Controllable Longitudinal Brain Image Generation using Mamba-based Latent Diffusion Model and Gaussian-aligned Autoencoder
- URL: http://arxiv.org/abs/2604.15611v1
- Date: Fri, 17 Apr 2026 01:34:41 GMT
- Title: CLIMB: Controllable Longitudinal Brain Image Generation using Mamba-based Latent Diffusion Model and Gaussian-aligned Autoencoder
- Abstract summary: We introduce CLIMB, Controllable Longitudinal brain Image generation via state space based latent diffusion model.<n>We train and evaluate our proposed model on the Alzheimers Disease Neuroimaging Initiative dataset, consisting of 6,306 MRI scans from 1,390 participants.<n>By comparing generated images with real MRI scans, CLIMB achieves a structural similarity index of 0.9433, demonstrating notable improvements over existing methods.
- Score: 4.922570253744897
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Latent diffusion models have emerged as powerful generative models in medical imaging, enabling the synthesis of high quality brain magnetic resonance imaging scans. In particular, predicting the evolution of a patients brain can aid in early intervention, prognosis, and treatment planning. In this study, we introduce CLIMB, Controllable Longitudinal brain Image generation via state space based latent diffusion model, an advanced framework for modeling temporal changes in brain structure. CLIMB is designed to model the structural evolution of the brain structure over time, utilizing a baseline MRI scan and its acquisition age as foundational inputs. Additionally, multiple conditional variables, including projected age, gender, disease status, genetic information, and brain structure volumes, are incorporated to enhance the temporal modeling of anatomical changes. Unlike existing LDM methods that rely on self attention modules, which effectively capture contextual information from input images but are computationally expensive, our approach leverages state space, a state space model architecture that substantially reduces computational overhead while preserving high-quality image synthesis. Furthermore, we introduce a Gaussian-aligned autoencoder that extracts latent representations conforming to prior distributions without the sampling noise inherent in conventional variational autoencoders. We train and evaluate our proposed model on the Alzheimers Disease Neuroimaging Initiative dataset, consisting of 6,306 MRI scans from 1,390 participants. By comparing generated images with real MRI scans, CLIMB achieves a structural similarity index of 0.9433, demonstrating notable improvements over existing methods.
Related papers
- A continually expandable foundation model for brain MRI [15.003502301993228]
Alcmaeon is a three-dimensional brain MRI foundation model pretrained without manual labels on more than 425,000 volumes.<n>It can be expanded sequentially across clinical domains.
arXiv Detail & Related papers (2026-08-08T20:06:35Z) - Brain-WM: Brain Glioblastoma World Model [56.45393372490125]
We present Brain-WM, a pioneering GBM world model that unifies next-step treatment prediction and future MRI generation.<n>Brain-WM encodes latent dynamics into a shared latent space for joint autoregressive treatment prediction and flow-based future MRI generation.<n>Ultimately, Brain-WM offers a robust clinical sandbox for optimizing patient healthcare.
arXiv Detail & Related papers (2026-03-08T09:54:08Z) - Align-cDAE: Alzheimer's Disease Progression Modeling with Attention-Aligned Conditional Diffusion Auto-Encoder [3.061416549958077]
Generative AI framework-based modeling and prediction of longitudinal human brain images offer an efficient mechanism to track neurodegenerative progression.<n>Recent diffusion-based models have emerged as an effective alternative to generate disease progression images.<n>We propose a diffusion autoencoder-based framework for disease progression modeling that explicitly enforces alignment between different modalities.
arXiv Detail & Related papers (2026-03-02T07:26:44Z) - Deep generative priors for 3D brain analysis [9.407614414126142]
We present the first general-purpose application of diffusion models as priors for solving medical imaging inverse problems.<n>Our approach leverages a score-based diffusion prior trained extensively on diverse brain MRI data, paired with flexible forward models that capture common image processing tasks.
arXiv Detail & Related papers (2025-10-16T20:20:50Z) - Estimating Brain Activity with High Spatial and Temporal Resolution using a Naturalistic MEG-fMRI Encoding Model [6.157087562708548]
Current non-invasive neuroimaging techniques trade off between spatial resolution and temporal resolution.<n>We develop a transformer-based encoding model that combines the magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI)<n>Our model is trained to predict MEG and fMRI from multiple subjects, simultaneously with a latent layer that represents our estimates of reconstructed cortical sources.
arXiv Detail & Related papers (2025-10-10T14:18:10Z) - Towards a general-purpose foundation model for fMRI analysis [58.06455456423138]
We introduce NeuroSTORM, a framework that learns from 4D fMRI volumes and enables efficient knowledge transfer across diverse applications.<n>NeuroSTORM is pre-trained on 28.65 million fMRI frames (>9,000 hours) from over 50,000 subjects across multiple centers and ages 5 to 100.<n>It outperforms existing methods across five tasks: age/gender prediction, phenotype prediction, disease diagnosis, fMRI-to-image retrieval, and task-based fMRI.
arXiv Detail & Related papers (2025-06-11T23:51:01Z) - Diffusion Models for conditional MRI generation [0.0]
We present a Latent Diffusion Model (LDM) for the generation of brain Magnetic Resonance Imaging (MRI)<n>To evaluate the quality of the generated images, the Fr'echet Inception Distance (FID) and Multi-Scale Structural Similarity Index (MS-SSIM) metrics were employed.
arXiv Detail & Related papers (2025-02-25T20:08:29Z) - Latent Drifting in Diffusion Models for Counterfactual Medical Image Synthesis [55.959002385347645]
Latent Drifting enables diffusion models to be conditioned for medical images fitted for the complex task of counterfactual image generation.<n>We evaluate our method on three public longitudinal benchmark datasets of brain MRI and chest X-rays for counterfactual image generation.
arXiv Detail & Related papers (2024-12-30T01:59:34Z) - A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
We propose a unified MRI reconstruction model robust to various measurement undersampling patterns and image resolutions.<n>Our model improves SSIM by 11% and PSNR by 4 dB over a state-of-the-art CNN (End-to-End VarNet) with 600$times$ faster inference than diffusion methods.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - Spatiotemporal Graph Neural Network Modelling Perfusion MRI [12.712005118761516]
Per vascular MRI (pMRI) offers valuable insights into tumority and promises to predict tumor genotypes.
Yet effective models tailored to 4D pMRI are still lacking.
This study presents the first attempt to model 4D pMRI using a GNN-based model.
arXiv Detail & Related papers (2024-06-10T16:24:46Z) - MindBridge: A Cross-Subject Brain Decoding Framework [60.58552697067837]
Brain decoding aims to reconstruct stimuli from acquired brain signals.
Currently, brain decoding is confined to a per-subject-per-model paradigm.
We present MindBridge, that achieves cross-subject brain decoding by employing only one model.
arXiv Detail & Related papers (2024-04-11T15:46:42Z) - NeuroPictor: Refining fMRI-to-Image Reconstruction via Multi-individual Pretraining and Multi-level Modulation [55.51412454263856]
This paper proposes to directly modulate the generation process of diffusion models using fMRI signals.
By training with about 67,000 fMRI-image pairs from various individuals, our model enjoys superior fMRI-to-image decoding capacity.
arXiv Detail & Related papers (2024-03-27T02:42:52Z) - Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy.
We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
arXiv Detail & Related papers (2023-03-07T09:40:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.