Cortex-Grounded Diffusion Models for Brain Image Generation
- URL: http://arxiv.org/abs/2601.19498v1
- Date: Tue, 27 Jan 2026 11:34:43 GMT
- Title: Cortex-Grounded Diffusion Models for Brain Image Generation
- Abstract summary: Cor2Vox is a cortex-grounded generative framework for brain magnetic resonance image (MRI) synthesis.<n>It leverages high-resolution cortical surfaces to guide a 3D shape-to-image Brownian bridge diffusion process.<n>We show that Cor2Vox preserved fine-grained cortical morphology at the sub-voxel level, exhibiting remarkable robustness to variations in cortical geometry and disease phenotype without retraining.
- Score: 10.384765005941782
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Synthetic neuroimaging data can mitigate critical limitations of real-world datasets, including the scarcity of rare phenotypes, domain shifts across scanners, and insufficient longitudinal coverage. However, existing generative models largely rely on weak conditioning signals, such as labels or text, which lack anatomical grounding and often produce biologically implausible outputs. To this end, we introduce Cor2Vox, a cortex-grounded generative framework for brain magnetic resonance image (MRI) synthesis that ties image generation to continuous structural priors of the cerebral cortex. It leverages high-resolution cortical surfaces to guide a 3D shape-to-image Brownian bridge diffusion process, enabling topologically faithful synthesis and precise control over underlying anatomies. To support the generation of new, realistic brain shapes, we developed a large-scale statistical shape model of cortical morphology derived from over 33,000 UK Biobank scans. We validated the fidelity of Cor2Vox based on traditional image quality metrics, advanced cortical surface reconstruction, and whole-brain segmentation quality, outperforming many baseline methods. Across three applications, namely (i) anatomically consistent synthesis, (ii) simulation of progressive gray matter atrophy, and (iii) harmonization of in-house frontotemporal dementia scans with public datasets, Cor2Vox preserved fine-grained cortical morphology at the sub-voxel level, exhibiting remarkable robustness to variations in cortical geometry and disease phenotype without retraining.
Related papers
- AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation [58.56402940400457]
3D brain MRI generation has made significant advances in medical imaging, simulation, and controllable anatomical analysis.<n>We introduce AnaDiffusion, an anatomically compositional latent diffusion framework that factorizes the generation process into distinct, anatomically meaningful regions.<n>AnaDiffusion produces both explicit part assets and a globally coherent volume, enabling controllable part editing.
arXiv Detail & Related papers (2026-08-24T09:16:42Z) - ProgFormer: Hierarchical Voxel Diffusion Transformer for Longitudinal Brain MRI Prediction [81.07048249760953]
longitudinal changes are often subtle and confined to specific anatomical regions.<n>Most subject-specific brain structure remains stable over time.<n>ProgFormer is a hierarchical voxel-space Diffusion Transformer for longitudinal brain MRI prediction.
arXiv Detail & Related papers (2026-07-30T00:13:42Z) - SIAM: Head and Brain MRI Segmentation from Few High-Quality Templates via Synthetic Training [0.4770448296514673]
Segment It All Model (SIAM) is a 3D whole-head segmentation framework for 16 anatomical structures.<n>SIAM simultaneously segments brain as well as extra-cerebral tissues, including cerebrospinal fluid, vessels, dura mater, skull, and skin.
arXiv Detail & Related papers (2026-05-04T15:37:12Z) - Generative Modeling of Neurodegenerative Brain Anatomy with 4D Longitudinal Diffusion Model [4.65021411381981]
Most longitudinal neuroimaging datasets are temporally sparse with a few follow-up scans per subject.<n>We propose a novel 4D (3DxT) diffusion-based generative framework that effectively models and synthesizes longitudinal anatomy over time.<n>Our method outperforms state-of-the-art baselines in generating anatomically accurate, temporally consistent, and clinically meaningful brain trajectories.
arXiv Detail & Related papers (2026-04-24T16:33:48Z) - Generative Latent Representations of 3D Brain MRI for Multi-Task Downstream Analysis in Down Syndrome [3.344873290507966]
We develop variational autoencoders to encode 3D brain MRI scans into compact latent space representations for generative and predictive applications.<n>Our results demonstrate that the VAE successfully captures essential brain features while maintaining high reconstruction fidelity.
arXiv Detail & Related papers (2026-02-14T11:50:57Z) - Improving Neuropathological Reconstruction Fidelity via AI Slice Imputation [7.249215795651748]
We introduce a computationally efficient super-resolution step that imputes slices to generate isotropic volumes from anisotropic 3D reconstructions of dissection photographs.<n>The imputed volumes yield improved automated segmentations, achieving higher Dice scores, particularly in cortical and white matter regions.
arXiv Detail & Related papers (2026-01-31T11:34:01Z) - A Semantically Enhanced Generative Foundation Model Improves Pathological Image Synthesis [82.01597026329158]
We introduce a Correlation-Regulated Alignment Framework for Tissue Synthesis (CRAFTS) for pathology-specific text-to-image synthesis.<n>CRAFTS incorporates a novel alignment mechanism that suppresses semantic drift to ensure biological accuracy.<n>This model generates diverse pathological images spanning 30 cancer types, with quality rigorously validated by objective metrics and pathologist evaluations.
arXiv Detail & Related papers (2025-12-15T10:22:43Z) - Moving Beyond Diffusion: Hierarchy-to-Hierarchy Autoregression for fMRI-to-Image Reconstruction [65.67001243986981]
We propose MindHier, a coarse-to-fine fMRI-to-image reconstruction framework built on scale-wise autoregressive modeling.<n>MindHier achieves superior semantic fidelity, 4.67x faster inference, and more deterministic results than the diffusion-based baselines.
arXiv Detail & Related papers (2025-10-25T15:40:07Z) - Integrating Anatomical Priors into a Causal Diffusion Model [14.471851828800055]
3D brain MRI studies often examine subtle morphometric differences that are hard to detect visually.<n>Counterfactual models struggle to produce plausible MRIs due to the lack of explicit inductive biases to preserve fine-grained anatomical details.<n>We propose to explicitly integrate anatomical constraints on a voxel-level as prior into a generative diffusion framework.
arXiv Detail & Related papers (2025-09-10T23:22:05Z) - Evaluation of 3D Counterfactual Brain MRI Generation [30.32365445563276]
We convert six generative models into 3D counterfactual approaches by incorporating an anatomy-guided framework based on a causal graph.<n>Our results indicate that anatomically grounded conditioning successfully modifies the targeted anatomical regions.
arXiv Detail & Related papers (2025-08-04T20:20:59Z) - 3D Shape-to-Image Brownian Bridge Diffusion for Brain MRI Synthesis from Cortical Surfaces [8.604681353022665]
Cor2Vox is the first diffusion model-based method that translates continuous cortical shape priors to synthetic brain MRIs.<n>We demonstrate significant improvements in the geometric accuracy of reconstructed structures compared to previous voxel-based approaches.<n>We also highlight the capability of our approach to simulate cortical atrophy at the sub-voxel level.
arXiv Detail & Related papers (2025-02-18T10:59:04Z) - BrainODE: Dynamic Brain Signal Analysis via Graph-Aided Neural Ordinary Differential Equations [67.79256149583108]
We propose a novel model called BrainODE to achieve continuous modeling of dynamic brain signals.
By learning latent initial values and neural ODE functions from irregular time series, BrainODE effectively reconstructs brain signals at any time point.
arXiv Detail & Related papers (2024-04-30T10:53:30Z) - MindBridge: A Cross-Subject Brain Decoding Framework [60.58552697067837]
Brain decoding aims to reconstruct stimuli from acquired brain signals.
Currently, brain decoding is confined to a per-subject-per-model paradigm.
We present MindBridge, that achieves cross-subject brain decoding by employing only one model.
arXiv Detail & Related papers (2024-04-11T15:46:42Z) - Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy.
We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
arXiv Detail & Related papers (2023-03-07T09:40:22Z) - Joint Reconstruction and Parcellation of Cortical Surfaces [3.9198548406564604]
Reconstruction of cerebral cortex surfaces from brain MRI scans is instrumental for the analysis of brain morphology and the detection of cortical thinning in neurodegenerative diseases like Alzheimer's disease (AD)
In this work, we propose two options, one based on a graph classification branch and another based on a novel generic 3D reconstruction loss, to augment template-deformation algorithms.
We attain highly accurate parcellations with a Dice score of 90.2 (graph classification branch) and 90.4 (novel reconstruction loss) together with state-of-the-art surfaces.
arXiv Detail & Related papers (2022-09-19T11:45:39Z) - Hierarchical Amortized Training for Memory-efficient High Resolution 3D
GAN [52.851990439671475]
We propose a novel end-to-end GAN architecture that can generate high-resolution 3D images.
We achieve this goal by using different configurations between training and inference.
Experiments on 3D thorax CT and brain MRI demonstrate that our approach outperforms state of the art in image generation.
arXiv Detail & Related papers (2020-08-05T02:33:04Z) - Scale-Space Autoencoders for Unsupervised Anomaly Segmentation in Brain
MRI [47.26574993639482]
We show improved anomaly segmentation performance and the general capability to obtain much more crisp reconstructions of input data at native resolution.
The modeling of the laplacian pyramid further enables the delineation and aggregation of lesions at multiple scales.
arXiv Detail & Related papers (2020-06-23T09:20:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.