Comparative Analysis of GAN and Diffusion for MRI-to-CT translation

• URL: http://arxiv.org/abs/2509.22049v1
• Date: Fri, 26 Sep 2025 08:33:34 GMT
• Title: Comparative Analysis of GAN and Diffusion for MRI-to-CT translation
• Authors: Emily Honey, Anders Helbo, Jens Petersen,
• Abstract summary: We compare the performance of two frequently used architectures for MRI-to-CT translation.<n>We separate the classical 3D translation problem into a sequence of 2D translations on the transverse plane.<n>We also investigate the impact of conditioning the generative process on a single MRI image/slice and on multiple MRI slices.
• Score: 0.7668561705871794
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Computed tomography (CT) is essential for treatment and diagnostics; In case CT are missing or otherwise difficult to obtain, methods for generating synthetic CT (sCT) images from magnetic resonance imaging (MRI) images are sought after. Therefore, it is valuable to establish a reference for what strategies are most effective for MRI-to-CT translation. In this paper, we compare the performance of two frequently used architectures for MRI-to-CT translation: a conditional generative adversarial network (cGAN) and a conditional denoising diffusion probabilistic model (cDDPM). We chose well-established implementations to represent each architecture: Pix2Pix for cGAN, and Palette for cDDPM. We separate the classical 3D translation problem into a sequence of 2D translations on the transverse plane, to investigate the viability of a strategy that reduces the computational cost. We also investigate the impact of conditioning the generative process on a single MRI image/slice and on multiple MRI slices. The performance is assessed using a thorough evaluation protocol, including a novel slice-wise metric Similarity Of Slices (SIMOS), which measures the continuity between transverse slices when compiling the sCTs into 3D format. Our comparative analysis revealed that MRI-to-CT generative models benefit from multi-channel conditional input and using cDDPM as an architecture.

Related papers

• EqDiff-CT: Equivariant Conditional Diffusion model for CT Image Synthesis from CBCT [43.92108185590778]
  Cone-beam computed tomography (CBCT) is widely used for imageguided radiotherapy (IGRT)<n>We propose a novel diffusion-based conditional generative model, coined EqDiff-CT, to synthesize high-quality CT images from CBCT.
  arXiv  Detail & Related papers  (2025-09-26T05:51:59Z)
• JSover: Joint Spectrum Estimation and Multi-Material Decomposition from Single-Energy CT Projections [45.14515691206885]
  Multi-material decomposition (MMD) enables quantitative reconstruction of tissue compositions in the human body.<n>Traditional MMD typically requires spectral CT scanners and pre-measured X-ray energy spectra, significantly limiting clinical applicability.<n>This paper proposes JSover, a fundamentally reformulated one-step SEMMD framework that jointly reconstructs multi-material compositions and estimates the energy spectrum directly from SECT projections.
  arXiv  Detail & Related papers  (2025-05-12T23:32:21Z)
• RadIR: A Scalable Framework for Multi-Grained Medical Image Retrieval via Radiology Report Mining [64.66825253356869]
  We propose a novel methodology that leverages dense radiology reports to define image-wise similarity ordering at multiple granularities.<n>We construct two comprehensive medical imaging retrieval datasets: MIMIC-IR for Chest X-rays and CTRATE-IR for CT scans.<n>We develop two retrieval systems, RadIR-CXR and model-ChestCT, which demonstrate superior performance in traditional image-image and image-report retrieval tasks.
  arXiv  Detail & Related papers  (2025-03-06T17:43:03Z)
• Synthetic CT image generation from CBCT: A Systematic Review [44.01505745127782]
  Generation of synthetic CT (sCT) images from cone-beam CT (CBCT) data using deep learning methodologies represents a significant advancement in radiation oncology.<n>A total of 35 relevant studies were identified and analyzed, revealing the prevalence of deep learning approaches in the generation of sCT.
  arXiv  Detail & Related papers  (2025-01-22T13:54:07Z)
• Leveraging Multimodal CycleGAN for the Generation of Anatomically Accurate Synthetic CT Scans from MRIs [1.779948689352186]
  We analyse the capabilities of different configurations of Deep Learning models to generate synthetic CT scans from MRI. Several CycleGAN models were trained unsupervised to generate CT scans from different MRI modalities with and without contrast agents. The results show how, depending on the input modalities, the models can have very different performances.
  arXiv  Detail & Related papers  (2024-07-15T16:38:59Z)
• A Two-Stage Generative Model with CycleGAN and Joint Diffusion for MRI-based Brain Tumor Detection [41.454028276986946]
  We propose a novel framework Two-Stage Generative Model (TSGM) to improve brain tumor detection and segmentation. CycleGAN is trained on unpaired data to generate abnormal images from healthy images as data prior. VE-JP is implemented to reconstruct healthy images using synthetic paired abnormal images as a guide.
  arXiv  Detail & Related papers  (2023-11-06T12:58:26Z)
• Denoising diffusion-based MRI to CT image translation enables automated spinal segmentation [8.094450260464354]
  This retrospective study involved translating T1w and T2w MR image series into CT images in a total of n=263 pairs of CT/MR series. Two landmarks per vertebra registration enabled paired image-to-image translation from MR to CT and outperformed all unpaired approaches.
  arXiv  Detail & Related papers  (2023-08-18T07:07:15Z)
• Synthetic CT Generation from MRI using 3D Transformer-based Denoising Diffusion Model [2.232713445482175]
  Magnetic resonance imaging (MRI)-based synthetic computed tomography (sCT) simplifies radiation therapy treatment planning. We propose an MRI-to-CT transformer-based denoising diffusion probabilistic model (MC-DDPM) to transform MRI into high-quality sCT.
  arXiv  Detail & Related papers  (2023-05-31T00:32:00Z)
• Joint Rigid Motion Correction and Sparse-View CT via Self-Calibrating Neural Field [37.86878619100209]
  NeRF has widely received attention in Sparse-View (SV) CT reconstruction problems as a self-supervised deep learning framework. Existing NeRF-based SVCT methods strictly suppose there is completely no relative motion during the CT acquisition. This work proposes a self-calibrating neural field that recovers the artifacts-free image from the rigid motion-corrupted SV measurement.
  arXiv  Detail & Related papers  (2022-10-23T13:55:07Z)
• Conversion Between CT and MRI Images Using Diffusion and Score-Matching Models [7.745729132928934]
  We propose to use an emerging deep learning framework called diffusion and score-matching models. Our results show that the diffusion and score-matching models generate better synthetic CT images than the CNN and GAN models. Our study suggests that diffusion and score-matching models are powerful to generate high quality images conditioned on an image obtained using a complementary imaging modality.
  arXiv  Detail & Related papers  (2022-09-24T23:50:54Z)
• Negligible effect of brain MRI data preprocessing for tumor segmentation [36.89606202543839]
  We conduct experiments on three publicly available datasets and evaluate the effect of different preprocessing steps in deep neural networks. Our results demonstrate that most popular standardization steps add no value to the network performance. We suggest that image intensity normalization approaches do not contribute to model accuracy because of the reduction of signal variance with image standardization.
  arXiv  Detail & Related papers  (2022-04-11T17:29:36Z)
• CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for Non-Contrast to Contrast CT Translation [56.622832383316215]
  We propose a novel approach to translate unpaired contrast computed tomography (CT) scans to non-contrast CT scans. Our approach is based on cycle-consistent generative adversarial convolutional transformers, for short, CyTran. Our empirical results show that CyTran outperforms all competing methods.
  arXiv  Detail & Related papers  (2021-10-12T23:25:03Z)
• Modality Completion via Gaussian Process Prior Variational Autoencoders for Multi-Modal Glioma Segmentation [75.58395328700821]
  We propose a novel model, Multi-modal Gaussian Process Prior Variational Autoencoder (MGP-VAE), to impute one or more missing sub-modalities for a patient scan. MGP-VAE can leverage the Gaussian Process (GP) prior on the Variational Autoencoder (VAE) to utilize the subjects/patients and sub-modalities correlations. We show the applicability of MGP-VAE on brain tumor segmentation where either, two, or three of four sub-modalities may be missing.
  arXiv  Detail & Related papers  (2021-07-07T19:06:34Z)
• Structurally aware bidirectional unpaired image to image translation between CT and MR [0.14788776577018314]
  Deep learning techniques can help us to leverage the possibility of an image to image translation between multiple imaging modalities. These techniques will help to conduct surgical planning under CT with the feedback of MRI information.
  arXiv  Detail & Related papers  (2020-06-05T11:21:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.