Dual-Domain Equivariant Generative Adversarial Network for Multimodal CT-PET Synthesis

• URL: http://arxiv.org/abs/2606.13341v1
• Date: Thu, 11 Jun 2026 13:30:56 GMT
• Title: Dual-Domain Equivariant Generative Adversarial Network for Multimodal CT-PET Synthesis
• Abstract summary: We present a Dual-Domain Equivariant Generative Adversarial Network (DDE-GAN) for multimodal CT-PET image synthesis.<n>DDE-GAN addresses challenges by jointly learning from both spatial and frequency domains, capturing complementary anatomical and spectral information.
• Score: 42.11510706776732
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present a Dual-Domain Equivariant Generative Adversarial Network (DDE-GAN) for multimodal CT-PET image synthesis. Traditional GAN-based approaches often operate solely in the spatial domain and ignore geometric consistency, resulting in limited structural fidelity. DDE-GAN addresses these challenges by jointly learning from both spatial and frequency (Fourier) domains, capturing complementary anatomical and spectral information. Furthermore, rotational equivariance embedded in the physics of the CT and PET measurements are integrated into the loss of both the generator and discriminator to ensure consistent responses under rotations, improving anatomical accuracy. A hierarchical dual-domain training strategy enforces intra- and inter-domain consistency through multi-stage loss functions. Evaluated on the HECKTOR 2022 CT-PET dataset, DDE-GAN achieves superior synthesis quality over baseline models for CT-PET image synthesis. The results demonstrate that combining dual-domain learning with geometric equivariance substantially enhances multimodal image synthesis accuracy and robustness, enabling practical applications in PET completion and data augmentation.

Related papers

• Generation of Heterogeneous PET Images from Uniform Organ Activity Maps Using a Pretrained Domain-Adapted Diffusion Model [1.3918848543076061]
  Synthetic PET images are valuable for quantitative imaging workflow development, scalable virtual imaging trials, and deep learning model training.<n>This study developed a pretrained domain-adapted diffusion model for anatomy-conditioned PET synthesis from uniform organ activity maps.
  arXiv  Detail & Related papers  (2026-05-18T21:05:28Z)
• Generalizable CT-Free PET Attenuation and Scatter Correction for Pediatric Patients [16.406616011746944]
  Existing CT-free methods are commonly trained in homogeneous settings and often degrade under scanner or radiotracer shifts.<n>We propose the Generalizable PET Correction Network (GPCN), a dual-domain network for domain-robust CT-free PET attenuation and scatter correction.
  arXiv  Detail & Related papers  (2026-04-24T10:55:19Z)
• PHASOR: Anatomy- and Phase-Consistent Volumetric Diffusion for CT Virtual Contrast Enhancement [60.81732730684265]
  This paper introduces PHASOR, a volumetric diffusion framework for high-fidelity virtual contrast enhancement (VCE)<n>By treating CT volumes as coherent sequences, we leverage a video diffusion model to enhance structural coherence and volumetric accuracy.<n>To ensure anatomy-phase consistent synthesis, we introduce two complementary modules. First, anatomy-routed mixture-of-experts (AR-MoE) anchors distinct enhancement patterns to anatomical semantics, with organ-specific memory to capture salient details.<n>Second, intensity-phase aware representation alignment (IP-REPA) highlights intricate contrast signals while mitigating the impact of imperfect spatial alignment.
  arXiv  Detail & Related papers  (2026-04-01T15:57:18Z)
• Whole-Body Image-to-Image Translation for a Virtual Scanner in a Healthcare Digital Twin [0.8714814768600079]
  We propose a framework that segments whole-body CT images into four regions-head, trunk, arms, and legs-and uses district-specific Generative Adversarial Networks (GANs) for tailored CT-to-PET translation.<n>This methodology supports healthcare Digital Twins by enabling accurate virtual PET scans from CT data, creating virtual imaging representations to monitor, predict, and optimize health outcomes.
  arXiv  Detail & Related papers  (2025-03-18T20:19:28Z)
• Let Synthetic Data Shine: Domain Reassembly and Soft-Fusion for Single Domain Generalization [68.41367635546183]
  Single Domain Generalization aims to train models with consistent performance across diverse scenarios using data from a single source.<n>We propose Discriminative Domain Reassembly and Soft-Fusion (DRSF), a training framework leveraging synthetic data to improve model generalization.
  arXiv  Detail & Related papers  (2025-03-17T18:08:03Z)
• H2ASeg: Hierarchical Adaptive Interaction and Weighting Network for Tumor Segmentation in PET/CT Images [6.753315684414596]
  Positron emission tomography (PET) combined with computed tomography (CT) imaging is routinely used in cancer diagnosis and prognosis. Traditional multi-modal segmentation solutions rely on concatenation operations for modality fusion. We propose a Hierarchical Adaptive Interaction and Weighting Network termed H2ASeg to explore intrinsic cross-modal correlations.
  arXiv  Detail & Related papers  (2024-03-27T08:28:14Z)
• SDR-Former: A Siamese Dual-Resolution Transformer for Liver Lesion Classification Using 3D Multi-Phase Imaging [59.78761085714715]
  This study proposes a novel Siamese Dual-Resolution Transformer (SDR-Former) framework for liver lesion classification. The proposed framework has been validated through comprehensive experiments on two clinical datasets. To support the scientific community, we are releasing our extensive multi-phase MR dataset for liver lesion analysis to the public.
  arXiv  Detail & Related papers  (2024-02-27T06:32:56Z)
• PET Synthesis via Self-supervised Adaptive Residual Estimation Generative Adversarial Network [14.381830012670969]
  Recent methods to generate high-quality PET images from low-dose counterparts have been reported to be state-of-the-art for low-to-high image recovery methods. To address these issues, we developed a self-supervised adaptive residual estimation generative adversarial network (SS-AEGAN) SS-AEGAN consistently outperformed the state-of-the-art synthesis methods with various dose reduction factors.
  arXiv  Detail & Related papers  (2023-10-24T06:43:56Z)
• Contrastive Diffusion Model with Auxiliary Guidance for Coarse-to-Fine PET Reconstruction [62.29541106695824]
  This paper presents a coarse-to-fine PET reconstruction framework that consists of a coarse prediction module (CPM) and an iterative refinement module (IRM) By delegating most of the computational overhead to the CPM, the overall sampling speed of our method can be significantly improved. Two additional strategies, i.e., an auxiliary guidance strategy and a contrastive diffusion strategy, are proposed and integrated into the reconstruction process.
  arXiv  Detail & Related papers  (2023-08-20T04:10:36Z)
• TriDo-Former: A Triple-Domain Transformer for Direct PET Reconstruction from Low-Dose Sinograms [45.24575167909925]
  TriDoFormer is a transformer-based model that unites triple domains of sinogram, image, and frequency for direct reconstruction. It outperforms state-of-the-art methods qualitatively and quantitatively. GFP serves as a learnable frequency filter that adjusts the frequency components in the frequency domain, enforcing the network to restore high-frequency details.
  arXiv  Detail & Related papers  (2023-08-10T06:20:00Z)
• InDuDoNet+: A Model-Driven Interpretable Dual Domain Network for Metal Artifact Reduction in CT Images [53.4351366246531]
  We construct a novel interpretable dual domain network, termed InDuDoNet+, into which CT imaging process is finely embedded. We analyze the CT values among different tissues, and merge the prior observations into a prior network for our InDuDoNet+, which significantly improve its generalization performance.
  arXiv  Detail & Related papers  (2021-12-23T15:52:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.