Memory-Efficient 3D High-Resolution Medical Image Synthesis Using CRF-Guided GANs

• URL: http://arxiv.org/abs/2503.10899v1
• Date: Thu, 13 Mar 2025 21:31:15 GMT
• Title: Memory-Efficient 3D High-Resolution Medical Image Synthesis Using CRF-Guided GANs
• Authors: Mahshid Shiri, Alessandro Bruno, Daniele Loiacono,
• Abstract summary: We propose an end-to-end novel GAN architecture that uses Conditional Random field (CRF) to model dependencies.<n>Our architecture outperforms state-of-the-art while it has lower memory usage and less complexity.
• Score: 47.873227167456136
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Generative Adversarial Networks (GANs) have many potential medical imaging applications. Due to the limited memory of Graphical Processing Units (GPUs), most current 3D GAN models are trained on low-resolution medical images, these models cannot scale to high-resolution or are susceptible to patchy artifacts. In this work, we propose an end-to-end novel GAN architecture that uses Conditional Random field (CRF) to model dependencies so that it can generate consistent 3D medical Images without exploiting memory. To achieve this purpose, the generator is divided into two parts during training, the first part produces an intermediate representation and CRF is applied to this intermediate representation to capture correlations. The second part of the generator produces a random sub-volume of image using a subset of the intermediate representation. This structure has two advantages: first, the correlations are modeled by using the features that the generator is trying to optimize. Second, the generator can generate full high-resolution images during inference. Experiments on Lung CTs and Brain MRIs show that our architecture outperforms state-of-the-art while it has lower memory usage and less complexity.

Related papers

• Bringing together invertible UNets with invertible attention modules for memory-efficient diffusion models [0.0]
  We propose a novel architecture for a single GPU memory-efficient training for diffusion models for high dimensional medical datasets. The proposed model is built by using an invertible UNet architecture with invertible attention modules. While this new model can be applied to a multitude of image generation tasks, we showcase its memory-efficiency on the 3D BraTS 2020 dataset.
  arXiv  Detail & Related papers  (2025-04-15T05:26:42Z)
• Comparative clinical evaluation of "memory-efficient" synthetic 3d generative adversarial networks (gan) head-to-head to state of art: results on computed tomography of the chest [35.858837946090674]
  This study introduces CRF-GAN, a novel memory-efficient GAN architecture. The model's performance is evaluated against the state-of-the-art hierarchical (HA)-GAN model.
  arXiv  Detail & Related papers  (2025-01-26T15:57:44Z)
• cWDM: Conditional Wavelet Diffusion Models for Cross-Modality 3D Medical Image Synthesis [1.767791678320834]
  This paper contributes to the "BraTS 2024 Brain MR Image Synthesis Challenge" It presents a conditional Wavelet Diffusion Model for solving a paired image-to-image translation task on high-resolution volumes.
  arXiv  Detail & Related papers  (2024-11-26T08:17:57Z)
• R$^2$-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstruction [53.19869886963333]
  3D Gaussian splatting (3DGS) has shown promising results in rendering image and surface reconstruction. This paper introduces R2$-Gaussian, the first 3DGS-based framework for sparse-view tomographic reconstruction.
  arXiv  Detail & Related papers  (2024-05-31T08:39:02Z)
• GVP: Generative Volumetric Primitives [76.95231302205235]
  We present Generative Volumetric Primitives (GVP), the first pure 3D generative model that can sample and render 512-resolution images in real-time. GVP jointly models a number of primitives and their spatial information, both of which can be efficiently generated via a 2D convolutional network. Experiments on several datasets demonstrate superior efficiency and 3D consistency of GVP over the state-of-the-art.
  arXiv  Detail & Related papers  (2023-03-31T16:50:23Z)
• NeRF-GAN Distillation for Efficient 3D-Aware Generation with Convolutions [97.27105725738016]
  integration of Neural Radiance Fields (NeRFs) and generative models, such as Generative Adversarial Networks (GANs) has transformed 3D-aware generation from single-view images. We propose a simple and effective method, based on re-using the well-disentangled latent space of a pre-trained NeRF-GAN in a pose-conditioned convolutional network to directly generate 3D-consistent images corresponding to the underlying 3D representations.
  arXiv  Detail & Related papers  (2023-03-22T18:59:48Z)
• GLEAM: Greedy Learning for Large-Scale Accelerated MRI Reconstruction [50.248694764703714]
  Unrolled neural networks have recently achieved state-of-the-art accelerated MRI reconstruction. These networks unroll iterative optimization algorithms by alternating between physics-based consistency and neural-network based regularization. We propose Greedy LEarning for Accelerated MRI reconstruction, an efficient training strategy for high-dimensional imaging settings.
  arXiv  Detail & Related papers  (2022-07-18T06:01:29Z)
• Hierarchical Amortized Training for Memory-efficient High Resolution 3D GAN [52.851990439671475]
  We propose a novel end-to-end GAN architecture that can generate high-resolution 3D images. We achieve this goal by using different configurations between training and inference. Experiments on 3D thorax CT and brain MRI demonstrate that our approach outperforms state of the art in image generation.
  arXiv  Detail & Related papers  (2020-08-05T02:33:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.