Toward Generating Synthetic CT Volumes using a 3D-Conditional Generative Adversarial Network

• URL: http://arxiv.org/abs/2104.02060v1
• Date: Fri, 2 Apr 2021 12:25:37 GMT
• Title: Toward Generating Synthetic CT Volumes using a 3D-Conditional Generative Adversarial Network
• Abstract summary: conditional Generative Adversarial Network (cGAN) architecture capable of generating 3D Computed Tomography scans in voxels from noisy and/or pixelated approximations. We believe conditional cGAN to be a tractable approach to generate 3D CT volumes.
• Score: 1.5846249630722484
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a novel conditional Generative Adversarial Network (cGAN) architecture that is capable of generating 3D Computed Tomography scans in voxels from noisy and/or pixelated approximations and with the potential to generate full synthetic 3D scan volumes. We believe conditional cGAN to be a tractable approach to generate 3D CT volumes, even though the problem of generating full resolution deep fakes is presently impractical due to GPU memory limitations. We present results for autoencoder, denoising, and depixelating tasks which are trained and tested on two novel COVID19 CT datasets. Our evaluation metrics, Peak Signal to Noise ratio (PSNR) range from 12.53 - 46.46 dB, and the Structural Similarity index ( SSIM) range from 0.89 to 1.

Related papers

• 3D Ultrasound-Derived Pseudo-CT Synthesis Using a Transformer-Augmented Residual Network for Real-Time Operator Guidance [0.0]
  Ultrasound (US) is non-ionizing and widely accessible; however, it is highly operator dependent and lacks quantitative tissue characterization.<n>This work presents a 3D ultrasound-derived pseudo-CT framework that generates CT-like anatomical reference volumes inferred from US.<n>The proposed method outperforms established baselines in structural fidelity and perceptual image quality.
  arXiv  Detail & Related papers  (2026-05-06T12:52:59Z)
• Conditional Diffusion Posterior Alignment for Sparse-View CT Reconstruction [4.107377779783183]
  We propose Conditional Posterior Alignment (CDPA) to enable scalable 3D sparse-view CT reconstruction.<n>A 2D U-Net diffusion model is conditioned on an initial 3D reconstruction to improve inter-slice consistency.<n> Experiments on synthetic and real Cone Beam CT (CBCT) data show state-of-the-art performance.
  arXiv  Detail & Related papers  (2026-04-23T14:09:13Z)
• RadioGen3D: 3D Radio Map Generation via Adversarial Learning on Large-Scale Synthetic Data [62.63849426834315]
  Radio maps are essential for efficient radio resource management in future 6G and low-altitude networks.<n>Deep learning (DL) techniques have emerged as an efficient alternative to conventional ray-tracing for radio map estimation.<n>We present the RadioGen3D framework to capture essential 3D signal propagation characteristics and antenna polarization effects.
  arXiv  Detail & Related papers  (2026-02-21T07:50:05Z)
• Artifact Reduction in Undersampled 3D Cone-Beam CTs using a Hybrid 2D-3D CNN Framework [3.460998655164144]
  Undersampled CT volumes introduce artifacts degrading image quality and diagnostic utility.<n>We propose a hybrid deep-learning framework that combines the strengths of 2D and 3D models.<n>The proposed two-stage approach balances the computational efficiency of 2D processing with the consistency provided by 3D modeling.
  arXiv  Detail & Related papers  (2026-02-09T14:36:05Z)
• Fast 3D Diffusion for Scalable Granular Media Synthesis [0.0]
  A novel generative pipeline is developed to synthesize large granular assemblies in their final and physically realistic configurations.<n>A 1.2 m long ballasted rail track synthesis equivalent to a 3-hour DEM simulation was completed under 20 seconds.
  arXiv  Detail & Related papers  (2025-08-27T10:27:36Z)
• Memory-Efficient 3D High-Resolution Medical Image Synthesis Using CRF-Guided GANs [47.873227167456136]
  We propose an end-to-end novel GAN architecture that uses Conditional Random field (CRF) to model dependencies. Our architecture outperforms state-of-the-art while it has lower memory usage and less complexity.
  arXiv  Detail & Related papers  (2025-03-13T21:31:15Z)
• DSplats: 3D Generation by Denoising Splats-Based Multiview Diffusion Models [67.50989119438508]
  We introduce DSplats, a novel method that directly denoises multiview images using Gaussian-based Reconstructors to produce realistic 3D assets. Our experiments demonstrate that DSplats not only produces high-quality, spatially consistent outputs, but also sets a new standard in single-image to 3D reconstruction.
  arXiv  Detail & Related papers  (2024-12-11T07:32:17Z)
• N-BVH: Neural ray queries with bounding volume hierarchies [51.430495562430565]
  In 3D computer graphics, the bulk of a scene's memory usage is due to polygons and textures. We devise N-BVH, a neural compression architecture designed to answer arbitrary ray queries in 3D. Our method provides faithful approximations of visibility, depth, and appearance attributes.
  arXiv  Detail & Related papers  (2024-05-25T13:54:34Z)
• NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View 3D Object Detection [65.02633277884911]
  We present NeRF-Det, a novel method for indoor 3D detection with posed RGB images as input. Our method makes use of NeRF in an end-to-end manner to explicitly estimate 3D geometry, thereby improving 3D detection performance.
  arXiv  Detail & Related papers  (2023-07-27T04:36:16Z)
• GVP: Generative Volumetric Primitives [76.95231302205235]
  We present Generative Volumetric Primitives (GVP), the first pure 3D generative model that can sample and render 512-resolution images in real-time. GVP jointly models a number of primitives and their spatial information, both of which can be efficiently generated via a 2D convolutional network. Experiments on several datasets demonstrate superior efficiency and 3D consistency of GVP over the state-of-the-art.
  arXiv  Detail & Related papers  (2023-03-31T16:50:23Z)
• NeRF-GAN Distillation for Efficient 3D-Aware Generation with Convolutions [97.27105725738016]
  integration of Neural Radiance Fields (NeRFs) and generative models, such as Generative Adversarial Networks (GANs) has transformed 3D-aware generation from single-view images. We propose a simple and effective method, based on re-using the well-disentangled latent space of a pre-trained NeRF-GAN in a pose-conditioned convolutional network to directly generate 3D-consistent images corresponding to the underlying 3D representations.
  arXiv  Detail & Related papers  (2023-03-22T18:59:48Z)
• VoloGAN: Adversarial Domain Adaptation for Synthetic Depth Data [0.0]
  We present VoloGAN, an adversarial domain adaptation network that translates synthetic RGB-D images of a high-quality 3D model of a person, into RGB-D images that could be generated with a consumer depth sensor. This system is especially useful to generate high amount training data for single-view 3D reconstruction algorithms replicating the real-world capture conditions.
  arXiv  Detail & Related papers  (2022-07-19T11:30:41Z)
• A hybrid deep learning framework for Covid-19 detection via 3D Chest CT Images [5.3708513698154015]
  We present a hybrid deep learning framework named CTNet which combines convolutional neural network and transformer together for the detection of COVID-19 via 3D chest CT images. It consists of a CNN feature extractor module with SE attention to extract sufficient features from CT scans, together with a transformer model to model the discriminative features of the 3D CT scans.
  arXiv  Detail & Related papers  (2021-07-08T15:37:46Z)
• R2U3D: Recurrent Residual 3D U-Net for Lung Segmentation [17.343802171952195]
  We propose a novel model, namely, Recurrent Residual 3D U-Net (R2U3D), for the 3D lung segmentation task. In particular, the proposed model integrates 3D convolution into the Recurrent Residual Neural Network based on U-Net. The proposed R2U3D network is trained on the publicly available dataset LUNA16 and it achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-05-05T19:17:14Z)
• Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans [72.04652116817238]
  We propose a differentiable neural architecture search (DNAS) framework to automatically search for the 3D DL models for 3D chest CT scans classification. We also exploit the Class Activation Mapping (CAM) technique on our models to provide the interpretability of the results.
  arXiv  Detail & Related papers  (2021-01-14T03:45:01Z)
• Revisiting 3D Context Modeling with Supervised Pre-training for Universal Lesion Detection in CT Slices [48.85784310158493]
  We propose a Modified Pseudo-3D Feature Pyramid Network (MP3D FPN) to efficiently extract 3D context enhanced 2D features for universal lesion detection in CT slices. With the novel pre-training method, the proposed MP3D FPN achieves state-of-the-art detection performance on the DeepLesion dataset. The proposed 3D pre-trained weights can potentially be used to boost the performance of other 3D medical image analysis tasks.
  arXiv  Detail & Related papers  (2020-12-16T07:11:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.