FCDM: Sparse-view Sinogram Inpainting with Frequency Domain Convolution Enhanced Diffusion Models

• URL: http://arxiv.org/abs/2409.06714v2
• Date: Fri, 22 Nov 2024 21:17:56 GMT
• Title: FCDM: Sparse-view Sinogram Inpainting with Frequency Domain Convolution Enhanced Diffusion Models
• Authors: Jiaze E, Srutarshi Banerjee, Tekin Bicer, Guannan Wang, Yanfu Zhang, Bin Ren,
• Abstract summary: We introduce a novel diffusion-based inpainting framework tailored for sinogram data. FCDM significantly outperforms existing methods, achieving SSIM over 0.95 and PSNR above 30 dB, with improvements of up to 33% in SSIM and 29% in PSNR compared to baselines.
• Score: 14.043383277622874
• License:
• Abstract: Computed tomography (CT) is an imaging technique that uses X-ray projections from multiple rotation angles to create detailed cross-sectional images, widely used in industrial inspection and medical diagnostics. Reducing the projection data in CT scans is often necessary to decrease radiation exposure, scanning time, and computational costs. However, this reduction makes accurate image reconstruction challenging due to the incomplete sinogram. Existing RGB inpainting models struggle with severe feature overlap, while current sinogram-specific models fail to employ efficient feature extraction methods that account for the physical principles underlying the sinogram generation process. To tackle these challenges, we introduce the Frequency Convolution Diffusion Model (FCDM), a novel diffusion-based inpainting framework tailored for sinogram data. FCDM leverages frequency-domain convolutions to capture global and fine-grained structural features, effectively disentangling overlapping components across projection angles. Additionally, we propose a custom loss function that incorporates unique sinogram properties of total absorption consistency and frequency-domain consistency. Extensive experiments on synthetic and real-world datasets demonstrate that FCDM significantly outperforms existing methods, achieving SSIM over 0.95 and PSNR above 30 dB, with improvements of up to 33% in SSIM and 29% in PSNR compared to baselines.

Related papers

• Partitioned Hankel-based Diffusion Models for Few-shot Low-dose CT Reconstruction [10.158713017984345]
  We propose a few-shot low-dose CT reconstruction method using Partitioned Hankel-based Diffusion (PHD) models. In the iterative reconstruction stage, an iterative differential equation solver is employed along with data consistency constraints to update the acquired projection data. The results approximate those of normaldose counterparts, validating PHD model as an effective and practical model for reducing artifacts and noise while preserving image quality.
  arXiv  Detail & Related papers  (2024-05-27T13:44:53Z)
• Generalized Consistency Trajectory Models for Image Manipulation [59.576781858809355]
  Diffusion models (DMs) excel in unconditional generation, as well as on applications such as image editing and restoration. This work aims to unlock the full potential of consistency trajectory models (CTMs) by proposing generalized CTMs (GCTMs) We discuss the design space of GCTMs and demonstrate their efficacy in various image manipulation tasks such as image-to-image translation, restoration, and editing.
  arXiv  Detail & Related papers  (2024-03-19T07:24:54Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• APRF: Anti-Aliasing Projection Representation Field for Inverse Problem in Imaging [74.9262846410559]
  Sparse-view Computed Tomography (SVCT) reconstruction is an ill-posed inverse problem in imaging. Recent works use Implicit Neural Representations (INRs) to build the coordinate-based mapping between sinograms and CT images. We propose a self-supervised SVCT reconstruction method -- Anti-Aliasing Projection Representation Field (APRF) APRF can build the continuous representation between adjacent projection views via the spatial constraints.
  arXiv  Detail & Related papers  (2023-07-11T14:04:12Z)
• Geometric Constraints Enable Self-Supervised Sinogram Inpainting in Sparse-View Tomography [7.416898042520079]
  Sparse-angle tomographic scans reduce radiation and accelerate data acquisition, but suffer from image artifacts and noise. Existing image processing algorithms can restore CT reconstruction quality but often require large training data sets or can not be used for truncated objects. This work presents a self-supervised projection inpainting method that allows optimizing missing projective views via gradient-based optimization.
  arXiv  Detail & Related papers  (2023-02-13T15:15:18Z)
• Orientation-Shared Convolution Representation for CT Metal Artifact Learning [63.67718355820655]
  During X-ray computed tomography (CT) scanning, metallic implants carrying with patients often lead to adverse artifacts. Existing deep-learning-based methods have gained promising reconstruction performance. We propose an orientation-shared convolution representation strategy to adapt the physical prior structures of artifacts.
  arXiv  Detail & Related papers  (2022-12-26T13:56:12Z)
• One Sample Diffusion Model in Projection Domain for Low-Dose CT Imaging [10.797632196651731]
  Low-dose computed tomography (CT) plays a significant role in reducing the radiation risk in clinical applications. With the rapid development and wide application of deep learning, it has brought new directions for the development of low-dose CT imaging algorithms. We propose a fully unsupervised one sample diffusion model (OSDM)in projection domain for low-dose CT reconstruction. The results prove that OSDM is practical and effective model for reducing the artifacts and preserving the image quality.
  arXiv  Detail & Related papers  (2022-12-07T13:39:23Z)
• Self-Attention Generative Adversarial Network for Iterative Reconstruction of CT Images [0.9208007322096533]
  The aim of this study is to train a single neural network to reconstruct high-quality CT images from noisy or incomplete data. The network includes a self-attention block to model long-range dependencies in the data. Our approach is shown to have comparable overall performance to CIRCLE GAN, while outperforming the other two approaches.
  arXiv  Detail & Related papers  (2021-12-23T19:20:38Z)
• DuDoTrans: Dual-Domain Transformer Provides More Attention for Sinogram Restoration in Sparse-View CT Reconstruction [13.358197688568463]
  iodine radiation in the imaging process induces irreversible injury. Iterative models are proposed to alleviate the appeared artifacts in sparse-view CT images, but the cost is too expensive. We propose textbfDual-textbfDomain textbfDuDoTrans to reconstruct CT image with both the enhanced and raw sinograms.
  arXiv  Detail & Related papers  (2021-11-21T10:41:07Z)
• CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for Non-Contrast to Contrast CT Translation [56.622832383316215]
  We propose a novel approach to translate unpaired contrast computed tomography (CT) scans to non-contrast CT scans. Our approach is based on cycle-consistent generative adversarial convolutional transformers, for short, CyTran. Our empirical results show that CyTran outperforms all competing methods.
  arXiv  Detail & Related papers  (2021-10-12T23:25:03Z)
• Multifold Acceleration of Diffusion MRI via Slice-Interleaved Diffusion Encoding (SIDE) [50.65891535040752]
  We propose a diffusion encoding scheme, called Slice-Interleaved Diffusion. SIDE, that interleaves each diffusion-weighted (DW) image volume with slices encoded with different diffusion gradients. We also present a method based on deep learning for effective reconstruction of DW images from the highly slice-undersampled data.
  arXiv  Detail & Related papers  (2020-02-25T14:48:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.