FCDM: Sparse-view Sinogram Inpainting with Frequency Domain Convolution Enhanced Diffusion Models

• URL: http://arxiv.org/abs/2409.06714v1
• Date: Mon, 26 Aug 2024 12:31:38 GMT
• Title: FCDM: Sparse-view Sinogram Inpainting with Frequency Domain Convolution Enhanced Diffusion Models
• Authors: Jiaze E, Srutarshi Banerjee, Tekin Bicer, Guannan Wang, Bin Ren,
• Abstract summary: Reducing the radiation dose in computed tomography (CT) is crucial, but it often results in sparse-view CT, where the number of available projections is significantly reduced. Sinogram inpainting enables accurate image reconstruction with limited projections. Existing models performing well on conventional RGB images for inpainting mostly fail in the case of sinograms. We propose a novel model called the Frequency Convolution Diffusion Model (FCDM) It employs frequency domain convolutions to extract frequency information from various angles and capture the intricate relationships between these angles.
• Score: 8.057037609493824
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Reducing the radiation dose in computed tomography (CT) is crucial, but it often results in sparse-view CT, where the number of available projections is significantly reduced. This reduction in projection data makes it challenging to accurately reconstruct high-quality CT images. In this condition, a sinogram, which is a collection of these projections, becomes incomplete. Sinogram inpainting then becomes essential because it enables accurate image reconstruction with limited projections. Existing models performing well on conventional RGB images for inpainting mostly fail in the case of sinograms. Further, these models usually do not make full use of unique properties, e.g., frequency features and absorption characteristics in the sinogram, and cannot handle large-area masks and complex real-world projections well. To address these limitations, we propose a novel model called the Frequency Convolution Diffusion Model (FCDM). It employs frequency domain convolutions to extract frequency information from various angles and capture the intricate relationships between these angles, which is essential for high-quality CT reconstruction. We also design a specific loss function based on the unique properties of a sinogram to maintain the consistency in physical properties, which allows the model to learn more effectively even in larger mask areas. We compare FCDM using both simulations and real data with nine inpainting models examples, among which two are designed for sinogram and seven for RGB. The results indicate that our model significantly improves the quality of the inpainted sinograms in terms of both visually and quantitatively, with an SSIM of more than 0.95 and PSNR of more than 30, achieving up to a 33% improvement in SSIM and a 29% improvement in PSNR compared to the baseline.

Related papers

• Partitioned Hankel-based Diffusion Models for Few-shot Low-dose CT Reconstruction [10.158713017984345]
  We propose a few-shot low-dose CT reconstruction method using Partitioned Hankel-based Diffusion (PHD) models. In the iterative reconstruction stage, an iterative differential equation solver is employed along with data consistency constraints to update the acquired projection data. The results approximate those of normaldose counterparts, validating PHD model as an effective and practical model for reducing artifacts and noise while preserving image quality.
  arXiv  Detail & Related papers  (2024-05-27T13:44:53Z)
• Taming Latent Diffusion Model for Neural Radiance Field Inpainting [63.297262813285265]
  Neural Radiance Field (NeRF) is a representation for 3D reconstruction from multi-view images. We propose tempering the diffusion model'sity with per-scene customization and mitigating the textural shift with masked training. Our framework yields state-of-the-art NeRF inpainting results on various real-world scenes.
  arXiv  Detail & Related papers  (2024-04-15T17:59:57Z)
• Distance Weighted Trans Network for Image Completion [52.318730994423106]
  We propose a new architecture that relies on Distance-based Weighted Transformer (DWT) to better understand the relationships between an image's components. CNNs are used to augment the local texture information of coarse priors. DWT blocks are used to recover certain coarse textures and coherent visual structures.
  arXiv  Detail & Related papers  (2023-10-11T12:46:11Z)
• APRF: Anti-Aliasing Projection Representation Field for Inverse Problem in Imaging [74.9262846410559]
  Sparse-view Computed Tomography (SVCT) reconstruction is an ill-posed inverse problem in imaging. Recent works use Implicit Neural Representations (INRs) to build the coordinate-based mapping between sinograms and CT images. We propose a self-supervised SVCT reconstruction method -- Anti-Aliasing Projection Representation Field (APRF) APRF can build the continuous representation between adjacent projection views via the spatial constraints.
  arXiv  Detail & Related papers  (2023-07-11T14:04:12Z)
• Hierarchical Integration Diffusion Model for Realistic Image Deblurring [71.76410266003917]
  Diffusion models (DMs) have been introduced in image deblurring and exhibited promising performance. We propose the Hierarchical Integration Diffusion Model (HI-Diff), for realistic image deblurring. Experiments on synthetic and real-world blur datasets demonstrate that our HI-Diff outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-05-22T12:18:20Z)
• One Sample Diffusion Model in Projection Domain for Low-Dose CT Imaging [10.797632196651731]
  Low-dose computed tomography (CT) plays a significant role in reducing the radiation risk in clinical applications. With the rapid development and wide application of deep learning, it has brought new directions for the development of low-dose CT imaging algorithms. We propose a fully unsupervised one sample diffusion model (OSDM)in projection domain for low-dose CT reconstruction. The results prove that OSDM is practical and effective model for reducing the artifacts and preserving the image quality.
  arXiv  Detail & Related papers  (2022-12-07T13:39:23Z)
• DeepDC: Deep Distance Correlation as a Perceptual Image Quality Evaluator [53.57431705309919]
  ImageNet pre-trained deep neural networks (DNNs) show notable transferability for building effective image quality assessment (IQA) models. We develop a novel full-reference IQA (FR-IQA) model based exclusively on pre-trained DNN features. We conduct comprehensive experiments to demonstrate the superiority of the proposed quality model on five standard IQA datasets.
  arXiv  Detail & Related papers  (2022-11-09T14:57:27Z)
• Self-Attention Generative Adversarial Network for Iterative Reconstruction of CT Images [0.9208007322096533]
  The aim of this study is to train a single neural network to reconstruct high-quality CT images from noisy or incomplete data. The network includes a self-attention block to model long-range dependencies in the data. Our approach is shown to have comparable overall performance to CIRCLE GAN, while outperforming the other two approaches.
  arXiv  Detail & Related papers  (2021-12-23T19:20:38Z)
• DuDoTrans: Dual-Domain Transformer Provides More Attention for Sinogram Restoration in Sparse-View CT Reconstruction [13.358197688568463]
  iodine radiation in the imaging process induces irreversible injury. Iterative models are proposed to alleviate the appeared artifacts in sparse-view CT images, but the cost is too expensive. We propose textbfDual-textbfDomain textbfDuDoTrans to reconstruct CT image with both the enhanced and raw sinograms.
  arXiv  Detail & Related papers  (2021-11-21T10:41:07Z)
• Towards Top-Down Just Noticeable Difference Estimation of Natural Images [65.14746063298415]
  Just noticeable difference (JND) estimation mainly dedicates to modeling the visibility masking effects of different factors in spatial and frequency domains. In this work, we turn to a dramatically different way to address these problems with a top-down design philosophy. Our proposed JND model can achieve better performance than several latest JND models.
  arXiv  Detail & Related papers  (2021-08-11T06:51:50Z)
• Interpolation of CT Projections by Exploiting Their Self-Similarity and Smoothness [6.891238879512674]
  The proposed algorithm exploits the self-similarity and smoothness of the sinogram. Experiments with simulated and real CT data show that sinogram with the proposed algorithm leads to a substantial improvement in the quality of the reconstructed image.
  arXiv  Detail & Related papers  (2021-03-05T22:41:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.