A Conditional Denoising Diffusion Probabilistic Model for Radio Interferometric Image Reconstruction

• URL: http://arxiv.org/abs/2305.09121v2
• Date: Tue, 29 Aug 2023 06:11:58 GMT
• Title: A Conditional Denoising Diffusion Probabilistic Model for Radio Interferometric Image Reconstruction
• Authors: Ruoqi Wang, Zhuoyang Chen, Qiong Luo, Feng Wang
• Abstract summary: We present VIC-DDPM, a Visibility and Image Conditioned Denoising Diffusion Probabilistic Model. Our main idea is to use both the original visibility data in the spectral domain and dirty images in the spatial domain to guide the image generation process with DDPM. Our results show that our method significantly improves the resulting images by reducing artifacts, preserving fine details, and recovering dim sources.
• Score: 4.715025376297672
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In radio astronomy, signals from radio telescopes are transformed into images of observed celestial objects, or sources. However, these images, called dirty images, contain real sources as well as artifacts due to signal sparsity and other factors. Therefore, radio interferometric image reconstruction is performed on dirty images, aiming to produce clean images in which artifacts are reduced and real sources are recovered. So far, existing methods have limited success on recovering faint sources, preserving detailed structures, and eliminating artifacts. In this paper, we present VIC-DDPM, a Visibility and Image Conditioned Denoising Diffusion Probabilistic Model. Our main idea is to use both the original visibility data in the spectral domain and dirty images in the spatial domain to guide the image generation process with DDPM. This way, we can leverage DDPM to generate fine details and eliminate noise, while utilizing visibility data to separate signals from noise and retaining spatial information in dirty images. We have conducted experiments in comparison with both traditional methods and recent deep learning based approaches. Our results show that our method significantly improves the resulting images by reducing artifacts, preserving fine details, and recovering dim sources. This advancement further facilitates radio astronomical data analysis tasks on celestial phenomena.

Related papers

• Diff-FMT: Diffusion Models for Fluorescence Molecular Tomography [16.950699640321936]
  We propose a FMT reconstruction method based on a denoising diffusion probabilistic model (DDPM) Through the step-by-step probability sampling mechanism, we achieve fine-grained reconstruction of the image, avoiding issues such as loss of image detail. We show that Diff-FMT can achieve high-resolution reconstruction images without relying on large-scale datasets.
  arXiv  Detail & Related papers  (2024-10-09T10:41:31Z)
• Radio-astronomical Image Reconstruction with Conditional Denoising Diffusion Model [5.673449249014537]
  Reconstructing sky models from dirty radio images is crucial for studying galaxy evolution at high redshift. Current techniques, such as CLEAN and PyBDSF, often fail to detect faint sources. This study proposes using neural networks to rebuild sky models directly from dirty images.
  arXiv  Detail & Related papers  (2024-02-15T18:57:24Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• TDiffDe: A Truncated Diffusion Model for Remote Sensing Hyperspectral Image Denoising [5.978703842488647]
  We propose a truncated diffusion model, called TDiffDe, to recover the useful information in hyperspectral images gradually. Rather than starting from a pure noise, the input data contains image information in hyperspectral image denoising.
  arXiv  Detail & Related papers  (2023-11-22T08:49:08Z)
• Towards High-quality HDR Deghosting with Conditional Diffusion Models [88.83729417524823]
  High Dynamic Range (LDR) images can be recovered from several Low Dynamic Range (LDR) images by existing Deep Neural Networks (DNNs) techniques. DNNs still generate ghosting artifacts when LDR images have saturation and large motion. We formulate the HDR deghosting problem as an image generation that leverages LDR features as the diffusion model's condition.
  arXiv  Detail & Related papers  (2023-11-02T01:53:55Z)
• Improving Lens Flare Removal with General Purpose Pipeline and Multiple Light Sources Recovery [69.71080926778413]
  flare artifacts can affect image visual quality and downstream computer vision tasks. Current methods do not consider automatic exposure and tone mapping in image signal processing pipeline. We propose a solution to improve the performance of lens flare removal by revisiting the ISP and design a more reliable light sources recovery strategy.
  arXiv  Detail & Related papers  (2023-08-31T04:58:17Z)
• DIRE for Diffusion-Generated Image Detection [128.95822613047298]
  We propose a novel representation called DIffusion Reconstruction Error (DIRE) DIRE measures the error between an input image and its reconstruction counterpart by a pre-trained diffusion model. It provides a hint that DIRE can serve as a bridge to distinguish generated and real images.
  arXiv  Detail & Related papers  (2023-03-16T13:15:03Z)
• The role of noise in denoising models for anomaly detection in medical images [62.0532151156057]
  Pathological brain lesions exhibit diverse appearance in brain images. Unsupervised anomaly detection approaches have been proposed using only normal data for training. We show that optimization of the spatial resolution and magnitude of the noise improves the performance of different model training regimes.
  arXiv  Detail & Related papers  (2023-01-19T21:39:38Z)
• Convolutional Deep Denoising Autoencoders for Radio Astronomical Images [0.0]
  We apply a Machine Learning technique known as Convolutional Denoising Autoencoder to denoise synthetic images of state-of-the-art radio telescopes. Our autoencoder can effectively denoise complex images identifying and extracting faint objects at the limits of the instrumental sensitivity.
  arXiv  Detail & Related papers  (2021-10-16T17:08:30Z)
• Learning MRI Artifact Removal With Unpaired Data [74.48301038665929]
  Retrospective artifact correction (RAC) improves image quality post acquisition and enhances image usability. Recent machine learning driven techniques for RAC are predominantly based on supervised learning. Here we show that unwanted image artifacts can be disentangled and removed from an image via an RAC neural network learned with unpaired data.
  arXiv  Detail & Related papers  (2021-10-09T16:09:27Z)
• AS-Net: Fast Photoacoustic Reconstruction with Multi-feature Fusion from Sparse Data [1.7237160821929758]
  Photoacoustic imaging is capable of acquiring high contrast images of optical absorption at depths much greater than traditional optical imaging techniques. In this paper, we employ a novel signal processing method to make sparse PA raw data more suitable for the neural network. We then propose Attention Steered Network (AS-Net) for PA reconstruction with multi-feature fusion.
  arXiv  Detail & Related papers  (2021-01-22T03:49:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.