Noise2Score: Tweedie's Approach to Self-Supervised Image Denoising without Clean Images

• URL: http://arxiv.org/abs/2106.07009v1
• Date: Sun, 13 Jun 2021 14:41:09 GMT
• Title: Noise2Score: Tweedie's Approach to Self-Supervised Image Denoising without Clean Images
• Authors: Kwanyoung Kim, Jong Chul Ye
• Abstract summary: We present a novel approach, called Noise2Score, which reveals a missing link in order to unite different approaches. Specifically, we show that image denoising problems without clean images can be addressed by finding the mode of the posterior distribution. Our method then uses the recent finding that the score function can be stably estimated from the noisy images using the amortized residual denoising autoencoder.
• Score: 35.41467558264341
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recently, there has been extensive research interest in training deep networks to denoise images without clean reference. However, the representative approaches such as Noise2Noise, Noise2Void, Stein's unbiased risk estimator (SURE), etc. seem to differ from one another and it is difficult to find the coherent mathematical structure. To address this, here we present a novel approach, called Noise2Score, which reveals a missing link in order to unite these seemingly different approaches. Specifically, we show that image denoising problems without clean images can be addressed by finding the mode of the posterior distribution and that the Tweedie's formula offers an explicit solution through the score function (i.e. the gradient of log likelihood). Our method then uses the recent finding that the score function can be stably estimated from the noisy images using the amortized residual denoising autoencoder, the method of which is closely related to Noise2Noise or Nose2Void. Our Noise2Score approach is so universal that the same network training can be used to remove noises from images that are corrupted by any exponential family distributions and noise parameters. Using extensive experiments with Gaussian, Poisson, and Gamma noises, we show that Noise2Score significantly outperforms the state-of-the-art self-supervised denoising methods in the benchmark data set such as (C)BSD68, Set12, and Kodak, etc.

Related papers

• Advancing Unsupervised Low-light Image Enhancement: Noise Estimation, Illumination Interpolation, and Self-Regulation [55.07472635587852]
  Low-Light Image Enhancement (LLIE) techniques have made notable advancements in preserving image details and enhancing contrast. These approaches encounter persistent challenges in efficiently mitigating dynamic noise and accommodating diverse low-light scenarios. We first propose a method for estimating the noise level in low light images in a quick and accurate way. We then devise a Learnable Illumination Interpolator (LII) to satisfy general constraints between illumination and input.
  arXiv  Detail & Related papers  (2023-05-17T13:56:48Z)
• Zero-Shot Noise2Noise: Efficient Image Denoising without any Data [26.808569077500128]
  We show that a simple 2-layer network, without any training data or knowledge of the noise distribution, can enable high-quality image denoising at low computational cost. Our approach is motivated by Noise2Noise and Neighbor2Neighbor and works well for denoising pixel-wise independent noise.
  arXiv  Detail & Related papers  (2023-03-20T16:40:37Z)
• Target Aware Poisson-Gaussian Noise Parameters Estimation from Noisy Images [0.0]
  We use a Poisson-Gaussian noise model for the raw-images captured by the sensor. We propose two algorithms based on variance and cumulant statistics.
  arXiv  Detail & Related papers  (2022-10-21T17:53:56Z)
• Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Training [50.018580462619425]
  We propose a novel framework, namely Pixel-level Noise-aware Generative Adrial Network (PNGAN) PNGAN employs a pre-trained real denoiser to map the fake and real noisy images into a nearly noise-free solution space. For better noise fitting, we present an efficient architecture Simple Multi-versa-scale Network (SMNet) as the generator.
  arXiv  Detail & Related papers  (2022-04-06T14:09:02Z)
• IDR: Self-Supervised Image Denoising via Iterative Data Refinement [66.5510583957863]
  We present a practical unsupervised image denoising method to achieve state-of-the-art denoising performance. Our method only requires single noisy images and a noise model, which is easily accessible in practical raw image denoising. To evaluate raw image denoising performance in real-world applications, we build a high-quality raw image dataset SenseNoise-500 that contains 500 real-life scenes.
  arXiv  Detail & Related papers  (2021-11-29T07:22:53Z)
• Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images [98.82804259905478]
  We present Neighbor2Neighbor to train an effective image denoising model with only noisy images. In detail, input and target used to train a network are images sub-sampled from the same noisy image. A denoising network is trained on sub-sampled training pairs generated in the first stage, with a proposed regularizer as additional loss for better performance.
  arXiv  Detail & Related papers  (2021-01-08T02:03:25Z)
• Noise2Stack: Improving Image Restoration by Learning from Volumetric Data [0.0]
  We introduce Noise2Stack, an extension of the Noise2Noise method to image stacks. Our experiments on magnetic resonance brain scans and newly acquired multiplane microscopy data show that learning only from image neighbors in a stack is sufficient to outperform Noise2Noise and Noise2Void.
  arXiv  Detail & Related papers  (2020-11-10T14:01:47Z)
• Unpaired Learning of Deep Image Denoising [80.34135728841382]
  This paper presents a two-stage scheme by incorporating self-supervised learning and knowledge distillation. For self-supervised learning, we suggest a dilated blind-spot network (D-BSN) to learn denoising solely from real noisy images. Experiments show that our unpaired learning method performs favorably on both synthetic noisy images and real-world noisy photographs.
  arXiv  Detail & Related papers  (2020-08-31T16:22:40Z)
• Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generation [52.75909685172843]
  Real-world image noise removal is a long-standing yet very challenging task in computer vision. We propose a novel unified framework to deal with the noise removal and noise generation tasks. Our method learns the joint distribution of the clean-noisy image pairs.
  arXiv  Detail & Related papers  (2020-07-12T09:16:06Z)
• Noise2Inpaint: Learning Referenceless Denoising by Inpainting Unrolling [2.578242050187029]
  We introduce Noise2Inpaint (N2I), a training approach that recasts the denoising problem into a regularized image inpainting framework. N2I performs successful denoising on real-world datasets, while better preserving details compared to its purely data-driven counterpart Noise2Self.
  arXiv  Detail & Related papers  (2020-06-16T18:46:42Z)
• Handling noise in image deblurring via joint learning [0.3407858371718068]
  Many blind deblurring methods assume blurred images are noise-free and perform unsatisfactorily on the blurry images with noise. We propose a cascaded framework consisting of a denoiser subnetwork and a deblurring subnetwork. Joint learning reduces the effect of the residual noise after denoising on deblurring, hence improves the robustness of deblurring to heavy noise.
  arXiv  Detail & Related papers  (2020-01-27T12:59:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.