Noise2Inpaint: Learning Referenceless Denoising by Inpainting Unrolling
- URL: http://arxiv.org/abs/2006.09450v2
- Date: Thu, 19 Nov 2020 16:56:54 GMT
- Title: Noise2Inpaint: Learning Referenceless Denoising by Inpainting Unrolling
- Authors: Burhaneddin Yaman, Seyed Amir Hossein Hosseini, Mehmet Ak\c{c}akaya
- Abstract summary: We introduce Noise2Inpaint (N2I), a training approach that recasts the denoising problem into a regularized image inpainting framework.
N2I performs successful denoising on real-world datasets, while better preserving details compared to its purely data-driven counterpart Noise2Self.
- Score: 2.578242050187029
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep learning based image denoising methods have been recently popular due to
their improved performance. Traditionally, these methods are trained in a
supervised manner, requiring a set of noisy input and clean target image pairs.
More recently, self-supervised approaches have been proposed to learn denoising
from only noisy images. These methods assume that noise across pixels is
statistically independent, and the underlying image pixels show spatial
correlations across neighborhoods. These methods rely on a masking approach
that divides the image pixels into two disjoint sets, where one is used as
input to the network while the other is used to define the loss. However, these
previous self-supervised approaches rely on a purely data-driven regularization
neural network without explicitly taking the masking model into account. In
this work, building on these self-supervised approaches, we introduce
Noise2Inpaint (N2I), a training approach that recasts the denoising problem
into a regularized image inpainting framework. This allows us to use an
objective function, which can incorporate different statistical properties of
the noise as needed. We use algorithm unrolling to unroll an iterative
optimization for solving this objective function and train the unrolled network
end-to-end. The training paradigm follows the masking approach from previous
works, splitting the pixels into two disjoint sets. Importantly, one of these
is now used to impose data fidelity in the unrolled network, while the other
still defines the loss. We demonstrate that N2I performs successful denoising
on real-world datasets, while better preserving details compared to its purely
data-driven counterpart Noise2Self.
Related papers
- Self-Calibrated Variance-Stabilizing Transformations for Real-World Image Denoising [19.08732222562782]
Supervised deep learning has become the method of choice for image denoising.
We show that, contrary to popular belief, denoising networks specialized in the removal of Gaussian noise can be efficiently leveraged in favor of real-world image denoising.
arXiv Detail & Related papers (2024-07-24T16:23:46Z) - Masked Image Training for Generalizable Deep Image Denoising [53.03126421917465]
We present a novel approach to enhance the generalization performance of denoising networks.
Our method involves masking random pixels of the input image and reconstructing the missing information during training.
Our approach exhibits better generalization ability than other deep learning models and is directly applicable to real-world scenarios.
arXiv Detail & Related papers (2023-03-23T09:33:44Z) - Linear Combinations of Patches are Unreasonably Effective for Single-Image Denoising [5.893124686141782]
Deep neural networks have revolutionized image denoising in achieving significant accuracy improvements.
To alleviate the requirement to learn image priors externally, single-image methods perform denoising solely based on the analysis of the input noisy image.
This work investigates the effectiveness of linear combinations of patches for denoising under this constraint.
arXiv Detail & Related papers (2022-12-01T10:52:03Z) - Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware
Adversarial Training [50.018580462619425]
We propose a novel framework, namely Pixel-level Noise-aware Generative Adrial Network (PNGAN)
PNGAN employs a pre-trained real denoiser to map the fake and real noisy images into a nearly noise-free solution space.
For better noise fitting, we present an efficient architecture Simple Multi-versa-scale Network (SMNet) as the generator.
arXiv Detail & Related papers (2022-04-06T14:09:02Z) - IDR: Self-Supervised Image Denoising via Iterative Data Refinement [66.5510583957863]
We present a practical unsupervised image denoising method to achieve state-of-the-art denoising performance.
Our method only requires single noisy images and a noise model, which is easily accessible in practical raw image denoising.
To evaluate raw image denoising performance in real-world applications, we build a high-quality raw image dataset SenseNoise-500 that contains 500 real-life scenes.
arXiv Detail & Related papers (2021-11-29T07:22:53Z) - Noise2Score: Tweedie's Approach to Self-Supervised Image Denoising
without Clean Images [35.41467558264341]
We present a novel approach, called Noise2Score, which reveals a missing link in order to unite different approaches.
Specifically, we show that image denoising problems without clean images can be addressed by finding the mode of the posterior distribution.
Our method then uses the recent finding that the score function can be stably estimated from the noisy images using the amortized residual denoising autoencoder.
arXiv Detail & Related papers (2021-06-13T14:41:09Z) - Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images [98.82804259905478]
We present Neighbor2Neighbor to train an effective image denoising model with only noisy images.
In detail, input and target used to train a network are images sub-sampled from the same noisy image.
A denoising network is trained on sub-sampled training pairs generated in the first stage, with a proposed regularizer as additional loss for better performance.
arXiv Detail & Related papers (2021-01-08T02:03:25Z) - Unpaired Learning of Deep Image Denoising [80.34135728841382]
This paper presents a two-stage scheme by incorporating self-supervised learning and knowledge distillation.
For self-supervised learning, we suggest a dilated blind-spot network (D-BSN) to learn denoising solely from real noisy images.
Experiments show that our unpaired learning method performs favorably on both synthetic noisy images and real-world noisy photographs.
arXiv Detail & Related papers (2020-08-31T16:22:40Z) - Dual Adversarial Network: Toward Real-world Noise Removal and Noise
Generation [52.75909685172843]
Real-world image noise removal is a long-standing yet very challenging task in computer vision.
We propose a novel unified framework to deal with the noise removal and noise generation tasks.
Our method learns the joint distribution of the clean-noisy image pairs.
arXiv Detail & Related papers (2020-07-12T09:16:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.