Restore from Restored: Single Image Denoising with Pseudo Clean Image
- URL: http://arxiv.org/abs/2003.04721v3
- Date: Wed, 18 Nov 2020 06:35:28 GMT
- Title: Restore from Restored: Single Image Denoising with Pseudo Clean Image
- Authors: Seunghwan Lee, Dongkyu Lee, Donghyeon Cho, Jiwon Kim, Tae Hyun Kim
- Abstract summary: We propose a simple and effective fine-tuning algorithm called "restore-from-restored"
Our method can be easily employed on top of the state-of-the-art denoising networks.
- Score: 28.38369890008251
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this study, we propose a simple and effective fine-tuning algorithm called
"restore-from-restored", which can greatly enhance the performance of fully
pre-trained image denoising networks. Many supervised denoising approaches can
produce satisfactory results using large external training datasets. However,
these methods have limitations in using internal information available in a
given test image. By contrast, recent self-supervised approaches can remove
noise in the input image by utilizing information from the specific test input.
However, such methods show relatively lower performance on known noise types
such as Gaussian noise compared to supervised methods. Thus, to combine
external and internal information, we fine-tune the fully pre-trained denoiser
using pseudo training set at test time. By exploiting internal self-similar
patches (i.e., patch-recurrence), the baseline network can be adapted to the
given specific input image. We demonstrate that our method can be easily
employed on top of the state-of-the-art denoising networks and further improve
the performance on numerous denoising benchmark datasets including real noisy
images.
Related papers
- Self2Self+: Single-Image Denoising with Self-Supervised Learning and
Image Quality Assessment Loss [4.035753155957699]
The proposed method achieves state-of-the-art denoising performance on both synthetic and real-world datasets.
This highlights the effectiveness and practicality of our method as a potential solution for various noise removal tasks.
arXiv Detail & Related papers (2023-07-20T08:38:01Z) - Masked Image Training for Generalizable Deep Image Denoising [53.03126421917465]
We present a novel approach to enhance the generalization performance of denoising networks.
Our method involves masking random pixels of the input image and reconstructing the missing information during training.
Our approach exhibits better generalization ability than other deep learning models and is directly applicable to real-world scenarios.
arXiv Detail & Related papers (2023-03-23T09:33:44Z) - Linear Combinations of Patches are Unreasonably Effective for Single-Image Denoising [5.893124686141782]
Deep neural networks have revolutionized image denoising in achieving significant accuracy improvements.
To alleviate the requirement to learn image priors externally, single-image methods perform denoising solely based on the analysis of the input noisy image.
This work investigates the effectiveness of linear combinations of patches for denoising under this constraint.
arXiv Detail & Related papers (2022-12-01T10:52:03Z) - Enhancing convolutional neural network generalizability via low-rank weight approximation [6.763245393373041]
Sufficient denoising is often an important first step for image processing.
Deep neural networks (DNNs) have been widely used for image denoising.
We introduce a new self-supervised framework for image denoising based on the Tucker low-rank tensor approximation.
arXiv Detail & Related papers (2022-09-26T14:11:05Z) - IDR: Self-Supervised Image Denoising via Iterative Data Refinement [66.5510583957863]
We present a practical unsupervised image denoising method to achieve state-of-the-art denoising performance.
Our method only requires single noisy images and a noise model, which is easily accessible in practical raw image denoising.
To evaluate raw image denoising performance in real-world applications, we build a high-quality raw image dataset SenseNoise-500 that contains 500 real-life scenes.
arXiv Detail & Related papers (2021-11-29T07:22:53Z) - Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images [98.82804259905478]
We present Neighbor2Neighbor to train an effective image denoising model with only noisy images.
In detail, input and target used to train a network are images sub-sampled from the same noisy image.
A denoising network is trained on sub-sampled training pairs generated in the first stage, with a proposed regularizer as additional loss for better performance.
arXiv Detail & Related papers (2021-01-08T02:03:25Z) - Unpaired Learning of Deep Image Denoising [80.34135728841382]
This paper presents a two-stage scheme by incorporating self-supervised learning and knowledge distillation.
For self-supervised learning, we suggest a dilated blind-spot network (D-BSN) to learn denoising solely from real noisy images.
Experiments show that our unpaired learning method performs favorably on both synthetic noisy images and real-world noisy photographs.
arXiv Detail & Related papers (2020-08-31T16:22:40Z) - Improving Blind Spot Denoising for Microscopy [73.94017852757413]
We present a novel way to improve the quality of self-supervised denoising.
We assume the clean image to be the result of a convolution with a point spread function (PSF) and explicitly include this operation at the end of our neural network.
arXiv Detail & Related papers (2020-08-19T13:06:24Z) - Self-Supervised Fast Adaptation for Denoising via Meta-Learning [28.057705167363327]
We propose a new denoising approach that can greatly outperform the state-of-the-art supervised denoising methods.
We show that the proposed method can be easily employed with state-of-the-art denoising networks without additional parameters.
arXiv Detail & Related papers (2020-01-09T09:40:53Z) - Variational Denoising Network: Toward Blind Noise Modeling and Removal [59.36166491196973]
Blind image denoising is an important yet very challenging problem in computer vision.
We propose a new variational inference method, which integrates both noise estimation and image denoising.
arXiv Detail & Related papers (2019-08-29T15:54:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.