Image Denoising via Style Disentanglement
- URL: http://arxiv.org/abs/2309.14755v1
- Date: Tue, 26 Sep 2023 08:29:33 GMT
- Title: Image Denoising via Style Disentanglement
- Authors: Jingwei Niu, Jun Cheng, and Shan Tan
- Abstract summary: We propose a novel approach to image denoising that offers both clear denoising mechanism and good performance.
We view noise as a type of image style and remove it by incorporating noise-free styles derived from clean images.
We conduct extensive experiments on synthetic noise removal and real-world image denoising datasets.
- Score: 9.38519460509602
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Image denoising is a fundamental task in low-level computer vision. While
recent deep learning-based image denoising methods have achieved impressive
performance, they are black-box models and the underlying denoising principle
remains unclear. In this paper, we propose a novel approach to image denoising
that offers both clear denoising mechanism and good performance. We view noise
as a type of image style and remove it by incorporating noise-free styles
derived from clean images. To achieve this, we design novel losses and network
modules to extract noisy styles from noisy images and noise-free styles from
clean images. The noise-free style induces low-response activations for noise
features and high-response activations for content features in the feature
space. This leads to the separation of clean contents from noise, effectively
denoising the image. Unlike disentanglement-based image editing tasks that edit
semantic-level attributes using styles, our main contribution lies in editing
pixel-level attributes through global noise-free styles. We conduct extensive
experiments on synthetic noise removal and real-world image denoising datasets
(SIDD and DND), demonstrating the effectiveness of our method in terms of both
PSNR and SSIM metrics. Moreover, we experimentally validate that our method
offers good interpretability.
Related papers
- A Self-Supervised Denoising Strategy for Underwater Acoustic Camera Imageries [3.0918473503782042]
This paper introduces a novel strategy for denoising acoustic camera images using deep learning techniques.
It successfully removes noise while preserving fine feature details, thereby enhancing the performance of local feature matching.
arXiv Detail & Related papers (2024-06-05T04:07:37Z) - Masked Image Training for Generalizable Deep Image Denoising [53.03126421917465]
We present a novel approach to enhance the generalization performance of denoising networks.
Our method involves masking random pixels of the input image and reconstructing the missing information during training.
Our approach exhibits better generalization ability than other deep learning models and is directly applicable to real-world scenarios.
arXiv Detail & Related papers (2023-03-23T09:33:44Z) - Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware
Adversarial Training [50.018580462619425]
We propose a novel framework, namely Pixel-level Noise-aware Generative Adrial Network (PNGAN)
PNGAN employs a pre-trained real denoiser to map the fake and real noisy images into a nearly noise-free solution space.
For better noise fitting, we present an efficient architecture Simple Multi-versa-scale Network (SMNet) as the generator.
arXiv Detail & Related papers (2022-04-06T14:09:02Z) - IDR: Self-Supervised Image Denoising via Iterative Data Refinement [66.5510583957863]
We present a practical unsupervised image denoising method to achieve state-of-the-art denoising performance.
Our method only requires single noisy images and a noise model, which is easily accessible in practical raw image denoising.
To evaluate raw image denoising performance in real-world applications, we build a high-quality raw image dataset SenseNoise-500 that contains 500 real-life scenes.
arXiv Detail & Related papers (2021-11-29T07:22:53Z) - Image Denoising Using the Geodesics' Gramian of the Manifold Underlying Patch-Space [1.7767466724342067]
We propose a novel and computationally efficient image denoising method that is capable of producing accurate images.
To preserve image smoothness, this method inputs patches partitioned from the image rather than pixels.
We validate the performance of this method against benchmark image processing methods.
arXiv Detail & Related papers (2020-10-14T04:07:24Z) - Enhancing and Learning Denoiser without Clean Reference [23.11994688706024]
We propose a novel deep image-denoising method by regarding the noise reduction task as a special case of the noise transference task.
The results on real-world denoising benchmarks demonstrate that our proposed method achieves promising performance on removing realistic noises.
arXiv Detail & Related papers (2020-09-09T13:15:31Z) - Unpaired Learning of Deep Image Denoising [80.34135728841382]
This paper presents a two-stage scheme by incorporating self-supervised learning and knowledge distillation.
For self-supervised learning, we suggest a dilated blind-spot network (D-BSN) to learn denoising solely from real noisy images.
Experiments show that our unpaired learning method performs favorably on both synthetic noisy images and real-world noisy photographs.
arXiv Detail & Related papers (2020-08-31T16:22:40Z) - Dual Adversarial Network: Toward Real-world Noise Removal and Noise
Generation [52.75909685172843]
Real-world image noise removal is a long-standing yet very challenging task in computer vision.
We propose a novel unified framework to deal with the noise removal and noise generation tasks.
Our method learns the joint distribution of the clean-noisy image pairs.
arXiv Detail & Related papers (2020-07-12T09:16:06Z) - NoiseBreaker: Gradual Image Denoising Guided by Noise Analysis [5.645552640953684]
This paper proposes a gradual denoising strategy that iteratively detects the dominating noise in an image, and removes it using a tailored denoiser.
The method provides an insight on the nature of the encountered noise, and it makes it possible to extend an existing denoiser with new noise nature.
arXiv Detail & Related papers (2020-02-18T11:09:03Z) - Variational Denoising Network: Toward Blind Noise Modeling and Removal [59.36166491196973]
Blind image denoising is an important yet very challenging problem in computer vision.
We propose a new variational inference method, which integrates both noise estimation and image denoising.
arXiv Detail & Related papers (2019-08-29T15:54:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.