Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --

• URL: http://arxiv.org/abs/2301.03362v1
• Date: Mon, 9 Jan 2023 14:16:40 GMT
• Title: Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --
• Authors: Michael Elad, Bahjat Kawar, Gregory Vaksman
• Abstract summary: Image denoising is one of the oldest and most studied problems in image processing. The penetration of deep learning into image processing brought a revolution to image denoising. Recent transitions in the field of image denoising go far beyond the ability to design better denoisers.
• Score: 19.648352957466983
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Image denoising (removal of additive white Gaussian noise from an image) is one of the oldest and most studied problems in image processing. An extensive work over several decades has led to thousands of papers on this subject, and to many well-performing algorithms for this task. Indeed, 10 years ago, these achievements have led some researchers to suspect that "Denoising is Dead", in the sense that all that can be achieved in this domain has already been obtained. However, this turned out to be far from the truth, with the penetration of deep learning (DL) into image processing. The era of DL brought a revolution to image denoising, both by taking the lead in today's ability for noise removal in images, and by broadening the scope of denoising problems being treated. Our paper starts by describing this evolution, highlighting in particular the tension and synergy that exist between classical approaches and modern DL-based alternatives in design of image denoisers. The recent transitions in the field of image denoising go far beyond the ability to design better denoisers. In the 2nd part of this paper we focus on recently discovered abilities and prospects of image denoisers. We expose the possibility of using denoisers to serve other problems, such as regularizing general inverse problems and serving as the prime engine in diffusion-based image synthesis. We also unveil the idea that denoising and other inverse problems might not have a unique solution as common algorithms would have us believe. Instead, we describe constructive ways to produce randomized and diverse high quality results for inverse problems, all fueled by the progress that DL brought to image denoising. This survey paper aims to provide a broad view of the history of image denoising and closely related topics. Our aim is to give a better context to recent discoveries, and to the influence of DL in our domain.

Related papers

• Denoising: A Powerful Building-Block for Imaging, Inverse Problems, and Machine Learning [19.222811476224383]
  Denoising is the process of reducing random fluctuations in a signal to emphasize essential patterns. Recent denoising techniques, particularly in imaging, have achieved remarkable success. Despite its long history, the community continues to uncover unexpected and groundbreaking uses for denoising.
  arXiv  Detail & Related papers  (2024-09-10T05:05:34Z)
• Masked Image Training for Generalizable Deep Image Denoising [53.03126421917465]
  We present a novel approach to enhance the generalization performance of denoising networks. Our method involves masking random pixels of the input image and reconstructing the missing information during training. Our approach exhibits better generalization ability than other deep learning models and is directly applicable to real-world scenarios.
  arXiv  Detail & Related papers  (2023-03-23T09:33:44Z)
• Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesis [148.16279746287452]
  We propose a swin-conv block to incorporate the local modeling ability of residual convolutional layer and non-local modeling ability of swin transformer block. For the training data synthesis, we design a practical noise degradation model which takes into consideration different kinds of noise. Experiments on AGWN removal and real image denoising demonstrate that the new network architecture design achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2022-03-24T18:11:31Z)
• A Critical Analysis of Patch Similarity Based Image Denoising Algorithms [0.0]
  Image denoising is a classical signal processing problem. Most of the algorithms for image denoising has focused on the paradigm of non-local similarity. This paper reviews multiple aspects of image denoising algorithm development based on non-local similarity.
  arXiv  Detail & Related papers  (2020-08-25T05:30:37Z)
• Pasadena: Perceptually Aware and Stealthy Adversarial Denoise Attack [45.74991480637961]
  Image denoising can remove noise that widely exists in images captured by multimedia devices due to low-quality imaging sensors, unstable image transmission processes, or low light conditions. Recent works also find that image denoising benefits the high-level vision tasks, e.g., image classification. In this work, we try to challenge this common sense and explore a totally new problem, i.e., whether the image denoising can be given the capability of fooling the state-of-the-art deep neural networks (DNNs) while enhancing the image quality.
  arXiv  Detail & Related papers  (2020-07-14T15:18:08Z)
• Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generation [52.75909685172843]
  Real-world image noise removal is a long-standing yet very challenging task in computer vision. We propose a novel unified framework to deal with the noise removal and noise generation tasks. Our method learns the joint distribution of the clean-noisy image pairs.
  arXiv  Detail & Related papers  (2020-07-12T09:16:06Z)
• A Review of an Old Dilemma: Demosaicking First, or Denoising First? [16.328866317851183]
  Denoising and demosaicking aim at reconstructing a full color image from a noisy color filter array (CFA) image. In this paper, we review the main variants of these strategies and carry-out an extensive evaluation to find the best way to reconstruct full color images from a noisy mosaic.
  arXiv  Detail & Related papers  (2020-04-24T07:32:17Z)
• NoiseBreaker: Gradual Image Denoising Guided by Noise Analysis [5.645552640953684]
  This paper proposes a gradual denoising strategy that iteratively detects the dominating noise in an image, and removes it using a tailored denoiser. The method provides an insight on the nature of the encountered noise, and it makes it possible to extend an existing denoiser with new noise nature.
  arXiv  Detail & Related papers  (2020-02-18T11:09:03Z)
• Reconstructing the Noise Manifold for Image Denoising [56.562855317536396]
  We introduce the idea of a cGAN which explicitly leverages structure in the image noise space. By learning directly a low dimensional manifold of the image noise, the generator promotes the removal from the noisy image only that information which spans this manifold. Based on our experiments, our model substantially outperforms existing state-of-the-art architectures.
  arXiv  Detail & Related papers  (2020-02-11T00:31:31Z)
• Deep Learning on Image Denoising: An overview [92.07378559622889]
  We offer a comparative study of deep techniques in image denoising. We first classify the deep convolutional neural networks (CNNs) for additive white noisy images. Next, we compare the state-of-the-art methods on public denoising datasets in terms of quantitative and qualitative analysis.
  arXiv  Detail & Related papers  (2019-12-31T05:03:57Z)
• Variational Denoising Network: Toward Blind Noise Modeling and Removal [59.36166491196973]
  Blind image denoising is an important yet very challenging problem in computer vision. We propose a new variational inference method, which integrates both noise estimation and image denoising.
  arXiv  Detail & Related papers  (2019-08-29T15:54:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.