Denoising: A Powerful Building-Block for Imaging, Inverse Problems, and Machine Learning

• URL: http://arxiv.org/abs/2409.06219v3
• Date: Sun, 27 Oct 2024 21:08:19 GMT
• Title: Denoising: A Powerful Building-Block for Imaging, Inverse Problems, and Machine Learning
• Authors: Peyman Milanfar, Mauricio Delbracio,
• Abstract summary: Denoising is the process of reducing random fluctuations in a signal to emphasize essential patterns. Recent denoising techniques, particularly in imaging, have achieved remarkable success. Despite its long history, the community continues to uncover unexpected and groundbreaking uses for denoising.
• Score: 19.222811476224383
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Denoising, the process of reducing random fluctuations in a signal to emphasize essential patterns, has been a fundamental problem of interest since the dawn of modern scientific inquiry. Recent denoising techniques, particularly in imaging, have achieved remarkable success, nearing theoretical limits by some measures. Yet, despite tens of thousands of research papers, the wide-ranging applications of denoising beyond noise removal have not been fully recognized. This is partly due to the vast and diverse literature, making a clear overview challenging. This paper aims to address this gap. We present a clarifying perspective on denoisers, their structure, and desired properties. We emphasize the increasing importance of denoising and showcase its evolution into an essential building block for complex tasks in imaging, inverse problems, and machine learning. Despite its long history, the community continues to uncover unexpected and groundbreaking uses for denoising, further solidifying its place as a cornerstone of scientific and engineering practice.

Related papers

• Harnessing the Power of Noise: A Survey of Techniques and Applications [20.696912127185147]
  Noise, traditionally considered a nuisance in computational systems, is reconsidered for its unexpected and counter-intuitive benefits. We highlight how noise-enhanced training strategies can lead to models that better generalize from noisy data. This work calls for a shift in how we perceive noise, proposing that it can be a spark for innovation and advancement in the information era.
  arXiv  Detail & Related papers  (2024-10-08T20:37:13Z)
• The Devil is in the Upsampling: Architectural Decisions Made Simpler for Denoising with Deep Image Prior [20.1435183909115]
  Deep Image Prior (DIP) shows that some network architectures naturally bias towards smooth images and resist noises. Although DIP has removed the requirement of large training sets, it still presents two practical challenges for denoising: architectural design and noise-fitting. In this study, we analyze from a frequency perspective to demonstrate that the unlearnt upsampling is the main driving force behind the denoising phenomenon in DIP.
  arXiv  Detail & Related papers  (2023-04-22T13:50:27Z)
• Masked Image Training for Generalizable Deep Image Denoising [53.03126421917465]
  We present a novel approach to enhance the generalization performance of denoising networks. Our method involves masking random pixels of the input image and reconstructing the missing information during training. Our approach exhibits better generalization ability than other deep learning models and is directly applicable to real-world scenarios.
  arXiv  Detail & Related papers  (2023-03-23T09:33:44Z)
• Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper -- [19.648352957466983]
  Image denoising is one of the oldest and most studied problems in image processing. The penetration of deep learning into image processing brought a revolution to image denoising. Recent transitions in the field of image denoising go far beyond the ability to design better denoisers.
  arXiv  Detail & Related papers  (2023-01-09T14:16:40Z)
• Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesis [148.16279746287452]
  We propose a swin-conv block to incorporate the local modeling ability of residual convolutional layer and non-local modeling ability of swin transformer block. For the training data synthesis, we design a practical noise degradation model which takes into consideration different kinds of noise. Experiments on AGWN removal and real image denoising demonstrate that the new network architecture design achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2022-03-24T18:11:31Z)
• Physics-based Noise Modeling for Extreme Low-light Photography [63.65570751728917]
  We study the noise statistics in the imaging pipeline of CMOS photosensors. We formulate a comprehensive noise model that can accurately characterize the real noise structures. Our noise model can be used to synthesize realistic training data for learning-based low-light denoising algorithms.
  arXiv  Detail & Related papers  (2021-08-04T16:36:29Z)
• Enhancing and Learning Denoiser without Clean Reference [23.11994688706024]
  We propose a novel deep image-denoising method by regarding the noise reduction task as a special case of the noise transference task. The results on real-world denoising benchmarks demonstrate that our proposed method achieves promising performance on removing realistic noises.
  arXiv  Detail & Related papers  (2020-09-09T13:15:31Z)
• Improving Blind Spot Denoising for Microscopy [73.94017852757413]
  We present a novel way to improve the quality of self-supervised denoising. We assume the clean image to be the result of a convolution with a point spread function (PSF) and explicitly include this operation at the end of our neural network.
  arXiv  Detail & Related papers  (2020-08-19T13:06:24Z)
• NoiseBreaker: Gradual Image Denoising Guided by Noise Analysis [5.645552640953684]
  This paper proposes a gradual denoising strategy that iteratively detects the dominating noise in an image, and removes it using a tailored denoiser. The method provides an insight on the nature of the encountered noise, and it makes it possible to extend an existing denoiser with new noise nature.
  arXiv  Detail & Related papers  (2020-02-18T11:09:03Z)
• Reconstructing the Noise Manifold for Image Denoising [56.562855317536396]
  We introduce the idea of a cGAN which explicitly leverages structure in the image noise space. By learning directly a low dimensional manifold of the image noise, the generator promotes the removal from the noisy image only that information which spans this manifold. Based on our experiments, our model substantially outperforms existing state-of-the-art architectures.
  arXiv  Detail & Related papers  (2020-02-11T00:31:31Z)
• Deep Learning on Image Denoising: An overview [92.07378559622889]
  We offer a comparative study of deep techniques in image denoising. We first classify the deep convolutional neural networks (CNNs) for additive white noisy images. Next, we compare the state-of-the-art methods on public denoising datasets in terms of quantitative and qualitative analysis.
  arXiv  Detail & Related papers  (2019-12-31T05:03:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.