Unleashing the Power of Self-Supervised Image Denoising: A Comprehensive Review

• URL: http://arxiv.org/abs/2308.00247v4
• Date: Mon, 25 Mar 2024 08:34:15 GMT
• Title: Unleashing the Power of Self-Supervised Image Denoising: A Comprehensive Review
• Authors: Dan Zhang, Fangfang Zhou, Felix Albu, Yuanzhou Wei, Xiao Yang, Yuan Gu, Qiang Li,
• Abstract summary: The advent of deep learning has brought a revolutionary transformation to image denoising techniques. The persistent challenge of acquiring noise-clean pairs for supervised methods in real-world scenarios remains formidable. This paper focuses on self-supervised image denoising methods that offer effective solutions.
• Score: 7.387921606240273
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The advent of deep learning has brought a revolutionary transformation to image denoising techniques. However, the persistent challenge of acquiring noise-clean pairs for supervised methods in real-world scenarios remains formidable, necessitating the exploration of more practical self-supervised image denoising. This paper focuses on self-supervised image denoising methods that offer effective solutions to address this challenge. Our comprehensive review thoroughly analyzes the latest advancements in self-supervised image denoising approaches, categorizing them into three distinct classes: General methods, Blind Spot Network (BSN)-based methods, and Transformer-based methods. For each class, we provide a concise theoretical analysis along with their practical applications. To assess the effectiveness of these methods, we present both quantitative and qualitative experimental results on various datasets, utilizing classical algorithms as benchmarks. Additionally, we critically discuss the current limitations of these methods and propose promising directions for future research. By offering a detailed overview of recent developments in self-supervised image denoising, this review serves as an invaluable resource for researchers and practitioners in the field, facilitating a deeper understanding of this emerging domain and inspiring further advancements.

Related papers

• Evaluating BM3D and NBNet: A Comprehensive Study of Image Denoising Across Multiple Datasets [10.15569443251672]
  This paper investigates image denoising, comparing traditional non-learning-based techniques, represented by Block-Matching 3D, with modern learning-based methods, exemplified by NBNet. We assess these approaches across diverse datasets, including CURE-OR, CURE-TSR, Set-12, and Chest-Xray. We find that while BM3D excels in scenarios like blur challenges, NBNet is more effective in complex noise environments such as under-exposure and over-exposure.
  arXiv  Detail & Related papers  (2024-08-11T04:54:52Z)
• Low-Trace Adaptation of Zero-shot Self-supervised Blind Image Denoising [23.758547513866766]
  We propose a trace-constraint loss function and low-trace adaptation Noise2Noise (LoTA-N2N) model to bridge the gap between self-supervised and supervised learning. Our method achieves state-of-the-art performance within the realm of zero-shot self-supervised image denoising approaches.
  arXiv  Detail & Related papers  (2024-03-19T02:47:33Z)
• On normalization-equivariance properties of supervised and unsupervised denoising methods: a survey [4.24243593213882]
  We propose a survey of guided tour of supervised and unsupervised learning methods for image denoising. We give insights on the rationales and limitations of the most performant methods in the literature. It is of paramount importance that intensity shifting or scaling applied to the input image results in a corresponding change in the denoiser output.
  arXiv  Detail & Related papers  (2024-02-23T14:39:12Z)
• Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imaging [6.202226277935329]
  We review theoretically principled unsupervised learning schemes for solving imaging inverse problems. We focus on methods rooted in optimal transport and convex analysis. We give an overview of a recent line of works on provably convergent learned optimization algorithms.
  arXiv  Detail & Related papers  (2023-11-15T14:04:37Z)
• Diffusion-based Visual Counterfactual Explanations -- Towards Systematic Quantitative Evaluation [64.0476282000118]
  Latest methods for visual counterfactual explanations (VCE) harness the power of deep generative models to synthesize new examples of high-dimensional images of impressive quality. It is currently difficult to compare the performance of these VCE methods as the evaluation procedures largely vary and often boil down to visual inspection of individual examples and small scale user studies. We propose a framework for systematic, quantitative evaluation of the VCE methods and a minimal set of metrics to be used.
  arXiv  Detail & Related papers  (2023-08-11T12:22:37Z)
• Self2Self+: Single-Image Denoising with Self-Supervised Learning and Image Quality Assessment Loss [4.035753155957699]
  The proposed method achieves state-of-the-art denoising performance on both synthetic and real-world datasets. This highlights the effectiveness and practicality of our method as a potential solution for various noise removal tasks.
  arXiv  Detail & Related papers  (2023-07-20T08:38:01Z)
• Masked Image Training for Generalizable Deep Image Denoising [53.03126421917465]
  We present a novel approach to enhance the generalization performance of denoising networks. Our method involves masking random pixels of the input image and reconstructing the missing information during training. Our approach exhibits better generalization ability than other deep learning models and is directly applicable to real-world scenarios.
  arXiv  Detail & Related papers  (2023-03-23T09:33:44Z)
• Towards Better Understanding Attribution Methods [77.1487219861185]
  Post-hoc attribution methods have been proposed to identify image regions most influential to the models' decisions. We propose three novel evaluation schemes to more reliably measure the faithfulness of those methods. We also propose a post-processing smoothing step that significantly improves the performance of some attribution methods.
  arXiv  Detail & Related papers  (2022-05-20T20:50:17Z)
• Improving Blind Spot Denoising for Microscopy [73.94017852757413]
  We present a novel way to improve the quality of self-supervised denoising. We assume the clean image to be the result of a convolution with a point spread function (PSF) and explicitly include this operation at the end of our neural network.
  arXiv  Detail & Related papers  (2020-08-19T13:06:24Z)
• Depth image denoising using nuclear norm and learning graph model [107.51199787840066]
  Group-based image restoration methods are more effective in gathering the similarity among patches. For each patch, we find and group the most similar patches within a searching window. The proposed method is superior to other current state-of-the-art denoising methods in both subjective and objective criterion.
  arXiv  Detail & Related papers  (2020-08-09T15:12:16Z)
• Fully Unsupervised Diversity Denoising with Convolutional Variational Autoencoders [81.30960319178725]
  We propose DivNoising, a denoising approach based on fully convolutional variational autoencoders (VAEs) First we introduce a principled way of formulating the unsupervised denoising problem within the VAE framework by explicitly incorporating imaging noise models into the decoder. We show that such a noise model can either be measured, bootstrapped from noisy data, or co-learned during training.
  arXiv  Detail & Related papers  (2020-06-10T21:28:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.