CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image Denoising by Disentangling Noise from Image

• URL: http://arxiv.org/abs/2203.13009v2
• Date: Mon, 28 Mar 2022 12:01:09 GMT
• Title: CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image Denoising by Disentangling Noise from Image
• Authors: Reyhaneh Neshatavar, Mohsen Yavartanoo, Sanghyun Son, Kyoung Mu Lee
• Abstract summary: We propose a novel and powerful self-supervised denoising method called CVF-SID. CVF-SID can disentangle a clean image and noise maps from the input by leveraging various self-supervised loss terms. It achieves state-of-the-art self-supervised image denoising performance and is comparable to other existing approaches.
• Score: 53.76319163746699
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recently, significant progress has been made on image denoising with strong supervision from large-scale datasets. However, obtaining well-aligned noisy-clean training image pairs for each specific scenario is complicated and costly in practice. Consequently, applying a conventional supervised denoising network on in-the-wild noisy inputs is not straightforward. Although several studies have challenged this problem without strong supervision, they rely on less practical assumptions and cannot be applied to practical situations directly. To address the aforementioned challenges, we propose a novel and powerful self-supervised denoising method called CVF-SID based on a Cyclic multi-Variate Function (CVF) module and a self-supervised image disentangling (SID) framework. The CVF module can output multiple decomposed variables of the input and take a combination of the outputs back as an input in a cyclic manner. Our CVF-SID can disentangle a clean image and noise maps from the input by leveraging various self-supervised loss terms. Unlike several methods that only consider the signal-independent noise models, we also deal with signal-dependent noise components for real-world applications. Furthermore, we do not rely on any prior assumptions about the underlying noise distribution, making CVF-SID more generalizable toward realistic noise. Extensive experiments on real-world datasets show that CVF-SID achieves state-of-the-art self-supervised image denoising performance and is comparable to other existing approaches. The code is publicly available from https://github.com/Reyhanehne/CVF-SID_PyTorch .

Related papers

• PUCA: Patch-Unshuffle and Channel Attention for Enhanced Self-Supervised Image Denoising [35.641029222760025]
  We propose PUCA, a novel J-invariant U-Net architecture, for self-supervised denoising. PUCA achieves state-of-the-art performance, outperforming existing methods in self-supervised image denoising.
  arXiv  Detail & Related papers  (2023-10-16T05:42:49Z)
• Unsupervised Denoising for Signal-Dependent and Row-Correlated Imaging Noise [54.0185721303932]
  We present the first fully unsupervised deep learning-based denoiser capable of handling imaging noise that is row-correlated. Our approach uses a Variational Autoencoder with a specially designed autoregressive decoder. Our method does not require a pre-trained noise model and can be trained from scratch using unpaired noisy data.
  arXiv  Detail & Related papers  (2023-10-11T20:48:20Z)
• I2V: Towards Texture-Aware Self-Supervised Blind Denoising using Self-Residual Learning for Real-World Images [8.763680382529412]
  pixel-shuffle downsampling (PD) has been proposed to eliminate the spatial correlation of noise. We propose self-residual learning without the PD process to maintain texture information. The results of extensive experiments show that the proposed method outperforms state-of-the-art self-supervised blind denoising approaches.
  arXiv  Detail & Related papers  (2023-02-21T08:51:17Z)
• Representing Noisy Image Without Denoising [91.73819173191076]
  Fractional-order Moments in Radon space (FMR) is designed to derive robust representation directly from noisy images. Unlike earlier integer-order methods, our work is a more generic design taking such classical methods as special cases.
  arXiv  Detail & Related papers  (2023-01-18T10:13:29Z)
• DINF: Dynamic Instance Noise Filter for Occluded Pedestrian Detection [0.0]
  RCNN-based pedestrian detectors use rectangle regions to extract instance features. The number of severely overlapping objects and the number of slightly overlapping objects are unbalanced. An iterable dynamic instance noise filter (DINF) is proposed for the RCNN-based pedestrian detectors to improve the signal-noise ratio of the instance feature.
  arXiv  Detail & Related papers  (2023-01-13T14:12:36Z)
• Flexible Image Denoising with Multi-layer Conditional Feature Modulation [56.018132592622706]
  We present a novel flexible image enoising network (CFMNet) by equipping an U-Net backbone with conditional feature modulation (CFM) modules. In comparison to channel-wise shifting only in the first layer, CFMNet can make better use of noise level information by deploying multiple layers of CFM. Our CFMNet is effective in exploiting noise level information for flexible non-blind denoising, and performs favorably against the existing deep image denoising methods in terms of both quantitative metrics and visual quality.
  arXiv  Detail & Related papers  (2020-06-24T06:00:00Z)
• Fully Unsupervised Diversity Denoising with Convolutional Variational Autoencoders [81.30960319178725]
  We propose DivNoising, a denoising approach based on fully convolutional variational autoencoders (VAEs) First we introduce a principled way of formulating the unsupervised denoising problem within the VAE framework by explicitly incorporating imaging noise models into the decoder. We show that such a noise model can either be measured, bootstrapped from noisy data, or co-learned during training.
  arXiv  Detail & Related papers  (2020-06-10T21:28:13Z)
• Variational Denoising Network: Toward Blind Noise Modeling and Removal [59.36166491196973]
  Blind image denoising is an important yet very challenging problem in computer vision. We propose a new variational inference method, which integrates both noise estimation and image denoising.
  arXiv  Detail & Related papers  (2019-08-29T15:54:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.