Residual Contrastive Learning for Joint Demosaicking and Denoising

• URL: http://arxiv.org/abs/2106.10070v1
• Date: Fri, 18 Jun 2021 11:37:05 GMT
• Title: Residual Contrastive Learning for Joint Demosaicking and Denoising
• Authors: Nanqing Dong, Matteo Maggioni, Yongxin Yang, Eduardo P\'erez-Pellitero, Ales Leonardis, Steven McDonagh
• Abstract summary: We present a novel contrastive learning approach on RAW images, residual contrastive learning (RCL) Our work is built on the assumption that noise contained in each RAW image is signal-dependent. We set a new benchmark for unsupervised JDD tasks with unknown (random) noise variance.
• Score: 49.81596361351967
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The breakthrough of contrastive learning (CL) has fueled the recent success of self-supervised learning (SSL) in high-level vision tasks on RGB images. However, CL is still ill-defined for low-level vision tasks, such as joint demosaicking and denoising (JDD), in the RAW domain. To bridge this methodological gap, we present a novel CL approach on RAW images, residual contrastive learning (RCL), which aims to learn meaningful representations for JDD. Our work is built on the assumption that noise contained in each RAW image is signal-dependent, thus two crops from the same RAW image should have more similar noise distribution than two crops from different RAW images. We use residuals as a discriminative feature and the earth mover's distance to measure the distribution divergence for the contrastive loss. To evaluate the proposed CL strategy, we simulate a series of unsupervised JDD experiments with large-scale data corrupted by synthetic signal-dependent noise, where we set a new benchmark for unsupervised JDD tasks with unknown (random) noise variance. Our empirical study not only validates that CL can be applied on distributions (c.f. features), but also exposes the lack of robustness of previous non-ML and SSL JDD methods when the statistics of the noise are unknown, thus providing some further insight into signal-dependent noise problems.

Related papers

• Zero-Shot Low-dose CT Denoising via Sinogram Flicking [5.101848799297469]
  We propose a zero-shot low-dose CT imaging method based on sinogram flicking. By randomly swapping portions of the conjugate X-rays in the sinogram domain, we generate a large set of sinograms with consistent content but differing noise patterns. We train the network on pairs of sinograms with the same content but different noise distributions using a lightweight model adapted from ZS-NSN.
  arXiv  Detail & Related papers  (2025-04-10T17:42:01Z)
• NCL-CIR: Noise-aware Contrastive Learning for Composed Image Retrieval [16.460121977322224]
  Composed Image Retrieval (CIR) seeks to find a target image using a multi-modal query, which combines an image with modification text to pinpoint the target. pairs are often partially or completely mismatched due to issues like inaccurate modification texts, low-quality target images, and annotation errors. We propose the Noise-aware Contrastive Learning for CIR (NCL-CIR) comprising two key components: the Weight Compensation Block (WCB) and the Noise-pair Filter Block (NFB).
  arXiv  Detail & Related papers  (2025-04-06T03:27:23Z)
• CamoTeacher: Dual-Rotation Consistency Learning for Semi-Supervised Camouflaged Object Detection [58.07124777351955]
  We introduce CamoTeacher, a novel semi-supervised COD framework, utilizing Dual-Rotation Consistency Learning(DRCL) DRCL minimizes pseudo-label noise by leveraging rotation views' consistency in pixel-level and instance-level. Our code will be available soon.
  arXiv  Detail & Related papers  (2024-08-15T09:33:43Z)
• Zero-Shot Image Denoising for High-Resolution Electron Microscopy [28.34992348748098]
  High-resolution electron microscopy (HREM) imaging technique is a powerful tool for directly visualizing a broad range of materials in real-space. It faces challenges in denoising due to ultra-low signal-to-noise ratio (SNR) and scarce data availability. We propose Noise2SR, a zero-shot self-supervised learning (ZS-SSL) denoising framework for HREM.
  arXiv  Detail & Related papers  (2024-06-20T12:40:18Z)
• Random Sub-Samples Generation for Self-Supervised Real Image Denoising [9.459398471988724]
  We propose a novel self-supervised real image denoising framework named Sampling Difference As Perturbation (SDAP) We find that adding an appropriate perturbation to the training images can effectively improve the performance of BSN. The results show that it significantly outperforms other state-of-the-art self-supervised denoising methods on real-world datasets.
  arXiv  Detail & Related papers  (2023-07-31T16:39:35Z)
• Advancing Unsupervised Low-light Image Enhancement: Noise Estimation, Illumination Interpolation, and Self-Regulation [55.07472635587852]
  Low-Light Image Enhancement (LLIE) techniques have made notable advancements in preserving image details and enhancing contrast. These approaches encounter persistent challenges in efficiently mitigating dynamic noise and accommodating diverse low-light scenarios. We first propose a method for estimating the noise level in low light images in a quick and accurate way. We then devise a Learnable Illumination Interpolator (LII) to satisfy general constraints between illumination and input.
  arXiv  Detail & Related papers  (2023-05-17T13:56:48Z)
• I2V: Towards Texture-Aware Self-Supervised Blind Denoising using Self-Residual Learning for Real-World Images [8.763680382529412]
  pixel-shuffle downsampling (PD) has been proposed to eliminate the spatial correlation of noise. We propose self-residual learning without the PD process to maintain texture information. The results of extensive experiments show that the proposed method outperforms state-of-the-art self-supervised blind denoising approaches.
  arXiv  Detail & Related papers  (2023-02-21T08:51:17Z)
• Embedding contrastive unsupervised features to cluster in- and out-of-distribution noise in corrupted image datasets [18.19216557948184]
  Using search engines for web image retrieval is a tempting alternative to manual curation when creating an image dataset. Their main drawback remains the proportion of incorrect (noisy) samples retrieved. We propose a two stage algorithm starting with a detection step where we use unsupervised contrastive feature learning. We find that the alignment and uniformity principles of contrastive learning allow OOD samples to be linearly separated from ID samples on the unit hypersphere.
  arXiv  Detail & Related papers  (2022-07-04T16:51:56Z)
• SAR Despeckling using a Denoising Diffusion Probabilistic Model [52.25981472415249]
  The presence of speckle degrades the image quality and adversely affects the performance of SAR image understanding applications. We introduce SAR-DDPM, a denoising diffusion probabilistic model for SAR despeckling. The proposed method achieves significant improvements in both quantitative and qualitative results over the state-of-the-art despeckling methods.
  arXiv  Detail & Related papers  (2022-06-09T14:00:26Z)
• Poisson2Sparse: Self-Supervised Poisson Denoising From a Single Image [34.27748767631027]
  We present a novel self-supervised learning method for single-image denoising. We approximate traditional iterative optimization algorithms for image denoising with a recurrent neural network. Our method outperforms the state-of-the-art approaches in terms of PSNR and SSIM.
  arXiv  Detail & Related papers  (2022-06-04T00:08:58Z)
• Treatment Learning Causal Transformer for Noisy Image Classification [62.639851972495094]
  In this work, we incorporate this binary information of "existence of noise" as treatment into image classification tasks to improve prediction accuracy. Motivated from causal variational inference, we propose a transformer-based architecture, that uses a latent generative model to estimate robust feature representations for noise image classification. We also create new noisy image datasets incorporating a wide range of noise factors for performance benchmarking.
  arXiv  Detail & Related papers  (2022-03-29T13:07:53Z)
• Residual-driven Fuzzy C-Means Clustering for Image Segmentation [152.609322951917]
  We elaborate on residual-driven Fuzzy C-Means (FCM) for image segmentation. Built on this framework, we present a weighted $ell_2$-norm fidelity term by weighting mixed noise distribution. The results demonstrate the superior effectiveness and efficiency of the proposed algorithm over existing FCM-related algorithms.
  arXiv  Detail & Related papers  (2020-04-15T15:46:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.