ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising

• URL: http://arxiv.org/abs/2102.09858v1
• Date: Fri, 19 Feb 2021 10:54:25 GMT
• Title: ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising
• Authors: Kanggeun Lee and Won-Ki Jeong
• Abstract summary: We propose a novel image denoising scheme, Interdependent Self-Cooperative Learning (ISCL) ISCL combines cyclic adversarial learning with self-supervised residual learning. We demonstrate that ISCL is superior to conventional and current state-of-the-art deep learning-based image denoising methods.
• Score: 3.796436257221662
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: With the advent of advances in self-supervised learning, paired clean-noisy data are no longer required in deep learning-based image denoising. However, existing blind denoising methods still require the assumption with regard to noise characteristics, such as zero-mean noise distribution and pixel-wise noise-signal independence; this hinders wide adaptation of the method in the medical domain. On the other hand, unpaired learning can overcome limitations related to the assumption on noise characteristics, which makes it more feasible for collecting the training data in real-world scenarios. In this paper, we propose a novel image denoising scheme, Interdependent Self-Cooperative Learning (ISCL), that leverages unpaired learning by combining cyclic adversarial learning with self-supervised residual learning. Unlike the existing unpaired image denoising methods relying on matching data distributions in different domains, the two architectures in ISCL, designed for different tasks, complement each other and boost the learning process. To assess the performance of the proposed method, we conducted extensive experiments in various biomedical image degradation scenarios, such as noise caused by physical characteristics of electron microscopy (EM) devices (film and charging noise), and structural noise found in low-dose computer tomography (CT). We demonstrate that the image quality of our method is superior to conventional and current state-of-the-art deep learning-based image denoising methods, including supervised learning.

Related papers

• Neighboring Slice Noise2Noise: Self-Supervised Medical Image Denoising from Single Noisy Image Volume [12.077993066353294]
  We propose a novel self-supervised medical image denoising method, Neighboring Slice Noise2Noise (NS-N2N) NS-N2N only requires a single noisy image volume obtained from one medical imaging procedure to achieve high-quality denoising of the image volume itself.
  arXiv  Detail & Related papers  (2024-11-16T16:24:28Z)
• Self-supervised OCT Image Denoising with Slice-to-Slice Registration and Reconstruction [5.972377737617966]
  Learning-based self-supervised methods for structure-preserving noise reduction have demonstrated superior performance over traditional methods. We introduce a new end-to-end self-supervised learning framework specifically tailored for OCT image denoising.
  arXiv  Detail & Related papers  (2023-11-26T02:45:16Z)
• Masked Image Training for Generalizable Deep Image Denoising [53.03126421917465]
  We present a novel approach to enhance the generalization performance of denoising networks. Our method involves masking random pixels of the input image and reconstructing the missing information during training. Our approach exhibits better generalization ability than other deep learning models and is directly applicable to real-world scenarios.
  arXiv  Detail & Related papers  (2023-03-23T09:33:44Z)
• Noise2Contrast: Multi-Contrast Fusion Enables Self-Supervised Tomographic Image Denoising [6.314790045423454]
  Noise2Contrast combines information from multiple measured image contrasts to train a denoising model. We stack denoising with domain-transfer operators to utilize the independent noise realizations of different image contrasts to derive a self-supervised loss. Our experiments on different real measured data sets indicate that Noise2Contrast generalizes to other multi-contrast imaging modalities.
  arXiv  Detail & Related papers  (2022-12-09T13:03:24Z)
• Robust Deep Ensemble Method for Real-world Image Denoising [62.099271330458066]
  We propose a simple yet effective Bayesian deep ensemble (BDE) method for real-world image denoising. Our BDE achieves +0.28dB PSNR gain over the state-of-the-art denoising method. Our BDE can be extended to other image restoration tasks, and achieves +0.30dB, +0.18dB and +0.12dB PSNR gains on benchmark datasets.
  arXiv  Detail & Related papers  (2022-06-08T06:19:30Z)
• Treatment Learning Causal Transformer for Noisy Image Classification [62.639851972495094]
  In this work, we incorporate this binary information of "existence of noise" as treatment into image classification tasks to improve prediction accuracy. Motivated from causal variational inference, we propose a transformer-based architecture, that uses a latent generative model to estimate robust feature representations for noise image classification. We also create new noisy image datasets incorporating a wide range of noise factors for performance benchmarking.
  arXiv  Detail & Related papers  (2022-03-29T13:07:53Z)
• Deformed2Self: Self-Supervised Denoising for Dynamic Medical Imaging [0.0]
  We propose Deformed2Self, an end-to-end self-supervised deep learning framework for dynamic imaging denoising. It combines single-image and multi-image denoising to improve image quality and use a spatial transformer network to model motion between different slices.
  arXiv  Detail & Related papers  (2021-06-23T05:50:19Z)
• Unpaired Learning of Deep Image Denoising [80.34135728841382]
  This paper presents a two-stage scheme by incorporating self-supervised learning and knowledge distillation. For self-supervised learning, we suggest a dilated blind-spot network (D-BSN) to learn denoising solely from real noisy images. Experiments show that our unpaired learning method performs favorably on both synthetic noisy images and real-world noisy photographs.
  arXiv  Detail & Related papers  (2020-08-31T16:22:40Z)
• Improving Blind Spot Denoising for Microscopy [73.94017852757413]
  We present a novel way to improve the quality of self-supervised denoising. We assume the clean image to be the result of a convolution with a point spread function (PSF) and explicitly include this operation at the end of our neural network.
  arXiv  Detail & Related papers  (2020-08-19T13:06:24Z)
• Self-supervised Denoising via Diffeomorphic Template Estimation: Application to Optical Coherence Tomography [6.197149831796131]
  We propose a joint diffeomorphic template estimation and denoising framework which enables the use of self-supervised denoising for motion deformed repeat acquisitions. Strong qualitative and quantitative improvements are achieved in denoising OCT images, with generic utility in any imaging modality amenable to multiple exposures.
  arXiv  Detail & Related papers  (2020-08-18T16:52:10Z)
• Variational Denoising Network: Toward Blind Noise Modeling and Removal [59.36166491196973]
  Blind image denoising is an important yet very challenging problem in computer vision. We propose a new variational inference method, which integrates both noise estimation and image denoising.
  arXiv  Detail & Related papers  (2019-08-29T15:54:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.