Efficient Deep Image Denoising via Class Specific Convolution

• URL: http://arxiv.org/abs/2103.01624v1
• Date: Tue, 2 Mar 2021 10:28:15 GMT
• Title: Efficient Deep Image Denoising via Class Specific Convolution
• Authors: Lu Xu, Jiawei Zhang, Xuanye Cheng, Feng Zhang, Xing Wei, Jimmy Ren
• Abstract summary: We propose an efficient deep neural network for image denoising based on pixel-wise classification. The proposed method can reduce the computational costs without sacrificing the performance.
• Score: 24.103826414190216
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Deep neural networks have been widely used in image denoising during the past few years. Even though they achieve great success on this problem, they are computationally inefficient which makes them inappropriate to be implemented in mobile devices. In this paper, we propose an efficient deep neural network for image denoising based on pixel-wise classification. Despite using a computationally efficient network cannot effectively remove the noises from any content, it is still capable to denoise from a specific type of pattern or texture. The proposed method follows such a divide and conquer scheme. We first use an efficient U-net to pixel-wisely classify pixels in the noisy image based on the local gradient statistics. Then we replace part of the convolution layers in existing denoising networks by the proposed Class Specific Convolution layers (CSConv) which use different weights for different classes of pixels. Quantitative and qualitative evaluations on public datasets demonstrate that the proposed method can reduce the computational costs without sacrificing the performance compared to state-of-the-art algorithms.

Related papers

• Multi-stage image denoising with the wavelet transform [125.2251438120701]
  Deep convolutional neural networks (CNNs) are used for image denoising via automatically mining accurate structure information. We propose a multi-stage image denoising CNN with the wavelet transform (MWDCNN) via three stages, i.e., a dynamic convolutional block (DCB), two cascaded wavelet transform and enhancement blocks (WEBs) and residual block (RB)
  arXiv  Detail & Related papers  (2022-09-26T03:28:23Z)
• NBD-GAP: Non-Blind Image Deblurring Without Clean Target Images [79.33220095067749]
  Large amounts of blurry-clean image pairs are required for training to achieve good performance. Deep networks often fail to perform well when the blurry images and the blur kernels during testing are very different from the ones used during training.
  arXiv  Detail & Related papers  (2022-09-20T06:21:11Z)
• Considering Image Information and Self-similarity: A Compositional Denoising Network [0.0]
  This paper proposes a compositional denoising network (CDN), whose image information path (IIP) and noise estimation path (NEP) will solve the two problems. Experiments show that CDN achieves state-of-the-art results in synthetic and real-world image denoising.
  arXiv  Detail & Related papers  (2022-09-14T05:05:08Z)
• Details Preserving Deep Collaborative Filtering-Based Method for Image Denoising [3.4176234391973512]
  We propose a deep collaborative filtering-based (Deep-CoFiB) algorithm for image denoising. This algorithm performs collaborative denoising of image patches in the sparse domain using a set of optimized neural network models. Extensive experiments show that the DeepCoFiB performed quantitatively (in terms of PSNR and SSIM) better than many of the state-of-the-art denoising algorithms.
  arXiv  Detail & Related papers  (2021-07-11T19:02:36Z)
• Dense-Sparse Deep Convolutional Neural Networks Training for Image Denoising [0.6215404942415159]
  Deep learning methods such as the convolutional neural networks have gained prominence in the area of image denoising. Deep denoising convolutional neural networks use many feed-forward convolution layers with added regularization methods of batch normalization and residual learning to speed up training and improve denoising performance significantly. In this paper, we show that by employing an enhanced dense-sparse-dense network training procedure to the deep denoising convolutional neural networks, comparable denoising performance level can be achieved at a significantly reduced number of trainable parameters.
  arXiv  Detail & Related papers  (2021-07-10T15:14:19Z)
• Content-Aware Convolutional Neural Networks [98.97634685964819]
  Convolutional Neural Networks (CNNs) have achieved great success due to the powerful feature learning ability of convolution layers. We propose a Content-aware Convolution (CAC) that automatically detects the smooth windows and applies a 1x1 convolutional kernel to replace the original large kernel.
  arXiv  Detail & Related papers  (2021-06-30T03:54:35Z)
• Learning Spatial and Spatio-Temporal Pixel Aggregations for Image and Video Denoising [104.59305271099967]
  We present a pixel aggregation network and learn the pixel sampling and averaging strategies for image denoising. We develop a pixel aggregation network for video denoising to sample pixels across the spatial-temporal space. Our method is able to solve the misalignment issues caused by large motion in dynamic scenes.
  arXiv  Detail & Related papers  (2021-01-26T13:00:46Z)
• Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images [98.82804259905478]
  We present Neighbor2Neighbor to train an effective image denoising model with only noisy images. In detail, input and target used to train a network are images sub-sampled from the same noisy image. A denoising network is trained on sub-sampled training pairs generated in the first stage, with a proposed regularizer as additional loss for better performance.
  arXiv  Detail & Related papers  (2021-01-08T02:03:25Z)
• Efficient Blind-Spot Neural Network Architecture for Image Denoising [4.513547390985147]
  We propose a novel fully convolutional network architecture that uses dilations to achieve the blind-spot property. Our network achieves the performance over the prior work and state-of-the-art results on established datasets.
  arXiv  Detail & Related papers  (2020-08-25T13:48:40Z)
• Neural Sparse Representation for Image Restoration [116.72107034624344]
  Inspired by the robustness and efficiency of sparse coding based image restoration models, we investigate the sparsity of neurons in deep networks. Our method structurally enforces sparsity constraints upon hidden neurons. Experiments show that sparse representation is crucial in deep neural networks for multiple image restoration tasks.
  arXiv  Detail & Related papers  (2020-06-08T05:15:17Z)
• Spatial-Adaptive Network for Single Image Denoising [14.643663950015334]
  We propose a novel spatial-adaptive denoising network (SADNet) for efficient single image blind noise removal. Our method can surpass the state-of-the-art denoising methods both quantitatively and visually.
  arXiv  Detail & Related papers  (2020-01-28T12:24:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.