Dense-Sparse Deep CNN Training for Image Denoising
- URL: http://arxiv.org/abs/2107.04857v1
- Date: Sat, 10 Jul 2021 15:14:19 GMT
- Title: Dense-Sparse Deep CNN Training for Image Denoising
- Authors: Basit O. Alawode, Mudassir Masood, Tarig Ballal, and Tareq Al-Naffouri
- Abstract summary: Deep learning (DL) methods such as convolutional neural networks (CNNs) have gained prominence in the area of image denoising.
Deep denoising CNNs (DnCNNs) use many feedforward convolution layers with added regularization methods of batch normalization and residual learning to improve denoising performance significantly.
However, this comes at the expense of a huge number of trainable parameters.
In this paper, we address this issue by reducing the number of parameters while achieving a comparable level of performance.
- Score: 3.4176234391973512
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Recently, deep learning (DL) methods such as convolutional neural networks
(CNNs) have gained prominence in the area of image denoising. This is owing to
their proven ability to surpass state-of-the-art classical image denoising
algorithms such as BM3D. Deep denoising CNNs (DnCNNs) use many feedforward
convolution layers with added regularization methods of batch normalization and
residual learning to improve denoising performance significantly. However, this
comes at the expense of a huge number of trainable parameters. In this paper,
we address this issue by reducing the number of parameters while achieving a
comparable level of performance. We derive motivation from the improved
performance obtained by training networks using the dense-sparse-dense (DSD)
training approach. We extend this training approach to a reduced DnCNN (RDnCNN)
network resulting in a faster denoising network with significantly reduced
parameters and comparable performance to the DnCNN.
Related papers
- Deep Multi-Threshold Spiking-UNet for Image Processing [51.88730892920031]
This paper introduces the novel concept of Spiking-UNet for image processing, which combines the power of Spiking Neural Networks (SNNs) with the U-Net architecture.
To achieve an efficient Spiking-UNet, we face two primary challenges: ensuring high-fidelity information propagation through the network via spikes and formulating an effective training strategy.
Experimental results show that, on image segmentation and denoising, our Spiking-UNet achieves comparable performance to its non-spiking counterpart.
arXiv Detail & Related papers (2023-07-20T16:00:19Z) - Neural information coding for efficient spike-based image denoising [0.5156484100374058]
In this work we investigate Spiking Neural Networks (SNNs) for Gaussian denoising.
We propose a formal analysis of the information conversion processing carried out by the Leaky Integrate and Fire (LIF) neurons.
We compare its performance with the classical rate-coding mechanism.
Our results show that SNNs with LIF neurons can provide competitive denoising performance but at a reduced computational cost.
arXiv Detail & Related papers (2023-05-15T09:05:32Z) - Multi-stage image denoising with the wavelet transform [125.2251438120701]
Deep convolutional neural networks (CNNs) are used for image denoising via automatically mining accurate structure information.
We propose a multi-stage image denoising CNN with the wavelet transform (MWDCNN) via three stages, i.e., a dynamic convolutional block (DCB), two cascaded wavelet transform and enhancement blocks (WEBs) and residual block (RB)
arXiv Detail & Related papers (2022-09-26T03:28:23Z) - Dynamic Slimmable Denoising Network [64.77565006158895]
Dynamic slimmable denoising network (DDSNet) is a general method to achieve good denoising quality with less computational complexity.
OurNet is empowered with the ability of dynamic inference by a dynamic gate.
Our experiments demonstrate our-Net consistently outperforms the state-of-the-art individually trained static denoising networks.
arXiv Detail & Related papers (2021-10-17T22:45:33Z) - Meta-Optimization of Deep CNN for Image Denoising Using LSTM [0.0]
We investigate the application of the meta-optimization training approach to the DnCNN denoising algorithm to enhance its denoising capability.
Our preliminary experiments on simpler algorithms reveal the prospects of utilizing the meta-optimization training approach towards the enhancement of the DnCNN denoising capability.
arXiv Detail & Related papers (2021-07-14T16:59:44Z) - Learning a Model-Driven Variational Network for Deformable Image
Registration [89.9830129923847]
VR-Net is a novel cascaded variational network for unsupervised deformable image registration.
It outperforms state-of-the-art deep learning methods on registration accuracy.
It maintains the fast inference speed of deep learning and the data-efficiency of variational model.
arXiv Detail & Related papers (2021-05-25T21:37:37Z) - Exploring ensembles and uncertainty minimization in denoising networks [0.522145960878624]
We propose a fusion model consisting of two attention modules, which focus on assigning the proper weights to pixels and channels.
The experimental results show that our model achieves better performance on top of the baseline of regular pre-trained denoising networks.
arXiv Detail & Related papers (2021-01-24T20:48:18Z) - Image Denoising using Attention-Residual Convolutional Neural Networks [0.0]
We propose a new learning-based non-blind denoising technique named Attention Residual Convolutional Neural Network (ARCNN) and its extension to blind denoising named Flexible Attention Residual Convolutional Neural Network (FARCNN)
ARCNN achieved an overall average PSNR results of around 0.44dB and 0.96dB for Gaussian and Poisson denoising, respectively FARCNN presented very consistent results, even with slightly worsen performance compared to ARCNN.
arXiv Detail & Related papers (2021-01-19T16:37:57Z) - Progressive Training of Multi-level Wavelet Residual Networks for Image
Denoising [80.10533234415237]
This paper presents a multi-level wavelet residual network (MWRN) architecture as well as a progressive training scheme to improve image denoising performance.
Experiments on both synthetic and real-world noisy images show that our PT-MWRN performs favorably against the state-of-the-art denoising methods.
arXiv Detail & Related papers (2020-10-23T14:14:00Z) - Unrolling of Deep Graph Total Variation for Image Denoising [106.93258903150702]
In this paper, we combine classical graph signal filtering with deep feature learning into a competitive hybrid design.
We employ interpretable analytical low-pass graph filters and employ 80% fewer network parameters than state-of-the-art DL denoising scheme DnCNN.
arXiv Detail & Related papers (2020-10-21T20:04:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.