Thunder: Thumbnail based Fast Lightweight Image Denoising Network

• URL: http://arxiv.org/abs/2205.11823v1
• Date: Tue, 24 May 2022 06:38:46 GMT
• Title: Thunder: Thumbnail based Fast Lightweight Image Denoising Network
• Authors: Yifeng Zhou and Xing Xu and Shuaicheng Liu and Guoqing Wang and Huimin Lu and Heng Tao Shen
• Abstract summary: A textbfThumbtextbfnail based textbfDtextbfenoising Netwotextbfrk dubbed Thunder is proposed.
• Score: 92.9631117239565
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: To achieve promising results on removing noise from real-world images, most of existing denoising networks are formulated with complex network structure, making them impractical for deployment. Some attempts focused on reducing the number of filters and feature channels but suffered from large performance loss, and a more practical and lightweight denoising network with fast inference speed is of high demand. To this end, a \textbf{Thu}mb\textbf{n}ail based \textbf{D}\textbf{e}noising Netwo\textbf{r}k dubbed Thunder, is proposed and implemented as a lightweight structure for fast restoration without comprising the denoising capabilities. Specifically, the Thunder model contains two newly-established modules: (1) a wavelet-based Thumbnail Subspace Encoder (TSE) which can leverage sub-bands correlation to provide an approximate thumbnail based on the low-frequent feature; (2) a Subspace Projection based Refine Module (SPR) which can restore the details for thumbnail progressively based on the subspace projection approach. Extensive experiments have been carried out on two real-world denoising benchmarks, demonstrating that the proposed Thunder outperforms the existing lightweight models and achieves competitive performance on PSNR and SSIM when compared with the complex designs.

Related papers

• Zero-Shot Image Denoising for High-Resolution Electron Microscopy [28.34992348748098]
  High-resolution electron microscopy (HREM) imaging technique is a powerful tool for directly visualizing a broad range of materials in real-space. It faces challenges in denoising due to ultra-low signal-to-noise ratio (SNR) and scarce data availability. We propose Noise2SR, a zero-shot self-supervised learning (ZS-SSL) denoising framework for HREM.
  arXiv  Detail & Related papers  (2024-06-20T12:40:18Z)
• Two-stage Progressive Residual Dense Attention Network for Image Denoising [0.680228754562676]
  Many deep CNN-based denoising models equally utilize the hierarchical features of noisy images without paying attention to the more important and useful features, leading to relatively low performance. We design a new Two-stage Progressive Residual Attention Network (TSP-RDANet) for image denoising, which divides the whole process of denoising into two sub-tasks to remove noise progressively. Two different attention mechanism-based denoising networks are designed for the two sequential sub-tasks.
  arXiv  Detail & Related papers  (2024-01-05T14:31:20Z)
• LDM-ISP: Enhancing Neural ISP for Low Light with Latent Diffusion Models [54.93010869546011]
  We propose to leverage the pre-trained latent diffusion model to perform the neural ISP for enhancing extremely low-light images. Specifically, to tailor the pre-trained latent diffusion model to operate on the RAW domain, we train a set of lightweight taming modules. We observe different roles of UNet denoising and decoder reconstruction in the latent diffusion model, which inspires us to decompose the low-light image enhancement task into latent-space low-frequency content generation and decoding-phase high-frequency detail maintenance.
  arXiv  Detail & Related papers  (2023-12-02T04:31:51Z)
• Advancing Unsupervised Low-light Image Enhancement: Noise Estimation, Illumination Interpolation, and Self-Regulation [55.07472635587852]
  Low-Light Image Enhancement (LLIE) techniques have made notable advancements in preserving image details and enhancing contrast. These approaches encounter persistent challenges in efficiently mitigating dynamic noise and accommodating diverse low-light scenarios. We first propose a method for estimating the noise level in low light images in a quick and accurate way. We then devise a Learnable Illumination Interpolator (LII) to satisfy general constraints between illumination and input.
  arXiv  Detail & Related papers  (2023-05-17T13:56:48Z)
• Image Blind Denoising Using Dual Convolutional Neural Network with Skip Connection [2.9689285167236603]
  We propose a novel dual convolutional blind denoising network with skip connection (DCBDNet) The proposed DCBDNet consists of a noise estimation network and a dual convolutional neural network (CNN)
  arXiv  Detail & Related papers  (2023-04-04T08:21:46Z)
• Zero-shot Blind Image Denoising via Implicit Neural Representations [77.79032012459243]
  We propose an alternative denoising strategy that leverages the architectural inductive bias of implicit neural representations (INRs) We show that our method outperforms existing zero-shot denoising methods under an extensive set of low-noise or real-noise scenarios.
  arXiv  Detail & Related papers  (2022-04-05T12:46:36Z)
• Noise2Recon: A Semi-Supervised Framework for Joint MRI Reconstruction and Denoising [7.121980163238901]
  We propose a semi-supervised, consistency-based framework (termed Noise2Recon) for joint MR reconstruction and denoising. Our method enables the usage of a limited number of fully-sampled and a large number of undersampled-only scans. Results demonstrate that even with minimal ground-truth data, Noise2Recon (1) achieves high performance on in-distribution (low-noise) scans and (2) improves generalizability to OOD, noisy scans.
  arXiv  Detail & Related papers  (2021-09-30T20:06:43Z)
• Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images [98.82804259905478]
  We present Neighbor2Neighbor to train an effective image denoising model with only noisy images. In detail, input and target used to train a network are images sub-sampled from the same noisy image. A denoising network is trained on sub-sampled training pairs generated in the first stage, with a proposed regularizer as additional loss for better performance.
  arXiv  Detail & Related papers  (2021-01-08T02:03:25Z)
• Designing and Training of A Dual CNN for Image Denoising [117.54244339673316]
  We propose a Dual denoising Network (DudeNet) to recover a clean image. DudeNet consists of four modules: a feature extraction block, an enhancement block, a compression block, and a reconstruction block.
  arXiv  Detail & Related papers  (2020-07-08T08:16:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.