A cross Transformer for image denoising

• URL: http://arxiv.org/abs/2310.10408v1
• Date: Mon, 16 Oct 2023 13:53:19 GMT
• Title: A cross Transformer for image denoising
• Authors: Chunwei Tian, Menghua Zheng, Wangmeng Zuo, Shichao Zhang, Yanning Zhang and Chia-Wen Ling
• Abstract summary: We propose a cross Transformer denoising CNN (CTNet) with a serial block (SB), a parallel block (PB), and a residual block (RB) CTNet is superior to some popular denoising methods in terms of real and synthetic image denoising.
• Score: 83.68175077524111
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep convolutional neural networks (CNNs) depend on feedforward and feedback ways to obtain good performance in image denoising. However, how to obtain effective structural information via CNNs to efficiently represent given noisy images is key for complex scenes. In this paper, we propose a cross Transformer denoising CNN (CTNet) with a serial block (SB), a parallel block (PB), and a residual block (RB) to obtain clean images for complex scenes. A SB uses an enhanced residual architecture to deeply search structural information for image denoising. To avoid loss of key information, PB uses three heterogeneous networks to implement multiple interactions of multi-level features to broadly search for extra information for improving the adaptability of an obtained denoiser for complex scenes. Also, to improve denoising performance, Transformer mechanisms are embedded into the SB and PB to extract complementary salient features for effectively removing noise in terms of pixel relations. Finally, a RB is applied to acquire clean images. Experiments illustrate that our CTNet is superior to some popular denoising methods in terms of real and synthetic image denoising. It is suitable to mobile digital devices, i.e., phones. Codes can be obtained at https://github.com/hellloxiaotian/CTNet.

Related papers

• Heterogeneous window transformer for image denoising [59.953076646860985]
  We propose a heterogeneous window transformer (HWformer) for image denoising. The proposed HWformer only takes 30% of popular Restormer in terms of denoising time.
  arXiv  Detail & Related papers  (2024-07-08T08:10:16Z)
• Multi-stage image denoising with the wavelet transform [125.2251438120701]
  Deep convolutional neural networks (CNNs) are used for image denoising via automatically mining accurate structure information. We propose a multi-stage image denoising CNN with the wavelet transform (MWDCNN) via three stages, i.e., a dynamic convolutional block (DCB), two cascaded wavelet transform and enhancement blocks (WEBs) and residual block (RB)
  arXiv  Detail & Related papers  (2022-09-26T03:28:23Z)
• Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesis [148.16279746287452]
  We propose a swin-conv block to incorporate the local modeling ability of residual convolutional layer and non-local modeling ability of swin transformer block. For the training data synthesis, we design a practical noise degradation model which takes into consideration different kinds of noise. Experiments on AGWN removal and real image denoising demonstrate that the new network architecture design achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2022-03-24T18:11:31Z)
• LINN: Lifting Inspired Invertible Neural Network for Image Denoising [41.188745735682744]
  We propose an invertible neural network for image denoising (DnINN) inspired by the transform-based denoising framework. The proposed DnINN consists of an invertible neural network called LINN whose architecture is inspired by the lifting scheme in wavelet theory. The proposed DnINN method achieves results comparable to the DnCNN method while only requiring 1/4 of learnable parameters.
  arXiv  Detail & Related papers  (2021-05-07T14:52:48Z)
• Synergy Between Semantic Segmentation and Image Denoising via Alternate Boosting [102.19116213923614]
  We propose a boosting network to perform denoising and segmentation alternately. We observe that not only denoising helps combat the drop of segmentation accuracy due to noise, but also pixel-wise semantic information boosts the capability of denoising. Experimental results show that the denoised image quality is improved substantially and the segmentation accuracy is improved to close to that of clean images.
  arXiv  Detail & Related papers  (2021-02-24T06:48:45Z)
• Image Denoising for Strong Gaussian Noises With Specialized CNNs for Different Frequency Components [4.010371060637209]
  In machine learning approach to image denoising a network is trained to recover a clean image from a noisy one. In this paper a novel structure is proposed based on training multiple specialized networks.
  arXiv  Detail & Related papers  (2020-11-26T23:20:25Z)
• Designing and Training of A Dual CNN for Image Denoising [117.54244339673316]
  We propose a Dual denoising Network (DudeNet) to recover a clean image. DudeNet consists of four modules: a feature extraction block, an enhancement block, a compression block, and a reconstruction block.
  arXiv  Detail & Related papers  (2020-07-08T08:16:24Z)
• Spatial-Adaptive Network for Single Image Denoising [14.643663950015334]
  We propose a novel spatial-adaptive denoising network (SADNet) for efficient single image blind noise removal. Our method can surpass the state-of-the-art denoising methods both quantitatively and visually.
  arXiv  Detail & Related papers  (2020-01-28T12:24:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.