Residual Swin Transformer Channel Attention Network for Image Demosaicing

• URL: http://arxiv.org/abs/2204.07098v1
• Date: Thu, 14 Apr 2022 16:45:17 GMT
• Title: Residual Swin Transformer Channel Attention Network for Image Demosaicing
• Authors: Wenzhu Xing and Karen Egiazarian
• Abstract summary: Deep neural networks have been widely used in image restoration, and in particular, in demosaicing, attaining significant performance improvement. Inspired by the success of SwinIR, we propose in this paper a novel Swin Transformer-based network for image demosaicing, called RSTCANet.
• Score: 3.8073142980733
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Image demosaicing is problem of interpolating full- resolution color images from raw sensor (color filter array) data. During last decade, deep neural networks have been widely used in image restoration, and in particular, in demosaicing, attaining significant performance improvement. In recent years, vision transformers have been designed and successfully used in various computer vision applications. One of the recent methods of image restoration based on a Swin Transformer (ST), SwinIR, demonstrates state-of-the-art performance with a smaller number of parameters than neural network-based methods. Inspired by the success of SwinIR, we propose in this paper a novel Swin Transformer-based network for image demosaicing, called RSTCANet. To extract image features, RSTCANet stacks several residual Swin Transformer Channel Attention blocks (RSTCAB), introducing the channel attention for each two successive ST blocks. Extensive experiments demonstrate that RSTCANet out- performs state-of-the-art image demosaicing methods, and has a smaller number of parameters.

Related papers

• Deep Learning Based Speckle Filtering for Polarimetric SAR Images. Application to Sentinel-1 [51.404644401997736]
  We propose a complete framework to remove speckle in polarimetric SAR images using a convolutional neural network. Experiments show that the proposed approach offers exceptional results in both speckle reduction and resolution preservation.
  arXiv  Detail & Related papers  (2024-08-28T10:07:17Z)
• A Lightweight Sparse Focus Transformer for Remote Sensing Image Change Captioning [11.93705794906543]
  This paper proposes a Sparse Focus Transformer (SFT) for the remote sensing image change captioning (RSICC) task. The proposed SFT network can reduce the parameter number and computational complexity by incorporating a sparse attention mechanism.
  arXiv  Detail & Related papers  (2024-05-10T16:56:53Z)
• SRTransGAN: Image Super-Resolution using Transformer based Generative Adversarial Network [16.243363392717434]
  We propose a transformer-based encoder-decoder network as a generator to generate 2x images and 4x images. The proposed SRTransGAN outperforms the existing methods by 4.38 % on an average of PSNR and SSIM scores.
  arXiv  Detail & Related papers  (2023-12-04T16:22:39Z)
• Lightweight Structure-aware Transformer Network for VHR Remote Sensing Image Change Detection [15.391216316828354]
  This Letter proposes a Lightweight Structure-aware Transformer (LSAT) network for RS image CD. First, a Cross-dimension Interactive Self-attention (CISA) module with linear complexity is designed to replace the vanilla self-attention in visual Transformer. Second, a Structure-aware Enhancement Module (SAEM) is designed to enhance difference features and edge detail information.
  arXiv  Detail & Related papers  (2023-06-03T03:21:18Z)
• Pure Transformer with Integrated Experts for Scene Text Recognition [11.089203218000854]
  Scene text recognition (STR) involves the task of reading text in cropped images of natural scenes. Recent times, the transformer architecture is being widely adopted in STR as it shows strong capability in capturing long-term dependency. This work proposes the use of a transformer-only model as a simple baseline which outperforms hybrid CNN-transformer models.
  arXiv  Detail & Related papers  (2022-11-09T15:26:59Z)
• High-Resolution Swin Transformer for Automatic Medical Image Segmentation [4.783572855609782]
  The resolution of feature maps is critical for medical image segmentation. Most of the existing Transformer-based networks for medical image segmentation are U-Net-like architecture. In this paper, we utilize the network design style from the High-Resolution Network (HRNet) to replace the convolutional layers with Transformer blocks.
  arXiv  Detail & Related papers  (2022-07-23T16:55:37Z)
• An Empirical Study of Remote Sensing Pretraining [117.90699699469639]
  We conduct an empirical study of remote sensing pretraining (RSP) on aerial images. RSP can help deliver distinctive performances in scene recognition tasks. RSP mitigates the data discrepancies of traditional ImageNet pretraining on RS images, but it may still suffer from task discrepancies.
  arXiv  Detail & Related papers  (2022-04-06T13:38:11Z)
• Transformer-based SAR Image Despeckling [53.99620005035804]
  We introduce a transformer-based network for SAR image despeckling. The proposed despeckling network comprises of a transformer-based encoder which allows the network to learn global dependencies between different image regions. Experiments show that the proposed method achieves significant improvements over traditional and convolutional neural network-based despeckling methods.
  arXiv  Detail & Related papers  (2022-01-23T20:09:01Z)
• Restormer: Efficient Transformer for High-Resolution Image Restoration [118.9617735769827]
  convolutional neural networks (CNNs) perform well at learning generalizable image priors from large-scale data. Transformers have shown significant performance gains on natural language and high-level vision tasks. Our model, named Restoration Transformer (Restormer), achieves state-of-the-art results on several image restoration tasks.
  arXiv  Detail & Related papers  (2021-11-18T18:59:10Z)
• SwinIR: Image Restoration Using Swin Transformer [124.8794221439392]
  We propose a strong baseline model SwinIR for image restoration based on the Swin Transformer. SwinIR consists of three parts: shallow feature extraction, deep feature extraction and high-quality image reconstruction. We conduct experiments on three representative tasks: image super-resolution, image denoising and JPEG compression artifact reduction.
  arXiv  Detail & Related papers  (2021-08-23T15:55:32Z)
• Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation [63.46694853953092]
  Swin-Unet is an Unet-like pure Transformer for medical image segmentation. tokenized image patches are fed into the Transformer-based U-shaped decoder-Decoder architecture.
  arXiv  Detail & Related papers  (2021-05-12T09:30:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.