Parameter-Free Channel Attention for Image Classification and Super-Resolution

• URL: http://arxiv.org/abs/2303.11055v1
• Date: Mon, 20 Mar 2023 12:08:58 GMT
• Title: Parameter-Free Channel Attention for Image Classification and Super-Resolution
• Authors: Yuxuan Shi, Lingxiao Yang, Wangpeng An, Xiantong Zhen, Liuqing Wang
• Abstract summary: The channel attention mechanism is a useful technique widely employed in deep convolutional neural networks to boost the performance for image processing tasks. We propose a. ‘Free Channel Attention (PFCA) module to boost the performance of popular image classification and image super-resolution networks. Experiments on CIFAR-100, ImageNet, and DIV2K validate that our PFCA module improves the performance of ResNet on image classification and improves the performance of MSRResNet on image super-resolution tasks.
• Score: 31.428547682263947
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The channel attention mechanism is a useful technique widely employed in deep convolutional neural networks to boost the performance for image processing tasks, eg, image classification and image super-resolution. It is usually designed as a parameterized sub-network and embedded into the convolutional layers of the network to learn more powerful feature representations. However, current channel attention induces more parameters and therefore leads to higher computational costs. To deal with this issue, in this work, we propose a Parameter-Free Channel Attention (PFCA) module to boost the performance of popular image classification and image super-resolution networks, but completely sweep out the parameter growth of channel attention. Experiments on CIFAR-100, ImageNet, and DIV2K validate that our PFCA module improves the performance of ResNet on image classification and improves the performance of MSRResNet on image super-resolution tasks, respectively, while bringing little growth of parameters and FLOPs.

Related papers

• DGNet: Dynamic Gradient-Guided Network for Water-Related Optics Image Enhancement [77.0360085530701]
  Underwater image enhancement (UIE) is a challenging task due to the complex degradation caused by underwater environments. Previous methods often idealize the degradation process, and neglect the impact of medium noise and object motion on the distribution of image features. Our approach utilizes predicted images to dynamically update pseudo-labels, adding a dynamic gradient to optimize the network's gradient space.
  arXiv  Detail & Related papers  (2023-12-12T06:07:21Z)
• Swift Parameter-free Attention Network for Efficient Super-Resolution [8.365929625909509]
  Single Image Super-Resolution is a crucial task in low-level computer vision. We propose the Swift. parameter-free Attention Network (SPAN), which balances parameter count, inference speed, and image quality. We evaluate SPAN on multiple benchmarks, showing that it outperforms existing efficient super-resolution models in terms of both image quality and inference speed.
  arXiv  Detail & Related papers  (2023-11-21T18:30:40Z)
• Spatially-Adaptive Feature Modulation for Efficient Image Super-Resolution [90.16462805389943]
  We develop a spatially-adaptive feature modulation (SAFM) mechanism upon a vision transformer (ViT)-like block. Proposed method is $3times$ smaller than state-of-the-art efficient SR methods.
  arXiv  Detail & Related papers  (2023-02-27T14:19:31Z)
• Efficient Image Super-Resolution using Vast-Receptive-Field Attention [49.87316814164699]
  The attention mechanism plays a pivotal role in designing advanced super-resolution (SR) networks. In this work, we design an efficient SR network by improving the attention mechanism. We propose VapSR, the VAst-receptive-field Pixel attention network.
  arXiv  Detail & Related papers  (2022-10-12T07:01:00Z)
• Image Super-resolution with An Enhanced Group Convolutional Neural Network [102.2483249598621]
  CNNs with strong learning abilities are widely chosen to resolve super-resolution problem. We present an enhanced super-resolution group CNN (ESRGCNN) with a shallow architecture. Experiments report that our ESRGCNN surpasses the state-of-the-arts in terms of SISR performance, complexity, execution speed, image quality evaluation and visual effect in SISR.
  arXiv  Detail & Related papers  (2022-05-29T00:34:25Z)
• Lightweight Image Enhancement Network for Mobile Devices Using Self-Feature Extraction and Dense Modulation [0.9911248259437542]
  Lightweight image enhancement network is proposed to restore details, texture, and structural information from low-resolution input images. The proposed network include self-feature extraction module which produces modulation parameters from low-quality image itself. Experimental results demonstrate better performance over existing approaches in terms of both quantitative and qualitative evaluations.
  arXiv  Detail & Related papers  (2022-05-02T12:35:08Z)
• Hybrid Pixel-Unshuffled Network for Lightweight Image Super-Resolution [64.54162195322246]
  Convolutional neural network (CNN) has achieved great success on image super-resolution (SR) Most deep CNN-based SR models take massive computations to obtain high performance. We propose a novel Hybrid Pixel-Unshuffled Network (HPUN) by introducing an efficient and effective downsampling module into the SR task.
  arXiv  Detail & Related papers  (2022-03-16T20:10:41Z)
• Deep Networks for Image and Video Super-Resolution [30.75380029218373]
  Single image super-resolution (SISR) is built using efficient convolutional units we refer to as mixed-dense connection blocks (MDCB) We train two versions of our network to enhance complementary image qualities using different loss configurations. We further employ our network for super-resolution task, where our network learns to aggregate information from multiple frames and maintain-temporal consistency.
  arXiv  Detail & Related papers  (2022-01-28T09:15:21Z)
• Asymmetric CNN for image super-resolution [102.96131810686231]
  Deep convolutional neural networks (CNNs) have been widely applied for low-level vision over the past five years. We propose an asymmetric CNN (ACNet) comprising an asymmetric block (AB), a mem?ory enhancement block (MEB) and a high-frequency feature enhancement block (HFFEB) for image super-resolution. Our ACNet can effectively address single image super-resolution (SISR), blind SISR and blind SISR of blind noise problems.
  arXiv  Detail & Related papers  (2021-03-25T07:10:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.