Single Image Deraining via Scale-space Invariant Attention Neural Network

• URL: http://arxiv.org/abs/2006.05049v2
• Date: Thu, 11 Jun 2020 01:35:10 GMT
• Title: Single Image Deraining via Scale-space Invariant Attention Neural Network
• Authors: Bo Pang, Deming Zhai, Junjun Jiang, Xianming Liu
• Abstract summary: We tackle the notion of scale that deals with visual changes in appearance of rain steaks with respect to the camera. We propose to represent the multi-scale correlation in convolutional feature domain, which is more compact and robust than that in pixel domain. In this way, we summarize the most activated presence of feature maps as the salient features.
• Score: 58.5284246878277
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Image enhancement from degradation of rainy artifacts plays a critical role in outdoor visual computing systems. In this paper, we tackle the notion of scale that deals with visual changes in appearance of rain steaks with respect to the camera. Specifically, we revisit multi-scale representation by scale-space theory, and propose to represent the multi-scale correlation in convolutional feature domain, which is more compact and robust than that in pixel domain. Moreover, to improve the modeling ability of the network, we do not treat the extracted multi-scale features equally, but design a novel scale-space invariant attention mechanism to help the network focus on parts of the features. In this way, we summarize the most activated presence of feature maps as the salient features. Extensive experiments results on synthetic and real rainy scenes demonstrate the superior performance of our scheme over the state-of-the-arts.

Related papers

• Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining [47.15857899099733]
  We develop an end-to-end multi-scale Transformer to facilitate high-quality image reconstruction. We incorporate intra-scale implicit neural representations based on pixel coordinates with the degraded inputs in a closed-loop design. Our approach, named as NeRD-Rain, performs favorably against the state-of-the-art ones on both synthetic and real-world benchmark datasets.
  arXiv  Detail & Related papers  (2024-04-02T01:18:16Z)
• Multi-scale Unified Network for Image Classification [33.560003528712414]
  CNNs face notable challenges in performance and computational efficiency when dealing with real-world, multi-scale image inputs. We propose Multi-scale Unified Network (MUSN) consisting of multi-scales, a unified network, and scale-invariant constraint. MUSN yields an accuracy increase up to 44.53% and diminishes FLOPs by 7.01-16.13% in multi-scale scenarios.
  arXiv  Detail & Related papers  (2024-03-27T06:40:26Z)
• Semantic-aware Texture-Structure Feature Collaboration for Underwater Image Enhancement [58.075720488942125]
  Underwater image enhancement has become an attractive topic as a significant technology in marine engineering and aquatic robotics. We develop an efficient and compact enhancement network in collaboration with a high-level semantic-aware pretrained model. We also apply the proposed algorithm to the underwater salient object detection task to reveal the favorable semantic-aware ability for high-level vision tasks.
  arXiv  Detail & Related papers  (2022-11-19T07:50:34Z)
• Online-updated High-order Collaborative Networks for Single Image Deraining [51.22694467126883]
  Single image deraining is an important task for some downstream artificial intelligence applications such as video surveillance and self-driving systems. We propose a high-order collaborative network with multi-scale compact constraints and a bidirectional scale-content similarity mining module. Our proposed method performs favorably against eleven state-of-the-art methods on five public synthetic and one real-world dataset.
  arXiv  Detail & Related papers  (2022-02-14T09:09:08Z)
• Revisit Visual Representation in Analytics Taxonomy: A Compression Perspective [69.99087941471882]
  We study the problem of supporting multiple machine vision analytics tasks with the compressed visual representation. By utilizing the intrinsic transferability among different tasks, our framework successfully constructs compact and expressive representations at low bit-rates. In order to impose compactness in the representations, we propose a codebook-based hyperprior.
  arXiv  Detail & Related papers  (2021-06-16T01:44:32Z)
• Wavelength-based Attributed Deep Neural Network for Underwater Image Restoration [9.378355457555319]
  This paper shows that attributing the right receptive field size (context) based on the traversing range of the color channel may lead to a substantial performance gain. As a second novelty, we have incorporated an attentive skip mechanism to adaptively refine the learned multi-contextual features. The proposed framework, called Deep WaveNet, is optimized using the traditional pixel-wise and feature-based cost functions.
  arXiv  Detail & Related papers  (2021-06-15T06:47:51Z)
• Enhancing Photorealism Enhancement [83.88433283714461]
  We present an approach to enhancing the realism of synthetic images using a convolutional network. We analyze scene layout distributions in commonly used datasets and find that they differ in important ways. We report substantial gains in stability and realism in comparison to recent image-to-image translation methods.
  arXiv  Detail & Related papers  (2021-05-10T19:00:49Z)
• Image super-resolution reconstruction based on attention mechanism and feature fusion [3.42658286826597]
  A network structure based on attention mechanism and multi-scale feature fusion is proposed. Experimental results show that the proposed method can achieve better performance over other representative super-resolution reconstruction algorithms.
  arXiv  Detail & Related papers  (2020-04-08T11:20:10Z)
• Multi-Scale Progressive Fusion Network for Single Image Deraining [84.0466298828417]
  Rain streaks in the air appear in various blurring degrees and resolutions due to different distances from their positions to the camera. Similar rain patterns are visible in a rain image as well as its multi-scale (or multi-resolution) versions. In this work, we explore the multi-scale collaborative representation for rain streaks from the perspective of input image scales and hierarchical deep features.
  arXiv  Detail & Related papers  (2020-03-24T17:22:37Z)
• MLFcGAN: Multi-level Feature Fusion based Conditional GAN for Underwater Image Color Correction [35.16835830904171]
  We propose a deep multi-scale feature fusion net based on the conditional generative adversarial network (GAN) for underwater image color correction. In our network, multi-scale features are extracted first, followed by augmenting local features on each scale with global features. This design was verified to facilitate more effective and faster network learning, resulting in better performance in both color correction and detail preservation.
  arXiv  Detail & Related papers  (2020-02-13T04:15:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.