Stereo Image Rain Removal via Dual-View Mutual Attention

• URL: http://arxiv.org/abs/2211.10104v1
• Date: Fri, 18 Nov 2022 09:07:01 GMT
• Title: Stereo Image Rain Removal via Dual-View Mutual Attention
• Authors: Yanyan Wei, Zhao Zhang, Zhongqiu Zhao, Yang Zhao, Richang Hong, Yi Yang
• Abstract summary: We propose a new underlineStereo underlineImage underlineRain underlineRemoval method (StereoIRR) via sufficient interaction between two views. We show that StereoIRR outperforms other related monocular and stereo image rain removal methods on several datasets.
• Score: 55.79448042969012
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Stereo images, containing left and right view images with disparity, are utilized in solving low-vision tasks recently, e.g., rain removal and super-resolution. Stereo image restoration methods usually obtain better performance than monocular methods by learning the disparity between dual views either implicitly or explicitly. However, existing stereo rain removal methods still cannot make full use of the complementary information between two views, and we find it is because: 1) the rain streaks have more complex distributions in directions and densities, which severely damage the complementary information and pose greater challenges; 2) the disparity estimation is not accurate enough due to the imperfect fusion mechanism for the features between two views. To overcome such limitations, we propose a new \underline{Stereo} \underline{I}mage \underline{R}ain \underline{R}emoval method (StereoIRR) via sufficient interaction between two views, which incorporates: 1) a new Dual-view Mutual Attention (DMA) mechanism which generates mutual attention maps by taking left and right views as key information for each other to facilitate cross-view feature fusion; 2) a long-range and cross-view interaction, which is constructed with basic blocks and dual-view mutual attention, can alleviate the adverse effect of rain on complementary information to help the features of stereo images to get long-range and cross-view interaction and fusion. Notably, StereoIRR outperforms other related monocular and stereo image rain removal methods on several datasets. Our codes and datasets will be released.

Related papers

• SDI-Net: Toward Sufficient Dual-View Interaction for Low-light Stereo Image Enhancement [38.66838623890922]
  Most low-light image enhancement methods only consider information from a single view. We propose a model called Toward Sufficient Dual-View Interaction for Low-light Stereo Image Enhancement (Sufficient-Net) We design a module named Cross-View Sufficient Interaction Module (CSIM) aiming to fully exploit the correlations between the binocular views via the attention mechanism.
  arXiv  Detail & Related papers  (2024-08-20T15:17:11Z)
• Multi-dimension Queried and Interacting Network for Stereo Image Deraining [13.759978932686519]
  We devise MQINet, which employs multi-dimension queries and interactions for stereo image deraining. This module leverages dimension-wise queries that are independent of the input features. We introduce an intra-view physics-aware attention (IPA) based on the inverse physical model of rainy images.
  arXiv  Detail & Related papers  (2023-09-19T05:04:06Z)
• Mutual Information-driven Triple Interaction Network for Efficient Image Dehazing [54.168567276280505]
  We propose a novel Mutual Information-driven Triple interaction Network (MITNet) for image dehazing. The first stage, named amplitude-guided haze removal, aims to recover the amplitude spectrum of the hazy images for haze removal. The second stage, named phase-guided structure refined, devotes to learning the transformation and refinement of the phase spectrum.
  arXiv  Detail & Related papers  (2023-08-14T08:23:58Z)
• SufrinNet: Toward Sufficient Cross-View Interaction for Stereo Image Enhancement in The Dark [119.01585302856103]
  Low-light stereo image enhancement (LLSIE) is a relatively new task to enhance the quality of visually unpleasant stereo images captured in dark conditions. Current methods clearly suffer from two shortages: 1) insufficient cross-view interaction; 2) lacking long-range dependency for intra-view learning. We propose a novel LLSIE model, termed underlineSufficient Cunderlineross-View underlineInteraction Network (SufrinNet)
  arXiv  Detail & Related papers  (2022-11-02T04:01:30Z)
• Cross-View Panorama Image Synthesis [68.35351563852335]
  PanoGAN is a novel adversarial feedback GAN framework named. PanoGAN enables high-quality panorama image generation with more convincing details than state-of-the-art approaches.
  arXiv  Detail & Related papers  (2022-03-22T15:59:44Z)
• Beyond Monocular Deraining: Parallel Stereo Deraining Network Via Semantic Prior [103.49307603952144]
  Most existing de-rain algorithms use only one single input image and aim to recover a clean image. We present a Paired Rain Removal Network (PRRNet), which exploits both stereo images and semantic information. Experiments on both monocular and the newly proposed stereo rainy datasets demonstrate that the proposed method achieves the state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-05-09T04:15:10Z)
• Multi-Scale Progressive Fusion Network for Single Image Deraining [84.0466298828417]
  Rain streaks in the air appear in various blurring degrees and resolutions due to different distances from their positions to the camera. Similar rain patterns are visible in a rain image as well as its multi-scale (or multi-resolution) versions. In this work, we explore the multi-scale collaborative representation for rain streaks from the perspective of input image scales and hierarchical deep features.
  arXiv  Detail & Related papers  (2020-03-24T17:22:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.