Dual Attention-in-Attention Model for Joint Rain Streak and Raindrop Removal

• URL: http://arxiv.org/abs/2103.07051v1
• Date: Fri, 12 Mar 2021 03:00:33 GMT
• Title: Dual Attention-in-Attention Model for Joint Rain Streak and Raindrop Removal
• Authors: Kaihao Zhang, Dongxu Li, Wenhan Luo, Wenqi Ren, Lin Ma, Hongdong Li
• Abstract summary: We propose a Dual Attention-in-Attention Model (DAiAM) which includes two DAMs for removing both rain streaks and raindrops simultaneously. The proposed method not only is capable of removing rain streaks and raindrops simultaneously, but also achieves the state-of-the-art performance on both tasks.
• Score: 103.4067418083549
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Rain streaks and rain drops are two natural phenomena, which degrade image capture in different ways. Currently, most existing deep deraining networks take them as two distinct problems and individually address one, and thus cannot deal adequately with both simultaneously. To address this, we propose a Dual Attention-in-Attention Model (DAiAM) which includes two DAMs for removing both rain streaks and raindrops. Inside the DAM, there are two attentive maps - each of which attends to the heavy and light rainy regions, respectively, to guide the deraining process differently for applicable regions. In addition, to further refine the result, a Differential-driven Dual Attention-in-Attention Model (D-DAiAM) is proposed with a "heavy-to-light" scheme to remove rain via addressing the unsatisfying deraining regions. Extensive experiments on one public raindrop dataset, one public rain streak and our synthesized joint rain streak and raindrop (JRSRD) dataset have demonstrated that the proposed method not only is capable of removing rain streaks and raindrops simultaneously, but also achieves the state-of-the-art performance on both tasks.

Related papers

• Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streaks [17.00078021737863]
  In the real world, image degradations caused by rain often exhibit a combination of rain streaks and raindrops, thereby increasing the challenges of recovering the underlying clean image. This paper aims to present an efficient and flexible mechanism to learn and model degradation relationships in a global view.
  arXiv  Detail & Related papers  (2023-08-27T16:33:11Z)
• Dual Degradation Representation for Joint Deraining and Low-Light Enhancement in the Dark [57.85378202032541]
  Rain in the dark poses a significant challenge to deploying real-world applications such as autonomous driving, surveillance systems, and night photography. Existing low-light enhancement or deraining methods struggle to brighten low-light conditions and remove rain simultaneously. We introduce an end-to-end model called L$2$RIRNet, designed to manage both low-light enhancement and deraining in real-world settings.
  arXiv  Detail & Related papers  (2023-05-06T10:17:42Z)
• Joint Depth Estimation and Mixture of Rain Removal From a Single Image [24.009353523566162]
  We propose an effective image deraining paradigm for Mixture of rain REmoval, called DEMore-Net. This study explores normalization approaches in image deraining tasks and introduces a new Hybrid Normalization Block (HNB) to enhance the deraining performance of DEMore-Net.
  arXiv  Detail & Related papers  (2023-03-31T02:05:45Z)
• Rethinking Real-world Image Deraining via An Unpaired Degradation-Conditioned Diffusion Model [51.49854435403139]
  We propose RainDiff, the first real-world image deraining paradigm based on diffusion models. We introduce a stable and non-adversarial unpaired cycle-consistent architecture that can be trained, end-to-end, with only unpaired data for supervision. We also propose a degradation-conditioned diffusion model that refines the desired output via a diffusive generative process conditioned by learned priors of multiple rain degradations.
  arXiv  Detail & Related papers  (2023-01-23T13:34:01Z)
• Asymmetric Dual-Decoder U-Net for Joint Rain and Haze Removal [21.316673824040752]
  In real-life scenarios, rain and haze, two often co-occurring common weather phenomena, can greatly degrade the clarity and quality of scene images. We propose a novel deep neural network, named Asymmetric Dual-decoder U-Net (ADU-Net), to address the aforementioned challenge. The ADU-Net produces both the contamination residual and the scene residual to efficiently remove the rain and haze while preserving the fidelity of the scene information.
  arXiv  Detail & Related papers  (2022-06-14T12:50:41Z)
• Deep Single Image Deraining using An Asymetric Cycle Generative and Adversarial Framework [16.59494337699748]
  We propose a novel Asymetric Cycle Generative and Adrial framework (ACGF) for single image deraining. ACGF trains on both synthetic and real rainy images while simultaneously capturing both rain streaks and fog features. Experiments on benchmark rain-fog and rain datasets show that ACGF outperforms state-of-the-art deraining methods.
  arXiv  Detail & Related papers  (2022-02-19T16:14:10Z)
• Unpaired Adversarial Learning for Single Image Deraining with Rain-Space Contrastive Constraints [61.40893559933964]
  We develop an effective unpaired SID method which explores mutual properties of the unpaired exemplars by a contrastive learning manner in a GAN framework, named as CDR-GAN. Our method performs favorably against existing unpaired deraining approaches on both synthetic and real-world datasets, even outperforms several fully-supervised or semi-supervised models.
  arXiv  Detail & Related papers  (2021-09-07T10:00:45Z)
• Closing the Loop: Joint Rain Generation and Removal via Disentangled Image Translation [12.639320247831181]
  We argue that the rain generation and removal are the two sides of the same coin and should be tightly coupled. We propose a bidirectional disentangled translation network, in which each unidirectional network contains two loops of joint rain generation and removal. Experiments on synthetic and real-world rain datasets show the superiority of proposed method compared to state-of-the-arts.
  arXiv  Detail & Related papers  (2021-03-25T08:21:43Z)
• Semi-Supervised Video Deraining with Dynamic Rain Generator [59.71640025072209]
  This paper proposes a new semi-supervised video deraining method, in which a dynamic rain generator is employed to fit the rain layer. Specifically, such dynamic generator consists of one emission model and one transition model to simultaneously encode the spatially physical structure and temporally continuous changes of rain streaks. Various prior formats are designed for the labeled synthetic and unlabeled real data, so as to fully exploit the common knowledge underlying them.
  arXiv  Detail & Related papers  (2021-03-14T14:28:57Z)
• Structural Residual Learning for Single Image Rain Removal [48.87977695398587]
  This study proposes a new network architecture by enforcing the output residual of the network possess intrinsic rain structures. Such a structural residual setting guarantees the rain layer extracted by the network finely comply with the prior knowledge of general rain streaks.
  arXiv  Detail & Related papers  (2020-05-19T05:52:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.