Rain Removal and Illumination Enhancement Done in One Go

• URL: http://arxiv.org/abs/2108.03873v1
• Date: Mon, 9 Aug 2021 08:46:15 GMT
• Title: Rain Removal and Illumination Enhancement Done in One Go
• Authors: Yecong Wan, Yuanshuo Cheng, and Mingwen Shao
• Abstract summary: We propose a novel entangled network, namely EMNet, which can remove the rain and enhance illumination in one go. We present a new synthetic dataset, namely DarkRain, to boost the development of rain image restoration algorithms. EMNet is extensively evaluated on the proposed benchmark and achieves state-of-the-art results.
• Score: 1.0323063834827415
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Rain removal plays an important role in the restoration of degraded images. Recently, data-driven methods have achieved remarkable success. However, these approaches neglect that the appearance of rain is often accompanied by low light conditions, which will further degrade the image quality. Therefore, it is very indispensable to jointly remove the rain and enhance the light for real-world rain image restoration. In this paper, we aim to address this problem from two aspects. First, we proposed a novel entangled network, namely EMNet, which can remove the rain and enhance illumination in one go. Specifically, two encoder-decoder networks interact complementary information through entanglement structure, and parallel rain removal and illumination enhancement. Considering that the encoder-decoder structure is unreliable in preserving spatial details, we employ a detail recovery network to restore the desired fine texture. Second, we present a new synthetic dataset, namely DarkRain, to boost the development of rain image restoration algorithms in practical scenarios. DarkRain not only contains different degrees of rain, but also considers different lighting conditions, and more realistically simulates the rainfall in the real world. EMNet is extensively evaluated on the proposed benchmark and achieves state-of-the-art results. In addition, after a simple transformation, our method outshines existing methods in both rain removal and low-light image enhancement. The source code and dataset will be made publicly available later.

Related papers

• RainyScape: Unsupervised Rainy Scene Reconstruction using Decoupled Neural Rendering [50.14860376758962]
  We propose RainyScape, an unsupervised framework for reconstructing clean scenes from a collection of multi-view rainy images. Based on the spectral bias property of neural networks, we first optimize the neural rendering pipeline to obtain a low-frequency scene representation. We jointly optimize the two modules, driven by the proposed adaptive direction-sensitive gradient-based reconstruction loss.
  arXiv  Detail & Related papers  (2024-04-17T14:07:22Z)
• Dual Degradation Representation for Joint Deraining and Low-Light Enhancement in the Dark [57.85378202032541]
  Rain in the dark poses a significant challenge to deploying real-world applications such as autonomous driving, surveillance systems, and night photography. Existing low-light enhancement or deraining methods struggle to brighten low-light conditions and remove rain simultaneously. We introduce an end-to-end model called L$2$RIRNet, designed to manage both low-light enhancement and deraining in real-world settings.
  arXiv  Detail & Related papers  (2023-05-06T10:17:42Z)
• From heavy rain removal to detail restoration: A faster and better network [26.60300982543502]
  In this work, we introduce a simple dual-stage progressive enhancement network, denoted as DPENet, to achieve effective deraining. This approach comprises two key modules, a rain streaks removal network (R$2$Net) focusing on accurate rain removal, and a details reconstruction network (DRNet) designed to recover the textural details of rain-free images.
  arXiv  Detail & Related papers  (2022-05-07T04:55:05Z)
• Semi-DRDNet Semi-supervised Detail-recovery Image Deraining Network via Unpaired Contrastive Learning [59.22620253308322]
  We propose a semi-supervised detail-recovery image deraining network (termed as Semi-DRDNet) As a semi-supervised learning paradigm, Semi-DRDNet operates smoothly on both synthetic and real-world rainy data in terms of deraining robustness and detail accuracy.
  arXiv  Detail & Related papers  (2022-04-06T12:35:27Z)
• Single Image Deraining Network with Rain Embedding Consistency and Layered LSTM [14.310541943673181]
  We introduce the idea of "Rain Embedding Consistency" by regarding the encoded embedding by the autoencoder as an ideal rain embedding. A Rain Embedding Loss is applied to directly supervise the encoding process, with a Rectified Local Contrast Normalization as the guide. We also propose Layered LSTM for recurrent deraining and fine-grained encoder feature refinement considering different scales.
  arXiv  Detail & Related papers  (2021-11-05T17:03:08Z)
• Structure-Preserving Deraining with Residue Channel Prior Guidance [33.41254475191555]
  Single image deraining is important for many high-level computer vision tasks. We propose a Structure-Preserving Deraining Network (SPDNet) with RCP guidance. SPDNet directly generates high-quality rain-free images with clear and accurate structures under RCP guidance.
  arXiv  Detail & Related papers  (2021-08-20T09:09:56Z)
• RCDNet: An Interpretable Rain Convolutional Dictionary Network for Single Image Deraining [49.99207211126791]
  We specifically build a novel deep architecture, called rain convolutional dictionary network (RCDNet) RCDNet embeds the intrinsic priors of rain streaks and has clear interpretability. By end-to-end training such an interpretable network, all involved rain kernels and proximal operators can be automatically extracted.
  arXiv  Detail & Related papers  (2021-07-14T16:08:11Z)
• Beyond Monocular Deraining: Parallel Stereo Deraining Network Via Semantic Prior [103.49307603952144]
  Most existing de-rain algorithms use only one single input image and aim to recover a clean image. We present a Paired Rain Removal Network (PRRNet), which exploits both stereo images and semantic information. Experiments on both monocular and the newly proposed stereo rainy datasets demonstrate that the proposed method achieves the state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-05-09T04:15:10Z)
• Exploiting Global and Local Attentions for Heavy Rain Removal on Single Images [35.596659286313766]
  Heavy rain removal from a single image is the task of simultaneously eliminating rain streaks and fog. Most existing rain removal methods do not generalize well for the heavy rain case. We propose a novel network architecture consisting of three sub-networks to remove heavy rain from a single image.
  arXiv  Detail & Related papers  (2021-04-16T14:08:27Z)
• Structural Residual Learning for Single Image Rain Removal [48.87977695398587]
  This study proposes a new network architecture by enforcing the output residual of the network possess intrinsic rain structures. Such a structural residual setting guarantees the rain layer extracted by the network finely comply with the prior knowledge of general rain streaks.
  arXiv  Detail & Related papers  (2020-05-19T05:52:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.