Raindrop Clarity: A Dual-Focused Dataset for Day and Night Raindrop Removal

• URL: http://arxiv.org/abs/2407.16957v1
• Date: Wed, 24 Jul 2024 02:48:30 GMT
• Title: Raindrop Clarity: A Dual-Focused Dataset for Day and Night Raindrop Removal
• Authors: Yeying Jin, Xin Li, Jiadong Wang, Yan Zhang, Malu Zhang,
• Abstract summary: Raindrop Clarity comprises 15,186 high-quality pairs/triplets of images with raindrops and the corresponding clear background images. There are 5,442 daytime raindrop images and 9,744 nighttime raindrop images. Our dataset will enable the community to explore background-focused and raindrop-focused images.
• Score: 16.50219011463268
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Existing raindrop removal datasets have two shortcomings. First, they consist of images captured by cameras with a focus on the background, leading to the presence of blurry raindrops. To our knowledge, none of these datasets include images where the focus is specifically on raindrops, which results in a blurry background. Second, these datasets predominantly consist of daytime images, thereby lacking nighttime raindrop scenarios. Consequently, algorithms trained on these datasets may struggle to perform effectively in raindrop-focused or nighttime scenarios. The absence of datasets specifically designed for raindrop-focused and nighttime raindrops constrains research in this area. In this paper, we introduce a large-scale, real-world raindrop removal dataset called Raindrop Clarity. Raindrop Clarity comprises 15,186 high-quality pairs/triplets (raindrops, blur, and background) of images with raindrops and the corresponding clear background images. There are 5,442 daytime raindrop images and 9,744 nighttime raindrop images. Specifically, the 5,442 daytime images include 3,606 raindrop- and 1,836 background-focused images. While the 9,744 nighttime images contain 4,838 raindrop- and 4,906 background-focused images. Our dataset will enable the community to explore background-focused and raindrop-focused images, including challenges unique to daytime and nighttime conditions. Our data and code are available at: \url{https://github.com/jinyeying/RaindropClarity}

Related papers

• NTIRE 2025 Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Results [173.5963741512905]
  This paper reviews the NTIRE 2025 Challenge on Day and Night Raindrop Removal for Dual-Focused Images. This challenge received a wide range of impressive solutions, which are developed and evaluated using our collected real-world Raindrop Clarity dataset. The primary objective of this challenge is to establish a new and powerful benchmark for the task of removing raindrops under varying lighting and focus conditions.
  arXiv  Detail & Related papers  (2025-04-17T07:35:35Z)
• SpikeDerain: Unveiling Clear Videos from Rainy Sequences Using Color Spike Streams [49.34425133546994]
  Restoring clear frames from rainy videos presents a significant challenge due to the rapid motion of rain streaks. Traditional frame-based visual sensors, which capture scene content synchronously, struggle to capture the fast-moving details of rain accurately. We propose a Color Spike Stream Deraining Network (SpikeDerain), capable of reconstructing spike streams of dynamic scenes and accurately removing rain streaks.
  arXiv  Detail & Related papers  (2025-03-26T08:28:28Z)
• NiteDR: Nighttime Image De-Raining with Cross-View Sensor Cooperative Learning for Dynamic Driving Scenes [49.92839157944134]
  In nighttime driving scenes, insufficient and uneven lighting shrouds the scenes in darkness, resulting degradation of image quality and visibility. We develop an image de-raining framework tailored for rainy nighttime driving scenes. It aims to remove rain artifacts, enrich scene representation, and restore useful information.
  arXiv  Detail & Related papers  (2024-02-28T09:02:33Z)
• Why current rain denoising models fail on CycleGAN created rain images in autonomous driving [1.4831974871130875]
  Rain is artificially added to a set of clear-weather condition images using a Generative Adversarial Network (GAN) This artificial generation of rain images is sufficiently realistic as in 7 out of 10 cases, human test subjects believed the generated rain images to be real. In a second step, this paired good/bad weather image data is used to train two rain denoising models, one based primarily on a Convolutional Neural Network (CNN) and the other using a Vision Transformer.
  arXiv  Detail & Related papers  (2023-05-22T12:42:32Z)
• Dual Degradation Representation for Joint Deraining and Low-Light Enhancement in the Dark [57.85378202032541]
  Rain in the dark poses a significant challenge to deploying real-world applications such as autonomous driving, surveillance systems, and night photography. Existing low-light enhancement or deraining methods struggle to brighten low-light conditions and remove rain simultaneously. We introduce an end-to-end model called L$2$RIRNet, designed to manage both low-light enhancement and deraining in real-world settings.
  arXiv  Detail & Related papers  (2023-05-06T10:17:42Z)
• Joint Depth Estimation and Mixture of Rain Removal From a Single Image [24.009353523566162]
  We propose an effective image deraining paradigm for Mixture of rain REmoval, called DEMore-Net. This study explores normalization approaches in image deraining tasks and introduces a new Hybrid Normalization Block (HNB) to enhance the deraining performance of DEMore-Net.
  arXiv  Detail & Related papers  (2023-03-31T02:05:45Z)
• GTAV-NightRain: Photometric Realistic Large-scale Dataset for Night-time Rain Streak Removal [30.93624632770902]
  Rain is transparent, which reflects and refracts light in the scene to the camera. In existing rain streak removal datasets, although density, scale, direction and intensity have been considered, transparency is not fully taken into account. This paper proposes GTAV-NightRain dataset, which is a large-scale synthetic night-time rain streak removal dataset.
  arXiv  Detail & Related papers  (2022-10-10T14:08:09Z)
• Not Just Streaks: Towards Ground Truth for Single Image Deraining [42.15398478201746]
  We propose a large-scale dataset of real-world rainy and clean image pairs. We propose a deep neural network that reconstructs the underlying scene by minimizing a rain-robust loss between rainy and clean images.
  arXiv  Detail & Related papers  (2022-06-22T00:10:06Z)
• Feature-Aligned Video Raindrop Removal with Temporal Constraints [68.49161092870224]
  Raindrop removal is challenging for both single image and video. Unlike rain streaks, adherent raindrops tend to cover the same area in several frames. Our method employs a two-stage video-based raindrop removal method.
  arXiv  Detail & Related papers  (2022-05-29T05:42:14Z)
• Memory-guided Image De-raining Using Time-Lapse Data [83.12497916664904]
  We address the problem of single image de-raining, that is, the task of recovering clean and rain-free background scenes from a single image obscured by a rainy artifact. We propose a novel network architecture based on a memory network that explicitly helps to capture long-term rain streak information in the time-lapse data.
  arXiv  Detail & Related papers  (2022-01-06T01:36:59Z)
• Dual Attention-in-Attention Model for Joint Rain Streak and Raindrop Removal [103.4067418083549]
  We propose a Dual Attention-in-Attention Model (DAiAM) which includes two DAMs for removing both rain streaks and raindrops simultaneously. The proposed method not only is capable of removing rain streaks and raindrops simultaneously, but also achieves the state-of-the-art performance on both tasks.
  arXiv  Detail & Related papers  (2021-03-12T03:00:33Z)
• MBA-RainGAN: Multi-branch Attention Generative Adversarial Network for Mixture of Rain Removal from Single Images [24.60495609529114]
  Rain severely hampers the visibility of scene objects when images are captured through glass in heavily rainy days. We observe three intriguing phenomenons that, 1) rain is a mixture of raindrops, rain streaks and rainy haze; 2) the depth from the camera determines the degrees of object visibility; and 3) raindrops on the glass randomly affect the object visibility of the whole image space.
  arXiv  Detail & Related papers  (2020-05-21T11:44:21Z)
• Structural Residual Learning for Single Image Rain Removal [48.87977695398587]
  This study proposes a new network architecture by enforcing the output residual of the network possess intrinsic rain structures. Such a structural residual setting guarantees the rain layer extracted by the network finely comply with the prior knowledge of general rain streaks.
  arXiv  Detail & Related papers  (2020-05-19T05:52:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.