Raindrops on Windshield: Dataset and Lightweight Gradient-Based Detection Algorithm

• URL: http://arxiv.org/abs/2104.05078v1
• Date: Sun, 11 Apr 2021 19:04:59 GMT
• Title: Raindrops on Windshield: Dataset and Lightweight Gradient-Based Detection Algorithm
• Authors: Vera Soboleva, Oleg Shipitko
• Abstract summary: We present a new dataset for training and assessing vision algorithms' performance for different tasks of image artifacts detection on either camera lens or windshield. To augment the data, we also propose an algorithm for data augmentation which allows the generation of synthetic raindrops on images. The proposed algorithm showed a higher quality of raindrop presence detection and image processing speed, making it applicable for the self-check procedure of real autonomous systems.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Autonomous vehicles use cameras as one of the primary sources of information about the environment. Adverse weather conditions such as raindrops, snow, mud, and others, can lead to various image artifacts. Such artifacts significantly degrade the quality and reliability of the obtained visual data and can lead to accidents if they are not detected in time. This paper presents ongoing work on a new dataset for training and assessing vision algorithms' performance for different tasks of image artifacts detection on either camera lens or windshield. At the moment, we present a publicly available set of images containing $8190$ images, of which $3390$ contain raindrops. Images are annotated with the binary mask representing areas with raindrops. We demonstrate the applicability of the dataset in the problems of raindrops presence detection and raindrop region segmentation. To augment the data, we also propose an algorithm for data augmentation which allows the generation of synthetic raindrops on images. Apart from the dataset, we present a novel gradient-based algorithm for raindrop presence detection in a video sequence. The experimental evaluation proves that the algorithm reliably detects raindrops. Moreover, compared with the state-of-the-art cross-correlation-based algorithm \cite{Einecke2014}, the proposed algorithm showed a higher quality of raindrop presence detection and image processing speed, making it applicable for the self-check procedure of real autonomous systems. The dataset is available at \href{https://github.com/EvoCargo/RaindropsOnWindshield}{$github.com/EvoCargo/RaindropsOnWindshield$}.

Related papers

• NiteDR: Nighttime Image De-Raining with Cross-View Sensor Cooperative Learning for Dynamic Driving Scenes [49.92839157944134]
  In nighttime driving scenes, insufficient and uneven lighting shrouds the scenes in darkness, resulting degradation of image quality and visibility. We develop an image de-raining framework tailored for rainy nighttime driving scenes. It aims to remove rain artifacts, enrich scene representation, and restore useful information.
  arXiv  Detail & Related papers  (2024-02-28T09:02:33Z)
• UAV-Rain1k: A Benchmark for Raindrop Removal from UAV Aerial Imagery [18.97379943624394]
  Raindrops adhering to the lens of UAVs can obstruct visibility of the background scene and degrade image quality. We first construct a new benchmark dataset for removing raindrops from UAV images, called UAV-Rain1k.
  arXiv  Detail & Related papers  (2024-02-08T16:00:25Z)
• Semantic Segmentation of Radar Detections using Convolutions on Point Clouds [59.45414406974091]
  We introduce a deep-learning based method to convolve radar detections into point clouds. We adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds. Our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds.
  arXiv  Detail & Related papers  (2023-05-22T07:09:35Z)
• Single Image Deraining via Feature-based Deep Convolutional Neural Network [13.39233717329633]
  A single image deraining algorithm based on the combination of data-driven and model-based approaches is proposed. Experiments show that the proposed algorithm significantly outperforms state-of-the-art methods in terms of both qualitative and quantitative measures.
  arXiv  Detail & Related papers  (2023-05-03T13:12:51Z)
• Potential Auto-driving Threat: Universal Rain-removal Attack [4.295658028319317]
  We propose a universal rain-removal attack (URA) on the vulnerability of image rain-removal algorithms. URA reduces the scene repair capability by 39.5% and the image generation quality by 26.4%. URA could be considered a critical tool for the vulnerability detection of image rain-removal algorithms.
  arXiv  Detail & Related papers  (2022-11-18T00:35:05Z)
• Toward Real-world Single Image Deraining: A New Benchmark and Beyond [79.5893880599847]
  Single image deraining (SID) in real scenarios attracts increasing attention in recent years. Previous real datasets suffer from low-resolution images, homogeneous rain streaks, limited background variation, and even misalignment of image pairs. We establish a new high-quality dataset named RealRain-1k, consisting of $1,120$ high-resolution paired clean and rainy images with low- and high-density rain streaks, respectively.
  arXiv  Detail & Related papers  (2022-06-11T12:26:59Z)
• RCDNet: An Interpretable Rain Convolutional Dictionary Network for Single Image Deraining [49.99207211126791]
  We specifically build a novel deep architecture, called rain convolutional dictionary network (RCDNet) RCDNet embeds the intrinsic priors of rain streaks and has clear interpretability. By end-to-end training such an interpretable network, all involved rain kernels and proximal operators can be automatically extracted.
  arXiv  Detail & Related papers  (2021-07-14T16:08:11Z)
• DAWN: Vehicle Detection in Adverse Weather Nature Dataset [4.09920839425892]
  We present a new dataset consisting of real-world images collected under various adverse weather conditions called DAWN. The dataset comprises a collection of 1000 images from real-traffic environments, which are divided into four sets of weather conditions: fog, snow, rain and sandstorms. This data helps interpreting effects caused by the adverse weather conditions on the performance of vehicle detection systems.
  arXiv  Detail & Related papers  (2020-08-12T15:48:49Z)
• Conditional Variational Image Deraining [158.76814157115223]
  Conditional Variational Image Deraining (CVID) network for better deraining performance. We propose a spatial density estimation (SDE) module to estimate a rain density map for each image. Experiments on synthesized and real-world datasets show that the proposed CVID network achieves much better performance than previous deterministic methods on image deraining.
  arXiv  Detail & Related papers  (2020-04-23T11:51:38Z)
• Multi-Scale Progressive Fusion Network for Single Image Deraining [84.0466298828417]
  Rain streaks in the air appear in various blurring degrees and resolutions due to different distances from their positions to the camera. Similar rain patterns are visible in a rain image as well as its multi-scale (or multi-resolution) versions. In this work, we explore the multi-scale collaborative representation for rain streaks from the perspective of input image scales and hierarchical deep features.
  arXiv  Detail & Related papers  (2020-03-24T17:22:37Z)
• Rainy screens: Collecting rainy datasets, indoors [19.71705192452036]
  We present a simple method for generating diverse rainy images from existing clear ground-truth images. This setup allows us to leverage the diversity of existing datasets with auxiliary task ground-truth data. We generate rainy images with real adherent droplets and rain streaks based on Cityscapes and BDD, and train a de-raining model.
  arXiv  Detail & Related papers  (2020-03-10T13:57:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.