HazardNet: Road Debris Detection by Augmentation of Synthetic Models

• URL: http://arxiv.org/abs/2303.07547v1
• Date: Tue, 14 Mar 2023 00:30:24 GMT
• Title: HazardNet: Road Debris Detection by Augmentation of Synthetic Models
• Authors: Tae Eun Choe, Jane Wu, Xiaolin Lin, Karen Kwon, Minwoo Park
• Abstract summary: We present an algorithm to detect unseen road debris using a small set of synthetic models. We constrain the problem domain to uncommon objects on the road and allow the deep neural network, HazardNet, to learn the semantic meaning of road debris.
• Score: 1.1750701213830141
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present an algorithm to detect unseen road debris using a small set of synthetic models. Early detection of road debris is critical for safe autonomous or assisted driving, yet the development of a robust road debris detection model has not been widely discussed. There are two main challenges to building a road debris detector: first, data collection of road debris is challenging since hazardous objects on the road are rare to encounter in real driving scenarios; second, the variability of road debris is broad, ranging from a very small brick to a large fallen tree. To overcome these challenges, we propose a novel approach to few-shot learning of road debris that uses semantic augmentation and domain randomization to augment real road images with synthetic models. We constrain the problem domain to uncommon objects on the road and allow the deep neural network, HazardNet, to learn the semantic meaning of road debris to eventually detect unseen road debris. Our results demonstrate that HazardNet is able to accurately detect real road debris when only trained on synthetic objects in augmented images.

Related papers

• Cut-and-Paste with Precision: a Content and Perspective-aware Data Augmentation for Road Damage Detection [5.939858158928473]
  Road damage can pose significant challenges to the integrity, safety, and durability of road infrastructure. In recent years, researchers have explored various data-driven methods for image-based damage detection in road monitoring applications. We propose an improved Cut-and-paste augmentation technique that is both content-aware (i.e. considers the true location of the road in the image) and perspective-aware (i.e. takes into account the difference in perspective between the injected damage and the target image)
  arXiv  Detail & Related papers  (2024-06-06T09:06:42Z)
• RSRD: A Road Surface Reconstruction Dataset and Benchmark for Safe and Comfortable Autonomous Driving [67.09546127265034]
  Road surface reconstruction helps to enhance the analysis and prediction of vehicle responses for motion planning and control systems. We introduce the Road Surface Reconstruction dataset, a real-world, high-resolution, and high-precision dataset collected with a specialized platform in diverse driving conditions. It covers common road types containing approximately 16,000 pairs of stereo images, original point clouds, and ground-truth depth/disparity maps.
  arXiv  Detail & Related papers  (2023-10-03T17:59:32Z)
• OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mapping [84.65114565766596]
  We present OpenLane-V2, the first dataset on topology reasoning for traffic scene structure. OpenLane-V2 consists of 2,000 annotated road scenes that describe traffic elements and their correlation to the lanes. We evaluate various state-of-the-art methods, and present their quantitative and qualitative results on OpenLane-V2 to indicate future avenues for investigating topology reasoning in traffic scenes.
  arXiv  Detail & Related papers  (2023-04-20T16:31:22Z)
• Spatio-Temporal Context Modeling for Road Obstacle Detection [12.464149169670735]
  A data-driven context-temporal model of the driving scene is constructed with the layouts of the training data. Obstacles are detected via state-of-the-art object detection algorithms, and the results are combined with the generated scene.
  arXiv  Detail & Related papers  (2023-01-19T07:06:35Z)
• A Pre-study on Data Processing Pipelines for Roadside Object Detection Systems Towards Safer Road Infrastructure [1.9967512860886603]
  Single-vehicle accidents are the most common type of fatal accidents in Sweden. This study investigates the feasibility, implementation, limitations and scaling up of data processing pipelines for roadside object detection. The goal of this report is to investigate how to implement a scalable roadside object detection system towards safe road infrastructure and Sweden's Vision Zero.
  arXiv  Detail & Related papers  (2022-04-17T16:27:26Z)
• VAE-iForest: Auto-encoding Reconstruction and Isolation-based Anomalies Detecting Fallen Objects on Road Surface [0.0]
  In road monitoring, it is important to detect changes in the road surface at an early stage to prevent damage to third parties. We prototype a method that combines auto-encoding reconstruction and isolation-based anomaly detector.
  arXiv  Detail & Related papers  (2022-03-02T15:47:36Z)
• A Computer Vision-assisted Approach to Automated Real-Time Road Infrastructure Management [0.0]
  We propose a supervised object detection approach to detect and classify road distresses in real-time via a vehicle dashboard-mounted smartphone camera. Our results rank in the top 5 of 121 teams that entered the IEEE's 2020 Global Road Damage Detection ("GRDC") Challenge.
  arXiv  Detail & Related papers  (2022-02-27T04:08:00Z)
• Road Network Guided Fine-Grained Urban Traffic Flow Inference [108.64631590347352]
  Accurate inference of fine-grained traffic flow from coarse-grained one is an emerging yet crucial problem. We propose a novel Road-Aware Traffic Flow Magnifier (RATFM) that exploits the prior knowledge of road networks. Our method can generate high-quality fine-grained traffic flow maps.
  arXiv  Detail & Related papers  (2021-09-29T07:51:49Z)
• Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detection [55.12894776039135]
  State-of-the-art 3D object detectors, based on deep learning, have shown promising accuracy but are prone to over-fit to domain idiosyncrasies. We propose a novel learning approach that drastically reduces this gap by fine-tuning the detector on pseudo-labels in the target domain. We show, on five autonomous driving datasets, that fine-tuning the detector on these pseudo-labels substantially reduces the domain gap to new driving environments.
  arXiv  Detail & Related papers  (2021-03-26T01:18:11Z)
• Convolutional Recurrent Network for Road Boundary Extraction [99.55522995570063]
  We tackle the problem of drivable road boundary extraction from LiDAR and camera imagery. We design a structured model where a fully convolutional network obtains deep features encoding the location and direction of road boundaries. We showcase the effectiveness of our method on a large North American city where we obtain perfect topology of road boundaries 99.3% of the time.
  arXiv  Detail & Related papers  (2020-12-21T18:59:12Z)
• Photon-Driven Neural Path Guiding [102.12596782286607]
  We present a novel neural path guiding approach that can reconstruct high-quality sampling distributions for path guiding from a sparse set of samples. We leverage photons traced from light sources as the input for sampling density reconstruction, which is highly effective for challenging scenes with strong global illumination. Our approach achieves significantly better rendering results of testing scenes than previous state-of-the-art path guiding methods.
  arXiv  Detail & Related papers  (2020-10-05T04:54:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.