Cut-and-Paste with Precision: a Content and Perspective-aware Data Augmentation for Road Damage Detection

• URL: http://arxiv.org/abs/2406.18586v2
• Date: Wed, 10 Jul 2024 09:24:19 GMT
• Title: Cut-and-Paste with Precision: a Content and Perspective-aware Data Augmentation for Road Damage Detection
• Authors: Punnawat Siripathitti, Florent Forest, Olga Fink,
• Abstract summary: Road damage can pose significant challenges to the integrity, safety, and durability of road infrastructure. In recent years, researchers have explored various data-driven methods for image-based damage detection in road monitoring applications. We propose an improved Cut-and-paste augmentation technique that is both content-aware (i.e. considers the true location of the road in the image) and perspective-aware (i.e. takes into account the difference in perspective between the injected damage and the target image)
• Score: 5.939858158928473
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Damage to road pavement can develop into cracks, potholes, spallings, and other issues posing significant challenges to the integrity, safety, and durability of the road structure. Detecting and monitoring the evolution of these damages is crucial for maintaining the condition and structural health of road infrastructure. In recent years, researchers have explored various data-driven methods for image-based damage detection in road monitoring applications. The field gained attention with the introduction of the Road Damage Detection Challenge (RDDC2018), encouraging competition in developing object detectors on street-view images from various countries. Leading teams have demonstrated the effectiveness of ensemble models, mostly based on the YOLO and Faster R-CNN series. Data augmentations have also shown benefits in object detection within the computer vision field, including transformations such as random flipping, cropping, cutting out patches, as well as cut-and-pasting object instances. Applying cut-and-paste augmentation to road damages appears to be a promising approach to increase data diversity. However, the standard cut-and-paste technique, which involves sampling an object instance from a random image and pasting it at a random location onto the target image, has demonstrated limited effectiveness for road damage detection. This method overlooks the location of the road and disregards the difference in perspective between the sampled damage and the target image, resulting in unrealistic augmented images. In this work, we propose an improved Cut-and-Paste augmentation technique that is both content-aware (i.e. considers the true location of the road in the image) and perspective-aware (i.e. takes into account the difference in perspective between the injected damage and the target image).

Related papers

• Semi-Truths: A Large-Scale Dataset of AI-Augmented Images for Evaluating Robustness of AI-Generated Image detectors [62.63467652611788]
  We introduce SEMI-TRUTHS, featuring 27,600 real images, 223,400 masks, and 1,472,700 AI-augmented images. Each augmented image is accompanied by metadata for standardized and targeted evaluation of detector robustness. Our findings suggest that state-of-the-art detectors exhibit varying sensitivities to the types and degrees of perturbations, data distributions, and augmentation methods used.
  arXiv  Detail & Related papers  (2024-11-12T01:17:27Z)
• Visual Context-Aware Person Fall Detection [52.49277799455569]
  We present a segmentation pipeline to semi-automatically separate individuals and objects in images. Background objects such as beds, chairs, or wheelchairs can challenge fall detection systems, leading to false positive alarms. We demonstrate that object-specific contextual transformations during training effectively mitigate this challenge.
  arXiv  Detail & Related papers  (2024-04-11T19:06:36Z)
• OOSTraj: Out-of-Sight Trajectory Prediction With Vision-Positioning Denoising [49.86409475232849]
  Trajectory prediction is fundamental in computer vision and autonomous driving. Existing approaches in this field often assume precise and complete observational data. We present a novel method for out-of-sight trajectory prediction that leverages a vision-positioning technique.
  arXiv  Detail & Related papers  (2024-04-02T18:30:29Z)
• CarPatch: A Synthetic Benchmark for Radiance Field Evaluation on Vehicle Components [77.33782775860028]
  We introduce CarPatch, a novel synthetic benchmark of vehicles. In addition to a set of images annotated with their intrinsic and extrinsic camera parameters, the corresponding depth maps and semantic segmentation masks have been generated for each view. Global and part-based metrics have been defined and used to evaluate, compare, and better characterize some state-of-the-art techniques.
  arXiv  Detail & Related papers  (2023-07-24T11:59:07Z)
• Spatio-Temporal Context Modeling for Road Obstacle Detection [12.464149169670735]
  A data-driven context-temporal model of the driving scene is constructed with the layouts of the training data. Obstacles are detected via state-of-the-art object detection algorithms, and the results are combined with the generated scene.
  arXiv  Detail & Related papers  (2023-01-19T07:06:35Z)
• Road Damages Detection and Classification with YOLOv7 [0.0]
  This work proposes to collect and label road damage data using Google Street View and use YOLOv7 (You Only Look Once version 7) The proposed approaches are applied to the Crowdsensing-based Road Damage Detection Challenge (CRDDC2022), IEEE BigData 2022.
  arXiv  Detail & Related papers  (2022-10-31T18:55:58Z)
• Perspective Aware Road Obstacle Detection [104.57322421897769]
  We show that road obstacle detection techniques ignore the fact that, in practice, the apparent size of the obstacles decreases as their distance to the vehicle increases. We leverage this by computing a scale map encoding the apparent size of a hypothetical object at every image location. We then leverage this perspective map to generate training data by injecting onto the road synthetic objects whose size corresponds to the perspective foreshortening.
  arXiv  Detail & Related papers  (2022-10-04T17:48:42Z)
• TAD: A Large-Scale Benchmark for Traffic Accidents Detection from Video Surveillance [2.1076255329439304]
  Existing datasets in traffic accidents are either small-scale, not from surveillance cameras, not open-sourced, or not built for freeway scenes. After integration and annotation by various dimensions, a large-scale traffic accidents dataset named TAD is proposed in this work.
  arXiv  Detail & Related papers  (2022-09-26T03:00:50Z)
• Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detection [55.12894776039135]
  State-of-the-art 3D object detectors, based on deep learning, have shown promising accuracy but are prone to over-fit to domain idiosyncrasies. We propose a novel learning approach that drastically reduces this gap by fine-tuning the detector on pseudo-labels in the target domain. We show, on five autonomous driving datasets, that fine-tuning the detector on these pseudo-labels substantially reduces the domain gap to new driving environments.
  arXiv  Detail & Related papers  (2021-03-26T01:18:11Z)
• Road surface detection and differentiation considering surface damages [0.0]
  We present an approach for road detection considering variation in surface types, identifying paved and unpaved surfaces and also detecting damage and other information on other road surface that may be relevant to driving safety. Our results show that it is possible to use passive vision for these purposes, even using images captured with low cost cameras.
  arXiv  Detail & Related papers  (2020-06-23T23:11:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.