A Benchmark Dataset for Spatially Aligned Road Damage Assessment in Small Uncrewed Aerial Systems Disaster Imagery

• URL: http://arxiv.org/abs/2512.12128v1
• Date: Sat, 13 Dec 2025 01:42:49 GMT
• Title: A Benchmark Dataset for Spatially Aligned Road Damage Assessment in Small Uncrewed Aerial Systems Disaster Imagery
• Authors: Thomas Manzini, Priyankari Perali, Raisa Karnik, Robin R. Murphy,
• Abstract summary: This paper presents the largest known benchmark dataset for road damage assessment and road alignment.<n>It provides 18 baseline models trained on the CRASAR-U-DRIODs dataset's post-disaster small uncrewed aerial systems (sUAS) imagery from 10 federally declared disasters.
• Score: 3.1498833540989413
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper presents the largest known benchmark dataset for road damage assessment and road alignment, and provides 18 baseline models trained on the CRASAR-U-DRIODs dataset's post-disaster small uncrewed aerial systems (sUAS) imagery from 10 federally declared disasters, addressing three challenges within prior post-disaster road damage assessment datasets. While prior disaster road damage assessment datasets exist, there is no current state of practice, as prior public datasets have either been small-scale or reliant on low-resolution imagery insufficient for detecting phenomena of interest to emergency managers. Further, while machine learning (ML) systems have been developed for this task previously, none are known to have been operationally validated. These limitations are overcome in this work through the labeling of 657.25km of roads according to a 10-class labeling schema, followed by training and deploying ML models during the operational response to Hurricanes Debby and Helene in 2024. Motivated by observed road line misalignment in practice, 9,184 road line adjustments were provided for spatial alignment of a priori road lines, as it was found that when the 18 baseline models are deployed against real-world misaligned road lines, model performance degraded on average by 5.596\% Macro IoU. If spatial alignment is not considered, approximately 8\% (11km) of adverse conditions on road lines will be labeled incorrectly, with approximately 9\% (59km) of road lines misaligned off the actual road. These dynamics are gaps that should be addressed by the ML, CV, and robotics communities to enable more effective and informed decision-making during disasters.

Related papers

• Automated Road Crack Localization to Guide Highway Maintenance [49.52476995589485]
  This study investigates the potential of open-source data to guide highway infrastructure maintenance.<n>The proposed framework integrates airborne imagery and OpenStreetMap to fine-tune YOLOv11 for highway crack localization.<n>To demonstrate the framework's real-world applicability, a Swiss Relative Highway Crack Density (RHCD) index was calculated.
  arXiv  Detail & Related papers  (2026-01-21T13:33:58Z)
• Network Level Evaluation of Hangup Susceptibility of HRGCs using Deep Learning and Sensing Techniques: A Goal Towards Safer Future [0.43748379918040853]
  Steep profiled Highway Railway Grade Crossings pose safety hazards to vehicles with low ground clearance.<n>This research develops a framework for network level evaluation of hangup susceptibility of HRGCs.
  arXiv  Detail & Related papers  (2025-12-14T20:25:42Z)
• TD-RD: A Top-Down Benchmark with Real-Time Framework for Road Damage Detection [17.370420825916867]
  Road damage detection remains relatively under explored, despite its critical significance for applications such as infrastructure maintenance and road safety.<n>This paper addresses this gap by introducing a novel top down benchmark that offers a complementary perspective to existing datasets, specifically tailored for road damage detection.<n>Our proposed Top Down Road Damage Detection dataset (TDRD) includes three primary categories of road damage cracks, potholes, and patches captured annotated top down viewpoint.
  arXiv  Detail & Related papers  (2025-01-24T08:00:25Z)
• A Multi-Loss Strategy for Vehicle Trajectory Prediction: Combining Off-Road, Diversity, and Directional Consistency Losses [68.68514648185828]
  Trajectory prediction is essential for the safety and efficiency of planning in autonomous vehicles.<n>Current models often fail to fully capture complex traffic rules and the complete range of potential vehicle movements.<n>This study introduces three novel loss functions: Offroad Loss, Direction Consistency Error, and Diversity Loss.
  arXiv  Detail & Related papers  (2024-11-29T14:47:08Z)
• LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusions [61.87108000328186]
  Lane detection (LD) is an essential component of autonomous driving systems, providing fundamental functionalities like adaptive cruise control and automated lane centering. Existing LD benchmarks primarily focus on evaluating common cases, neglecting the robustness of LD models against environmental illusions. This paper studies the potential threats caused by these environmental illusions to LD and establishes the first comprehensive benchmark LanEvil.
  arXiv  Detail & Related papers  (2024-06-03T02:12:27Z)
• RSRD: A Road Surface Reconstruction Dataset and Benchmark for Safe and Comfortable Autonomous Driving [67.09546127265034]
  Road surface reconstruction helps to enhance the analysis and prediction of vehicle responses for motion planning and control systems. We introduce the Road Surface Reconstruction dataset, a real-world, high-resolution, and high-precision dataset collected with a specialized platform in diverse driving conditions. It covers common road types containing approximately 16,000 pairs of stereo images, original point clouds, and ground-truth depth/disparity maps.
  arXiv  Detail & Related papers  (2023-10-03T17:59:32Z)
• Re-Evaluating LiDAR Scene Flow for Autonomous Driving [80.37947791534985]
  Popular benchmarks for self-supervised LiDAR scene flow have unrealistic rates of dynamic motion, unrealistic correspondences, and unrealistic sampling patterns. We evaluate a suite of top methods on a suite of real-world datasets. We show that despite the emphasis placed on learning, most performance gains are caused by pre- and post-processing steps.
  arXiv  Detail & Related papers  (2023-04-04T22:45:50Z)
• Road Damages Detection and Classification with YOLOv7 [0.0]
  This work proposes to collect and label road damage data using Google Street View and use YOLOv7 (You Only Look Once version 7) The proposed approaches are applied to the Crowdsensing-based Road Damage Detection Challenge (CRDDC2022), IEEE BigData 2022.
  arXiv  Detail & Related papers  (2022-10-31T18:55:58Z)
• How Do We Fail? Stress Testing Perception in Autonomous Vehicles [40.19326157052966]
  This paper presents a method for characterizing failures of LiDAR-based perception systems for autonomous vehicles in adverse weather conditions. We develop a methodology based in reinforcement learning to find likely failures in object tracking and trajectory prediction due to sequences of disturbances.
  arXiv  Detail & Related papers  (2022-03-26T20:48:09Z)
• A Computer Vision-assisted Approach to Automated Real-Time Road Infrastructure Management [0.0]
  We propose a supervised object detection approach to detect and classify road distresses in real-time via a vehicle dashboard-mounted smartphone camera. Our results rank in the top 5 of 121 teams that entered the IEEE's 2020 Global Road Damage Detection ("GRDC") Challenge.
  arXiv  Detail & Related papers  (2022-02-27T04:08:00Z)
• SS-SFDA : Self-Supervised Source-Free Domain Adaptation for Road Segmentation in Hazardous Environments [54.22535063244038]
  We present a novel approach for unsupervised road segmentation in adverse weather conditions such as rain or fog. This includes a new algorithm for source-free domain adaptation (SFDA) using self-supervised learning. We have evaluated the performance on $6$ datasets corresponding to real and synthetic adverse weather conditions.
  arXiv  Detail & Related papers  (2020-11-27T09:19:03Z)
• Can Autonomous Vehicles Identify, Recover From, and Adapt to Distribution Shifts? [104.04999499189402]
  Out-of-training-distribution (OOD) scenarios are a common challenge of learning agents at deployment. We propose an uncertainty-aware planning method, called emphrobust imitative planning (RIP) Our method can detect and recover from some distribution shifts, reducing the overconfident and catastrophic extrapolations in OOD scenes. We introduce an autonomous car novel-scene benchmark, textttCARNOVEL, to evaluate the robustness of driving agents to a suite of tasks with distribution shifts.
  arXiv  Detail & Related papers  (2020-06-26T11:07:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.