SafeAug: Safety-Critical Driving Data Augmentation from Naturalistic Datasets

• URL: http://arxiv.org/abs/2501.02143v1
• Date: Fri, 03 Jan 2025 23:46:29 GMT
• Title: SafeAug: Safety-Critical Driving Data Augmentation from Naturalistic Datasets
• Authors: Zhaobin Mo, Yunlong Li, Xuan Di,
• Abstract summary: We propose a novel framework to augment the safety-critical driving data from the naturalistic dataset to address this issue.<n>In this framework, we first detect vehicles using YOLOv5, followed by depth estimation and 3D transformation to simulate vehicle proximity and critical driving scenarios better.<n>Compared to the simulated or artificially generated data, our augmentation methods can generate safety-critical driving data with minimal compromise on image authenticity.
• Score: 7.865191493201841
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Safety-critical driving data is crucial for developing safe and trustworthy self-driving algorithms. Due to the scarcity of safety-critical data in naturalistic datasets, current approaches primarily utilize simulated or artificially generated images. However, there remains a gap in authenticity between these generated images and naturalistic ones. We propose a novel framework to augment the safety-critical driving data from the naturalistic dataset to address this issue. In this framework, we first detect vehicles using YOLOv5, followed by depth estimation and 3D transformation to simulate vehicle proximity and critical driving scenarios better. This allows for targeted modification of vehicle dynamics data to reflect potentially hazardous situations. Compared to the simulated or artificially generated data, our augmentation methods can generate safety-critical driving data with minimal compromise on image authenticity. Experiments using KITTI datasets demonstrate that a downstream self-driving algorithm trained on this augmented dataset performs superiorly compared to the baselines, which include SMOGN and importance sampling.

Related papers

• World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving [1.8277374107085946]
  We propose a comprehensive framework combining generative augmentation scene with adaptive temporal reasoning.<n>We develop a video generation pipeline that utilizes a world model by guided domain-informed prompts to create high-resolution, statistically consistent driving scenarios.<n>In parallel, we construct a dynamic prediction model that encodes-temporal relationships through strengthened graph convolutions and dilated temporal operators.
  arXiv  Detail & Related papers  (2025-07-17T03:34:54Z)
• RISEE: A Highly Interactive Naturalistic Driving Trajectories Dataset with Human Subjective Risk Perception and Eye-tracking Information [4.153091882015747]
  Most existing datasets primarily focus on vehicle motion states and trajectories, human-related information.<n>This paper constructs the Risk-Informed Subjective Evaluation and Eye-tracking (RISEE) dataset.<n>RISEE dataset specifically contains human subjective evaluations and eye-tracking data apart from regular naturalistic driving trajectories.
  arXiv  Detail & Related papers  (2025-05-29T02:29:17Z)
• RS2V-L: Vehicle-Mounted LiDAR Data Generation from Roadside Sensor Observations [4.219537240663029]
  RS2V-L is a novel framework for reconstructing and synthesizing vehicle-mounted LiDAR data from roadside sensor observations. To the best of our knowledge, this is the first approach to reconstruct vehicle-mounted LiDAR data from roadside sensor inputs.
  arXiv  Detail & Related papers  (2025-03-10T09:08:05Z)
• Enhancing Autonomous Driving Safety with Collision Scenario Integration [36.83682052117178]
  We propose SafeFusion, a training framework to learn from collision data. Instead of over-relying on imitation learning, SafeFusion integrates safety-oriented metrics during training to enable collision avoidance learning. We also propose CollisionGen, a scalable data generation pipeline to generate diverse, high-quality scenarios.
  arXiv  Detail & Related papers  (2025-03-05T23:08:43Z)
• ReGentS: Real-World Safety-Critical Driving Scenario Generation Made Stable [88.08120417169971]
  Machine learning based autonomous driving systems often face challenges with safety-critical scenarios that are rare in real-world data. This work explores generating safety-critical driving scenarios by modifying complex real-world regular scenarios through trajectory optimization. Our approach addresses unrealistic diverging trajectories and unavoidable collision scenarios that are not useful for training robust planner.
  arXiv  Detail & Related papers  (2024-09-12T08:26:33Z)
• Adversarial Safety-Critical Scenario Generation using Naturalistic Human Driving Priors [2.773055342671194]
  We introduce a natural adversarial scenario generation solution using naturalistic human driving priors and reinforcement learning techniques. Our findings demonstrate that the proposed model can generate realistic safety-critical test scenarios covering both naturalness and adversariality.
  arXiv  Detail & Related papers  (2024-08-06T13:58:56Z)
• RainSD: Rain Style Diversification Module for Image Synthesis Enhancement using Feature-Level Style Distribution [5.500457283114346]
  This paper presents a synthetic road dataset with sensor blockage generated from real road dataset BDD100K. Using this dataset, the degradation of diverse multi-task networks for autonomous driving has been thoroughly evaluated and analyzed. The tendency of the performance degradation of deep neural network-based perception systems for autonomous vehicle has been analyzed in depth.
  arXiv  Detail & Related papers  (2023-12-31T11:30:42Z)
• SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries [94.84458417662407]
  We introduce SAFE-SIM, a controllable closed-loop safety-critical simulation framework. Our approach yields two distinct advantages: 1) generating realistic long-tail safety-critical scenarios that closely reflect real-world conditions, and 2) providing controllable adversarial behavior for more comprehensive and interactive evaluations. We validate our framework empirically using the nuScenes and nuPlan datasets across multiple planners, demonstrating improvements in both realism and controllability.
  arXiv  Detail & Related papers  (2023-12-31T04:14:43Z)
• Leveraging Driver Field-of-View for Multimodal Ego-Trajectory Prediction [69.29802752614677]
  RouteFormer is a novel ego-trajectory prediction network combining GPS data, environmental context, and the driver's field-of-view. To tackle data scarcity and enhance diversity, we introduce GEM, a dataset of urban driving scenarios enriched with synchronized driver field-of-view and gaze data.
  arXiv  Detail & Related papers  (2023-12-13T23:06:30Z)
• Unsupervised Domain Adaptation for Self-Driving from Past Traversal Features [69.47588461101925]
  We propose a method to adapt 3D object detectors to new driving environments. Our approach enhances LiDAR-based detection models using spatial quantized historical features. Experiments on real-world datasets demonstrate significant improvements.
  arXiv  Detail & Related papers  (2023-09-21T15:00:31Z)
• Generative AI-empowered Simulation for Autonomous Driving in Vehicular Mixed Reality Metaverses [130.15554653948897]
  In vehicular mixed reality (MR) Metaverse, distance between physical and virtual entities can be overcome. Large-scale traffic and driving simulation via realistic data collection and fusion from the physical world is difficult and costly. We propose an autonomous driving architecture, where generative AI is leveraged to synthesize unlimited conditioned traffic and driving data in simulations.
  arXiv  Detail & Related papers  (2023-02-16T16:54:10Z)
• KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradients [39.9379344872937]
  Current driving simulators exhibit na"ive behavior models for background traffic. Hand-tuned scenarios are typically added during simulation to induce safety-critical situations. We propose KING, which generates safety-critical driving scenarios with a 20% higher success rate than black-box optimization.
  arXiv  Detail & Related papers  (2022-04-28T17:48:48Z)
• Learning Interactive Driving Policies via Data-driven Simulation [125.97811179463542]
  Data-driven simulators promise high data-efficiency for driving policy learning. Small underlying datasets often lack interesting and challenging edge cases for learning interactive driving. We propose a simulation method that uses in-painted ado vehicles for learning robust driving policies.
  arXiv  Detail & Related papers  (2021-11-23T20:14:02Z)
• Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehicles [86.9067793493874]
  We propose efficient mechanisms to characterize and generate testing scenarios using a state-of-the-art driving simulator. We use our method to characterize real driving data from the Next Generation Simulation (NGSIM) project. We rank the scenarios by defining metrics based on the complexity of avoiding accidents and provide insights into how the AV could have minimized the probability of incurring an accident.
  arXiv  Detail & Related papers  (2021-03-12T17:00:23Z)
• Enhanced Transfer Learning for Autonomous Driving with Systematic Accident Simulation [3.2456691142503256]
  We show that transfer learning on simulated data sets provide better generalization and collision avoidance. Our results illustrate that information from a model trained on simulated data can be inferred to a model trained on real-world data.
  arXiv  Detail & Related papers  (2020-07-23T17:27:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.