ADPerf: Investigating and Testing Performance in Autonomous Driving Systems

• URL: http://arxiv.org/abs/2510.13078v1
• Date: Wed, 15 Oct 2025 01:45:59 GMT
• Title: ADPerf: Investigating and Testing Performance in Autonomous Driving Systems
• Authors: Tri Minh-Triet Pham, Diego Elias Costa, Weiyi Shang, Jinqiu Yang,
• Abstract summary: We present the first comprehensive investigation on measuring and modeling the performance of the obstacle detection modules in two industry-grade autonomous driving systems.<n>We introduce ADPerf, a tool that aims to generate realistic point cloud data test cases that can expose increased detection latency.<n>Our evaluation highlights the need to conduct performance testing of obstacle detection components, especially 3D obstacle detection.
• Score: 7.10115369804893
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Obstacle detection is crucial to the operation of autonomous driving systems, which rely on multiple sensors, such as cameras and LiDARs, combined with code logic and deep learning models to detect obstacles for time-sensitive decisions. Consequently, obstacle detection latency is critical to the safety and effectiveness of autonomous driving systems. However, the latency of the obstacle detection module and its resilience to various changes in the LiDAR point cloud data are not yet fully understood. In this work, we present the first comprehensive investigation on measuring and modeling the performance of the obstacle detection modules in two industry-grade autonomous driving systems, i.e., Apollo and Autoware. Learning from this investigation, we introduce ADPerf, a tool that aims to generate realistic point cloud data test cases that can expose increased detection latency. Increasing latency decreases the availability of the detected obstacles and stresses the capabilities of subsequent modules in autonomous driving systems, i.e., the modules may be negatively impacted by the increased latency in obstacle detection. We applied ADPerf to stress-test the performance of widely used 3D obstacle detection modules in autonomous driving systems, as well as the propagation of such tests on trajectory prediction modules. Our evaluation highlights the need to conduct performance testing of obstacle detection components, especially 3D obstacle detection, as they can be a major bottleneck to increased latency of the autonomous driving system. Such an adverse outcome will also further propagate to other modules, reducing the overall reliability of autonomous driving systems.

Related papers

• Lane-Wise Highway Anomaly Detection [8.086502588472783]
  This paper proposes a scalable and interpretable framework for lane-wise highway traffic anomaly detection.<n>Unlike traditional sensor-dependent methods, our approach uses AI-powered vision models to extract lane-specific features.<n>Our framework outperforms state-of-the-art methods in precision, recall, and F1-score.
  arXiv  Detail & Related papers  (2025-05-05T12:32:23Z)
• MSC-Bench: Benchmarking and Analyzing Multi-Sensor Corruption for Driving Perception [9.575044300747061]
  Multi-sensor fusion models play a crucial role in autonomous driving perception, particularly in tasks like 3D object detection and HD map construction.<n>These models provide essential and comprehensive static environmental information for autonomous driving systems.<n>While camera-LiDAR fusion methods have shown promising results, they often depend on complete sensor inputs.<n>This reliance can lead to low robustness and potential failures when sensors are corrupted or missing, raising significant safety concerns.<n>To tackle this challenge, we introduce the Multi-Sensor Corruption Benchmark (MSC-Bench), the first comprehensive benchmark aimed at evaluating the robustness of multi-sensor autonomous driving perception models against various sensor corruption
  arXiv  Detail & Related papers  (2025-01-02T03:38:46Z)
• On the Robustness Evaluation of 3D Obstacle Detection Against Specifications in Autonomous Driving [5.013456653983232]
  robustness of 3D obstacle detection models against specification-based perturbations remains unevaluated.<n>We apply ET to evaluate the robustness of five classic 3D obstacle detection models, including one from an industry-grade Level 4 ADS.<n>We find that even very subtle changes in the PCD (i.e., removing two points) may introduce a non-trivial decrease in safety of objects.
  arXiv  Detail & Related papers  (2024-08-24T19:10:07Z)
• Towards Automated Driving Violation Cause Analysis in Scenario-Based Testing for Autonomous Driving Systems [22.872694649245044]
  We propose a novel driving violation cause analysis (DVCA) tool. Our tool can achieve perfect component-level attribution accuracy (100%) and almost (>98%) perfect message-level accuracy.
  arXiv  Detail & Related papers  (2024-01-19T01:12:37Z)
• DARTH: Holistic Test-time Adaptation for Multiple Object Tracking [87.72019733473562]
  Multiple object tracking (MOT) is a fundamental component of perception systems for autonomous driving. Despite the urge of safety in driving systems, no solution to the MOT adaptation problem to domain shift in test-time conditions has ever been proposed. We introduce DARTH, a holistic test-time adaptation framework for MOT.
  arXiv  Detail & Related papers  (2023-10-03T10:10:42Z)
• Unsupervised Domain Adaptation for Self-Driving from Past Traversal Features [69.47588461101925]
  We propose a method to adapt 3D object detectors to new driving environments. Our approach enhances LiDAR-based detection models using spatial quantized historical features. Experiments on real-world datasets demonstrate significant improvements.
  arXiv  Detail & Related papers  (2023-09-21T15:00:31Z)
• Unsupervised Adaptation from Repeated Traversals for Autonomous Driving [54.59577283226982]
  Self-driving cars must generalize to the end-user's environment to operate reliably. One potential solution is to leverage unlabeled data collected from the end-users' environments. There is no reliable signal in the target domain to supervise the adaptation process. We show that this simple additional assumption is sufficient to obtain a potent signal that allows us to perform iterative self-training of 3D object detectors on the target domain.
  arXiv  Detail & Related papers  (2023-03-27T15:07:55Z)
• Camera-Radar Perception for Autonomous Vehicles and ADAS: Concepts, Datasets and Metrics [77.34726150561087]
  This work aims to carry out a study on the current scenario of camera and radar-based perception for ADAS and autonomous vehicles. Concepts and characteristics related to both sensors, as well as to their fusion, are presented. We give an overview of the Deep Learning-based detection and segmentation tasks, and the main datasets, metrics, challenges, and open questions in vehicle perception.
  arXiv  Detail & Related papers  (2023-03-08T00:48:32Z)
• Verifiable Obstacle Detection [10.277825331268179]
  We present a safety verification of an existing LiDAR based classical obstacle detection algorithm. We provide a rigorous analysis of the obstacle detection system with empirical results based on real-world sensor data.
  arXiv  Detail & Related papers  (2022-08-30T17:15:35Z)
• Efficient and Robust LiDAR-Based End-to-End Navigation [132.52661670308606]
  We present an efficient and robust LiDAR-based end-to-end navigation framework. We propose Fast-LiDARNet that is based on sparse convolution kernel optimization and hardware-aware model design. We then propose Hybrid Evidential Fusion that directly estimates the uncertainty of the prediction from only a single forward pass.
  arXiv  Detail & Related papers  (2021-05-20T17:52:37Z)
• Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detection [55.12894776039135]
  State-of-the-art 3D object detectors, based on deep learning, have shown promising accuracy but are prone to over-fit to domain idiosyncrasies. We propose a novel learning approach that drastically reduces this gap by fine-tuning the detector on pseudo-labels in the target domain. We show, on five autonomous driving datasets, that fine-tuning the detector on these pseudo-labels substantially reduces the domain gap to new driving environments.
  arXiv  Detail & Related papers  (2021-03-26T01:18:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.