From Research to Practice: An Interactive Rapid Review of Autonomous Driving System Testing in Industry
- URL: http://arxiv.org/abs/2605.00531v1
- Date: Fri, 01 May 2026 09:13:03 GMT
- Title: From Research to Practice: An Interactive Rapid Review of Autonomous Driving System Testing in Industry
- Abstract summary: Autonomous driving systems (ADS) are increasingly deployed in real traffic, yet testing remains fundamentally challenging.<n>Despite extensive research, a gap persists between academic advances and their applicability in industrial practice.<n>This study provides the first practitioner-driven review and evaluation of current ADS testing research.
- Score: 4.424336158797069
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Autonomous driving systems (ADS) are increasingly deployed in real traffic, yet testing remains fundamentally challenging due to open environments, complex scenarios, and the lack of established processes and metrics. Despite extensive research, a gap persists between academic advances and their applicability in industrial practice. To address this, we conduct an interactive rapid review in collaboration with 21 practitioners from a leading automotive company. Practitioners identified 12 key challenges in ADS testing, and prioritised two as the most critical issues, namely approaches to and completeness of testing for End-to-End (E2E) ADS. We analyzed 17 research studies relevant to these two challenges, most of which focus on generating critical testing scenarios, and subsequently assessed their relevance and applicability in practice. Our study provides the first practitioner-driven review and evaluation of current ADS testing research, reveals practical challenges in ADS testing, offers rapid insights for practitioners, and highlights the need for more context-aware, industry-relevant solutions to bridge the gap between research and practice.
Related papers
- In the Driver's Seat: A Multi-Company Study on the Reality of Autonomous Driving System Testing [9.65830001261678]
Autonomous driving systems (ADS) are rapidly advancing and increasingly deployed in real-world applications.<n>ADS testing remains complex and lacks well-established standards for scenario selection, performance evaluation, and acceptance criteria.<n>This study conducted an interview study with experts working on ADS development and testing in nine companies from six different countries.
arXiv Detail & Related papers (2026-07-17T10:28:42Z) - Benchmarking AI Agents for Addressing Scientific Challenges Across Scales [118.2204632627895]
SciAgentArena is a systematic benchmark for evaluating AI agents in real-world scientific research scenarios.<n>It comprises approximately 200 tasks with stepwise verification and an interactive, agent-agnostic environment for assessing diverse AI agents.<n>We find that current agents can contribute effectively to well-specified data-analysis, particularly when the task structure and evaluation criteria are clear.
arXiv Detail & Related papers (2026-06-10T22:55:30Z) - Aligning Academia with Industry: An Empirical Study of Industrial Needs and Academic Capabilities in AI-Driven Software Engineering [45.09204791294318]
The rapid advancement of large language models (LLMs) is fundamentally reshaping software engineering (SE)<n>While top-tier SE venues continue to show sustained or emerging focus on areas like automated testing and program repair, the alignment of these academic advances with real industrial needs remains unclear.<n>This study aims to refocus academic attention on these important yet under-explored problems and to guide future SE research toward greater industrial impact.
arXiv Detail & Related papers (2025-12-17T07:29:18Z) - Let the Barbarians In: How AI Can Accelerate Systems Performance Research [80.43506848683633]
We term this iterative cycle of generation, evaluation, and refinement AI-Driven Research for Systems.<n>We demonstrate that ADRS-generated solutions can match or even outperform human state-of-the-art designs.
arXiv Detail & Related papers (2025-12-16T18:51:23Z) - Advancing Autonomous Driving System Testing: Demands, Challenges, and Future Directions [16.701909787572724]
Autonomous driving systems (ADSs) promise improved transportation efficiency and safety, yet ensuring their reliability in complex real-world environments remains a critical challenge.<n>This study investigates current ADS testing practices for both modular and end-to-end systems.<n>We review major testing techniques and consider emerging factors such as Vehicle-to-Everything (V2X) communication and foundation models.
arXiv Detail & Related papers (2025-12-09T06:33:27Z) - Generative AI for Testing of Autonomous Driving Systems: A Survey [13.226510198306885]
Autonomous driving systems (ADS) have been an active area of research, with the potential to deliver significant benefits to society.<n>Different testing approaches are required, and achieving effective and efficient testing of ADS remains an open challenge.<n>generative AI has emerged as a powerful tool across many domains, and it is increasingly being applied to ADS testing due to its ability to interpret context.<n>This survey provides an overview and practical insights into the use of generative AI for testing ADS, highlights existing challenges, and outlines directions for future research in this rapidly evolving field.
arXiv Detail & Related papers (2025-08-27T13:40:14Z) - A Survey on Web Testing: On the Rise of AI and Applications in Industry [1.5149438988761574]
This paper presents a systematic literature survey focusing on web testing methodologies, tools, and trends from 2014 to 2025.<n>By analyzing 259 research papers, the survey identifies key trends, demographics, contributions, tools, challenges, and innovations in this domain.
arXiv Detail & Related papers (2025-03-07T12:39:59Z) - TrialBench: Multi-Modal Artificial Intelligence-Ready Clinical Trial Datasets [54.98321887435557]
This paper presents a suite of 23 meticulously curated AI-ready datasets covering multi-modal input features and 8 crucial prediction challenges in clinical trial design.<n>We provide basic validation methods for each task to ensure the datasets' usability and reliability.<n>We anticipate that the availability of such open-access datasets will catalyze the development of advanced AI approaches for clinical trial design.
arXiv Detail & Related papers (2024-06-30T09:13:10Z) - Industry Practices for Challenging Autonomous Driving Systems with
Critical Scenarios [2.42477526148542]
Testing autonomous driving systems for safety and reliability is extremely complex.
There are several proposed methods and tools for critical scenario identification.
The industry practices, such as the selection, implementation, and limitations of the approaches, are not well understood.
arXiv Detail & Related papers (2023-05-23T15:13:11Z) - The Technological Emergence of AutoML: A Survey of Performant Software
and Applications in the Context of Industry [72.10607978091492]
Automated/Autonomous Machine Learning (AutoML/AutonoML) is a relatively young field.
This review makes two primary contributions to knowledge around this topic.
It provides the most up-to-date and comprehensive survey of existing AutoML tools, both open-source and commercial.
arXiv Detail & Related papers (2022-11-08T10:42:08Z) - Artificial Intelligence for IT Operations (AIOPS) Workshop White Paper [50.25428141435537]
Artificial Intelligence for IT Operations (AIOps) is an emerging interdisciplinary field arising in the intersection between machine learning, big data, streaming analytics, and the management of IT operations.
Main aim of the AIOPS workshop is to bring together researchers from both academia and industry to present their experiences, results, and work in progress in this field.
arXiv Detail & Related papers (2021-01-15T10:43:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.