TEASER: Simulation-based CAN Bus Regression Testing for Self-driving
Cars Software
- URL: http://arxiv.org/abs/2307.03279v1
- Date: Thu, 6 Jul 2023 20:30:35 GMT
- Title: TEASER: Simulation-based CAN Bus Regression Testing for Self-driving
Cars Software
- Authors: Christian Birchler, Cyrill Rohrbach, Hyeongkyun Kim, Alessio Gambi,
Tianhai Liu, Jens Horneber, Timo Kehrer, Sebastiano Panichella
- Abstract summary: TEASER is a tool that generates realistic CAN signals for SDCs obtained from sensors from state-of-the-art car simulators.
We integrated TEASER in a Continous Integration (CI) pipeline configured with Jenkins.
Our evaluation shows the ability of TEASER to generate and execute CI test cases that expose simulation-based faults.
- Score: 5.77326389907799
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Software systems for safety-critical systems like self-driving cars (SDCs)
need to be tested rigorously. Especially electronic control units (ECUs) of
SDCs should be tested with realistic input data. In this context, a
communication protocol called Controller Area Network (CAN) is typically used
to transfer sensor data to the SDC control units. A challenge for SDC
maintainers and testers is the need to manually define the CAN inputs that
realistically represent the state of the SDC in the real world. To address this
challenge, we developed TEASER, which is a tool that generates realistic CAN
signals for SDCs obtained from sensors from state-of-the-art car simulators. We
evaluated TEASER based on its integration capability into a DevOps pipeline of
aicas GmbH, a company in the automotive sector. Concretely, we integrated
TEASER in a Continous Integration (CI) pipeline configured with Jenkins. The
pipeline executes the test cases in simulation environments and sends the
sensor data over the CAN bus to a physical CAN device, which is the test
subject. Our evaluation shows the ability of TEASER to generate and execute CI
test cases that expose simulation-based faults (using regression strategies);
the tool produces CAN inputs that realistically represent the state of the SDC
in the real world. This result is of critical importance for increasing
automation and effectiveness of simulation-based CAN bus regression testing for
SDC software. Tool: https://doi.org/10.5281/zenodo.7964890 GitHub:
https://github.com/christianbirchler-org/sdc-scissor/releases/tag/v2.2.0-rc.1
Documentation: https://sdc-scissor.readthedocs.io
Related papers
- Autonomous Vehicle Controllers From End-to-End Differentiable Simulation [60.05963742334746]
We propose a differentiable simulator and design an analytic policy gradients (APG) approach to training AV controllers.
Our proposed framework brings the differentiable simulator into an end-to-end training loop, where gradients of environment dynamics serve as a useful prior to help the agent learn a more grounded policy.
We find significant improvements in performance and robustness to noise in the dynamics, as well as overall more intuitive human-like handling.
arXiv Detail & Related papers (2024-09-12T11:50:06Z) - NeuroNCAP: Photorealistic Closed-loop Safety Testing for Autonomous Driving [19.709153559084093]
We present a versatile NeRF-based simulator for testing autonomous driving software systems.
The simulator learns from sequences of real-world driving sensor data.
We use our simulator to test the responses of AD models to safety-critical scenarios inspired by Euro NCAP.
arXiv Detail & Related papers (2024-04-11T14:03:16Z) - SensoDat: Simulation-based Sensor Dataset of Self-driving Cars [4.135985106933988]
SensoDat is a dataset of 32,580 executed simulation-based self-driving car test cases.
SensoDat provides data from 81 different simulated sensors.
arXiv Detail & Related papers (2024-01-18T08:57:53Z) - UniSim: A Neural Closed-Loop Sensor Simulator [76.79818601389992]
We present UniSim, a neural sensor simulator that takes a single recorded log captured by a sensor-equipped vehicle.
UniSim builds neural feature grids to reconstruct both the static background and dynamic actors in the scene.
We incorporate learnable priors for dynamic objects, and leverage a convolutional network to complete unseen regions.
arXiv Detail & Related papers (2023-08-03T17:56:06Z) - Generative AI-empowered Simulation for Autonomous Driving in Vehicular
Mixed Reality Metaverses [130.15554653948897]
In vehicular mixed reality (MR) Metaverse, distance between physical and virtual entities can be overcome.
Large-scale traffic and driving simulation via realistic data collection and fusion from the physical world is difficult and costly.
We propose an autonomous driving architecture, where generative AI is leveraged to synthesize unlimited conditioned traffic and driving data in simulations.
arXiv Detail & Related papers (2023-02-16T16:54:10Z) - VISTA 2.0: An Open, Data-driven Simulator for Multimodal Sensing and
Policy Learning for Autonomous Vehicles [131.2240621036954]
We present VISTA, an open source, data-driven simulator that integrates multiple types of sensors for autonomous vehicles.
Using high fidelity, real-world datasets, VISTA represents and simulates RGB cameras, 3D LiDAR, and event-based cameras.
We demonstrate the ability to train and test perception-to-control policies across each of the sensor types and showcase the power of this approach via deployment on a full scale autonomous vehicle.
arXiv Detail & Related papers (2021-11-23T18:58:10Z) - SilGAN: Generating driving maneuvers for scenario-based
software-in-the-loop testing [0.0]
SilGAN is a deep generative model that eases specification, stimulus generation, and automation of automotive software-in-the-loop testing.
The model is trained using data recorded from vehicles in the field.
arXiv Detail & Related papers (2021-07-05T07:17:49Z) - DriveGAN: Towards a Controllable High-Quality Neural Simulation [147.6822288981004]
We introduce a novel high-quality neural simulator referred to as DriveGAN.
DriveGAN achieves controllability by disentangling different components without supervision.
We train DriveGAN on multiple datasets, including 160 hours of real-world driving data.
arXiv Detail & Related papers (2021-04-30T15:30:05Z) - Digital Twins Are Not Monozygotic -- Cross-Replicating ADAS Testing in
Two Industry-Grade Automotive Simulators [13.386879259549305]
We show that SBST can be used to effectively and efficiently generate critical test scenarios in two simulators.
We find that executing the same test scenarios in the two simulators leads to notable differences in the details of the test outputs.
arXiv Detail & Related papers (2020-12-12T14:00:33Z) - Testing the Safety of Self-driving Vehicles by Simulating Perception and
Prediction [88.0416857308144]
We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps.
We directly simulate the outputs of the self-driving vehicle's perception and prediction system, enabling realistic motion planning testing.
arXiv Detail & Related papers (2020-08-13T17:20:02Z) - Towards Automated Safety Coverage and Testing for Autonomous Vehicles
with Reinforcement Learning [0.3683202928838613]
Validation puts the autonomous vehicle system to the test in scenarios or situations that the system would likely encounter in everyday driving.
We propose using reinforcement learning (RL) to generate failure examples and unexpected traffic situations for the AV software implementation.
arXiv Detail & Related papers (2020-05-22T19:00:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.