Wasserstein Generative Adversarial Networks for Online Test Generation
for Cyber Physical Systems
- URL: http://arxiv.org/abs/2205.11060v1
- Date: Mon, 23 May 2022 05:58:28 GMT
- Title: Wasserstein Generative Adversarial Networks for Online Test Generation
for Cyber Physical Systems
- Authors: Jarkko Peltom\"aki, Frankie Spencer, Ivan Porres
- Abstract summary: We propose a novel online test generation algorithm WOGAN based on Wasserstein Generative Adversarial Networks.
WOGAN is a general-purpose black-box test generator applicable to any system under test having a fitness function for determining failing tests.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose a novel online test generation algorithm WOGAN based on
Wasserstein Generative Adversarial Networks. WOGAN is a general-purpose
black-box test generator applicable to any system under test having a fitness
function for determining failing tests. As a proof of concept, we evaluate
WOGAN by generating roads such that a lane assistance system of a car fails to
stay on the designated lane. We find that our algorithm has a competitive
performance respect to previously published algorithms.
Related papers
- Learning test generators for cyber-physical systems [2.4171019220503402]
Black-box runtime verification methods for cyber-physical systems can be used to discover errors in systems whose inputs and outputs are expressed as signals over time.
Existing methods, such as requirement falsification, often focus on finding a single input that is a counterexample to system correctness.
We show how to create test generators that can produce multiple and diverse counterexamples for a single requirement.
arXiv Detail & Related papers (2024-10-04T07:34:02Z) - Benchmarking ChatGPT on Algorithmic Reasoning [58.50071292008407]
We evaluate ChatGPT's ability to solve algorithm problems from the CLRS benchmark suite that is designed for GNNs.
We find that ChatGPT outperforms specialist GNN models, using Python to successfully solve these problems.
arXiv Detail & Related papers (2024-04-04T13:39:06Z) - Requirement falsification for cyber-physical systems using generative
models [1.90365714903665]
OGAN can find inputs that are counterexamples for the safety of a system revealing design, software, or hardware defects before the system is taken into operation.
OGAN executes tests atomically and does not require any previous model of the system under test.
OGAN can be applied to new systems with little effort, has few requirements for the system under test, and exhibits state-of-the-art CPS falsification efficiency and effectiveness.
arXiv Detail & Related papers (2023-10-31T14:32:54Z) - Reinforcement learning informed evolutionary search for autonomous
systems testing [15.210312666486029]
We propose augmenting the evolutionary search (ES) with a reinforcement learning (RL) agent trained using surrogate rewards derived from domain knowledge.
In our approach, known as RIGAA, we first train an RL agent to learn useful constraints of the problem and then use it to produce a certain part of the initial population of the search algorithm.
We evaluate RIGAA on two case studies: maze generation for an autonomous ant robot and road topology generation for an autonomous vehicle lane keeping assist system.
arXiv Detail & Related papers (2023-08-24T13:11:07Z) - The Cascaded Forward Algorithm for Neural Network Training [61.06444586991505]
We propose a new learning framework for neural networks, namely Cascaded Forward (CaFo) algorithm, which does not rely on BP optimization as that in FF.
Unlike FF, our framework directly outputs label distributions at each cascaded block, which does not require generation of additional negative samples.
In our framework each block can be trained independently, so it can be easily deployed into parallel acceleration systems.
arXiv Detail & Related papers (2023-03-17T02:01:11Z) - Machine Learning Testing in an ADAS Case Study Using
Simulation-Integrated Bio-Inspired Search-Based Testing [7.5828169434922]
Deeper generates failure-revealing test scenarios for testing a deep neural network-based lane-keeping system.
In the newly proposed version, we utilize a new set of bio-inspired search algorithms, genetic algorithm (GA), $(mu+lambda)$ and $(mu,lambda)$ evolution strategies (ES), and particle swarm optimization (PSO)
Our evaluation shows the newly proposed test generators in Deeper represent a considerable improvement on the previous version.
arXiv Detail & Related papers (2022-03-22T20:27:40Z) - Waypoint Planning Networks [66.72790309889432]
We propose a hybrid algorithm based on LSTMs with a local kernel - a classic algorithm such as A*, and a global kernel using a learned algorithm.
We compare WPN against A*, as well as related works including motion planning networks (MPNet) and value networks (VIN)
It is shown that WPN's search space is considerably less than A*, while being able to generate near optimal results.
arXiv Detail & Related papers (2021-05-01T18:02:01Z) - Online GANs for Automatic Performance Testing [0.10312968200748115]
We present a novel algorithm for automatic performance testing that uses an online variant of the Generative Adversarial Network (GAN)
The proposed approach does not require a prior training set or model of the system under test.
We consider that the presented algorithm serves as a proof of concept and we hope that it can spark a research discussion on the application of GANs to test generation.
arXiv Detail & Related papers (2021-04-21T06:03:27Z) - Generating Correct Answers for Progressive Matrices Intelligence Tests [88.78821060331582]
Raven's Progressive Matrices are multiple-choice intelligence tests, where one tries to complete the missing location in a $3times 3$ grid of abstract images.
Previous attempts to address this test have focused solely on selecting the right answer out of the multiple choices.
In this work, we focus, instead, on generating a correct answer given the grid, without seeing the choices, which is a harder task, by definition.
arXiv Detail & Related papers (2020-11-01T13:21:07Z) - A Novel Anomaly Detection Algorithm for Hybrid Production Systems based
on Deep Learning and Timed Automata [73.38551379469533]
DAD:DeepAnomalyDetection is a new approach for automatic model learning and anomaly detection in hybrid production systems.
It combines deep learning and timed automata for creating behavioral model from observations.
The algorithm has been applied to few data sets including two from real systems and has shown promising results.
arXiv Detail & Related papers (2020-10-29T08:27:43Z) - Unsupervised Text Generation by Learning from Search [86.51619839836331]
TGLS is a novel framework to unsupervised Text Generation by Learning.
We demonstrate the effectiveness of TGLS on two real-world natural language generation tasks, paraphrase generation and text formalization.
arXiv Detail & Related papers (2020-07-09T04:34:48Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.