Using Neural Networks for Novelty-based Test Selection to Accelerate
Functional Coverage Closure
- URL: http://arxiv.org/abs/2207.00445v3
- Date: Wed, 14 Jun 2023 21:53:05 GMT
- Title: Using Neural Networks for Novelty-based Test Selection to Accelerate
Functional Coverage Closure
- Authors: Xuan Zheng, Kerstin Eder and Tim Blackmore
- Abstract summary: This paper presents a highly-automated framework for novel test selection based on neural networks.
Three configurations of this framework are tested with a commercial signal processing unit.
All three convincingly outperform random test selection with the largest saving of simulation being 49.37% to reach 99.5% coverage.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Novel test selectors used in simulation-based verification have been shown to
significantly accelerate coverage closure regardless of the number of coverage
holes. This paper presents a configurable and highly-automated framework for
novel test selection based on neural networks. Three configurations of this
framework are tested with a commercial signal processing unit. All three
convincingly outperform random test selection with the largest saving of
simulation being 49.37% to reach 99.5% coverage. The computational expense of
the configurations is negligible compared to the simulation reduction. We
compare the experimental results and discuss important characteristics related
to the performance of the configurations.
Related papers
- Unveiling the Power of Sparse Neural Networks for Feature Selection [60.50319755984697]
Sparse Neural Networks (SNNs) have emerged as powerful tools for efficient feature selection.
We show that SNNs trained with dynamic sparse training (DST) algorithms can achieve, on average, more than $50%$ memory and $55%$ FLOPs reduction.
Our findings show that feature selection with SNNs trained with DST algorithms can achieve, on average, more than $50%$ memory and $55%$ FLOPs reduction.
arXiv Detail & Related papers (2024-08-08T16:48:33Z) - Detecting Stimuli with Novel Temporal Patterns to Accelerate Functional Coverage Closure [0.7499722271664147]
This paper introduces two novel test selectors designed to identify stimuli with novel temporal patterns.
Experiments reveal that both test selectors can accelerate the functional coverage for a commercial bus bridge, compared to random test selection.
arXiv Detail & Related papers (2024-06-19T15:00:02Z) - TENNs-PLEIADES: Building Temporal Kernels with Orthogonal Polynomials [1.1970409518725493]
We focus on interfacing these networks with event-based data to perform online classification and detection with low latency.
We experimented with three event-based benchmarks and obtained state-of-the-art results on all three by large margins with significantly smaller memory and compute costs.
arXiv Detail & Related papers (2024-05-20T17:06:24Z) - Multilayer Multiset Neuronal Networks -- MMNNs [55.2480439325792]
The present work describes multilayer multiset neuronal networks incorporating two or more layers of coincidence similarity neurons.
The work also explores the utilization of counter-prototype points, which are assigned to the image regions to be avoided.
arXiv Detail & Related papers (2023-08-28T12:55:13Z) - Adaptive Siamese Tracking with a Compact Latent Network [219.38172719948048]
We present an intuitive viewing to simplify the Siamese-based trackers by converting the tracking task to a classification.
Under this viewing, we perform an in-depth analysis for them through visual simulations and real tracking examples.
We apply it to adjust three classical Siamese-based trackers, namely SiamRPN++, SiamFC, and SiamBAN.
arXiv Detail & Related papers (2023-02-02T08:06:02Z) - Layer Ensembles [95.42181254494287]
We introduce a method for uncertainty estimation that considers a set of independent categorical distributions for each layer of the network.
We show that the method can be further improved by ranking samples, resulting in models that require less memory and time to run.
arXiv Detail & Related papers (2022-10-10T17:52:47Z) - Automatic Neural Network Hyperparameter Optimization for Extrapolation:
Lessons Learned from Visible and Near-Infrared Spectroscopy of Mango Fruit [7.462336024223667]
This paper considers automatic methods for configuring a neural network that extrapolates in time for the domain of visible and near-infrared (VNIR) spectroscopy.
To encourage the neural network model to extrapolate, we consider validating model configurations on samples that are shifted in time similar to the test set.
We find that ensembling improves the state-of-the-art model's variance and accuracy.
arXiv Detail & Related papers (2022-10-03T00:41:05Z) - Hybrid Intelligent Testing in Simulation-Based Verification [0.0]
Several millions of tests may be required to achieve coverage goals.
Coverage-Directed Test Selection learns from coverage feedback to bias testing towards the most effective tests.
Novelty-Driven Verification learns to identify and simulate stimuli that differ from previous stimuli.
arXiv Detail & Related papers (2022-05-19T13:22:08Z) - Supervised Learning for Coverage-Directed Test Selection in
Simulation-Based Verification [0.0]
We introduce a novel method for automatic constraint extraction and test selection.
Coverage-directed test selection is based on supervised learning from coverage feedback.
We show how coverage-directed test selection can reduce manual constraint writing, prioritise effective tests, reduce verification resource consumption, and accelerate coverage closure on a large, real-life industrial hardware design.
arXiv Detail & Related papers (2022-05-17T17:49:30Z) - Adversarial Examples Detection with Bayesian Neural Network [57.185482121807716]
We propose a new framework to detect adversarial examples motivated by the observations that random components can improve the smoothness of predictors.
We propose a novel Bayesian adversarial example detector, short for BATer, to improve the performance of adversarial example detection.
arXiv Detail & Related papers (2021-05-18T15:51:24Z) - Noisy Adaptive Group Testing using Bayesian Sequential Experimental
Design [63.48989885374238]
When the infection prevalence of a disease is low, Dorfman showed 80 years ago that testing groups of people can prove more efficient than testing people individually.
Our goal in this paper is to propose new group testing algorithms that can operate in a noisy setting.
arXiv Detail & Related papers (2020-04-26T23:41:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.