Generating Maximal Configurations and Their Variants Using Code Metrics
- URL: http://arxiv.org/abs/2401.07898v1
- Date: Mon, 15 Jan 2024 18:58:22 GMT
- Title: Generating Maximal Configurations and Their Variants Using Code Metrics
- Authors: Tuba Yavuz (1), Chin Khor (2), Ken (Yihang) Bai (1), Robyn Lutz (2)
((1) University of Florida, (2) Iowa State University)
- Abstract summary: We present new configuration-generation algorithms that leverage constraint solving (SAT and MaxSAT) and configuration fuzzing.
We show that our MaxSAT-based configuration generation achieves better coverage for several code metrics.
Results also show that, when high coverage of multiple configurations is needed, CONFIZZ's presence-condition fuzzing outperforms alternatives.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Testing configurable systems continues to be challenging and costly.
Generation of configurations for testing tends to use either techniques based
on semantic sampling (e.g., logical formulas over configuration variables,
often called presence conditions) or structural code metrics (e.g., code
coverage). In this paper we describe our hybrid approaches that combine these
two kinds of techniques to good effect. We present new configuration-generation
algorithms that leverage constraint solving (SAT and MaxSAT) and configuration
fuzzing, and implement our approach in a configuration-generation framework,
CONFIZZ. CONFIZZ both enables the generation of maximal configurations (maximal
sets of presence conditions that can be satisfied together) and performs
code-metric guided configuration fuzzing. Results from evaluation on BusyBox, a
highly configurable benchmark, show that our MaxSAT-based configuration
generation achieves better coverage for several code metrics. Results also show
that, when high coverage of multiple configurations is needed, CONFIZZ's
presence-condition fuzzing outperforms alternatives.
Related papers
- Efficient Multi-Instance Generation with Janus-Pro-Dirven Prompt Parsing [53.295515505026096]
Janus-Pro-driven Prompt Parsing is a prompt- parsing module that bridges text understanding and layout generation.
MIGLoRA is a parameter-efficient plug-in integrating Low-Rank Adaptation into UNet (SD1.5) and DiT (SD3) backbones.
The proposed method achieves state-of-the-art performance on COCO and LVIS benchmarks while maintaining parameter efficiency.
arXiv Detail & Related papers (2025-03-27T00:59:14Z) - PANTHER: Pluginizable Testing Environment for Network Protocols [1.7965226171103972]
PANTHER is a modular framework for testing network protocols and formally verifying their specification.
Its modular design validates complex protocol properties, adapts to dynamic behaviors, and facilitates seamless plugin integration for scalability.
arXiv Detail & Related papers (2025-03-04T08:56:03Z) - DynamicControl: Adaptive Condition Selection for Improved Text-to-Image Generation [63.63429658282696]
We propose DynamicControl, which supports dynamic combinations of diverse control signals.
We show that DynamicControl is superior to existing methods in terms of controllability, generation quality and composability under various conditional controls.
arXiv Detail & Related papers (2024-12-04T11:54:57Z) - Scaling LLM Inference with Optimized Sample Compute Allocation [56.524278187351925]
We propose OSCA, an algorithm to find an optimal mix of different inference configurations.
Our experiments show that with our learned mixed allocation, we can achieve accuracy better than the best single configuration.
OSCA is also shown to be effective in agentic beyond single-turn tasks, achieving a better accuracy on SWE-Bench with 3x less compute than the default configuration.
arXiv Detail & Related papers (2024-10-29T19:17:55Z) - fSEAD: a Composable FPGA-based Streaming Ensemble Anomaly Detection Library [1.8570740863168362]
Machine learning ensembles combine multiple base models to produce a more accurate output.
We propose a flexible computing architecture consisting of multiple partially reconfigurable regions, pblocks, which each implement anomaly detectors.
Our proof-of-concept design supports three state-of-the-art anomaly detection algorithms: Loda, RS-Hash and xStream.
arXiv Detail & Related papers (2024-06-10T03:38:35Z) - Algebraic Positional Encodings [7.0975366862235445]
We introduce a novel positional encoding strategy for Transformer-style models, addressing the shortcomings of existing, often ad hoc, approaches.
We conduct a series of experiments to demonstrate the practical applicability of our approach.
Results suggest performance on par with or surpassing the current state-of-the-art.
arXiv Detail & Related papers (2023-12-26T13:17:25Z) - GNBG: A Generalized and Configurable Benchmark Generator for Continuous
Numerical Optimization [5.635586285644365]
It is crucial to use a benchmark test suite that encompasses a diverse range of problem instances with various characteristics.
Traditional benchmark suites often consist of numerous fixed test functions, making it challenging to align these with specific research objectives.
This paper introduces the Generalized Numerical Benchmark Generator (GNBG) for single-objective, box-constrained, continuous numerical optimization.
arXiv Detail & Related papers (2023-12-12T09:04:34Z) - Solving Multi-Configuration Problems: A Performance Analysis with Choco
Solver [49.712444772173775]
In this paper, we exemplify the application of multi-configuration for generating individualized exams.
We also provide a constraint solver performance analysis which helps to gain some insights into corresponding performance issues.
arXiv Detail & Related papers (2023-10-04T08:34:32Z) - Exploiting Configurations of MaxSAT Solvers [0.0]
We describe how these configurations can be computed in the context of MaxSAT.
In particular, we experimentally show how to easily combine configurations of a non-competitive solver to obtain a better solving approach.
arXiv Detail & Related papers (2023-06-13T09:11:17Z) - Performance Optimization using Multimodal Modeling and Heterogeneous GNN [1.304892050913381]
We propose a technique for tuning parallel code regions that is general enough to be adapted to multiple tasks.
In this paper, we analyze IR-based programming models to make task-specific performance optimizations.
Our experiments show that this multimodal learning based approach outperforms the state-of-the-art in all experiments.
arXiv Detail & Related papers (2023-04-25T04:27:43Z) - Online Continuous Hyperparameter Optimization for Generalized Linear Contextual Bandits [55.03293214439741]
In contextual bandits, an agent sequentially makes actions from a time-dependent action set based on past experience.
We propose the first online continuous hyperparameter tuning framework for contextual bandits.
We show that it could achieve a sublinear regret in theory and performs consistently better than all existing methods on both synthetic and real datasets.
arXiv Detail & Related papers (2023-02-18T23:31:20Z) - SFNet: Faster and Accurate Semantic Segmentation via Semantic Flow [88.97790684009979]
A common practice to improve the performance is to attain high-resolution feature maps with strong semantic representation.
We propose a Flow Alignment Module (FAM) to learn textitSemantic Flow between feature maps of adjacent levels.
We also present a novel Gated Dual Flow Alignment Module to directly align high-resolution feature maps and low-resolution feature maps.
arXiv Detail & Related papers (2022-07-10T08:25:47Z) - Tree ensemble kernels for Bayesian optimization with known constraints
over mixed-feature spaces [54.58348769621782]
Tree ensembles can be well-suited for black-box optimization tasks such as algorithm tuning and neural architecture search.
Two well-known challenges in using tree ensembles for black-box optimization are (i) effectively quantifying model uncertainty for exploration and (ii) optimizing over the piece-wise constant acquisition function.
Our framework performs as well as state-of-the-art methods for unconstrained black-box optimization over continuous/discrete features and outperforms competing methods for problems combining mixed-variable feature spaces and known input constraints.
arXiv Detail & Related papers (2022-07-02T16:59:37Z) - An Efficient Diagnosis Algorithm for Inconsistent Constraint Sets [68.8204255655161]
We introduce a divide-and-conquer based diagnosis algorithm (FastDiag) which identifies minimal sets of faulty constraints in an over-constrained problem.
We compare FastDiag with the conflict-directed calculation of hitting sets and present an in-depth performance analysis.
arXiv Detail & Related papers (2021-02-17T19:55:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.