LONViZ: Unboxing the black-box of Configurable Software Systems from a
Complex Networks Perspective
- URL: http://arxiv.org/abs/2201.01429v1
- Date: Wed, 5 Jan 2022 03:14:39 GMT
- Title: LONViZ: Unboxing the black-box of Configurable Software Systems from a
Complex Networks Perspective
- Authors: Ke Li, Peili Mao, Tao Chen
- Abstract summary: This paper proposes a tool, dubbed LONViZ, to facilitate the exploratory analysis of black-boxconfigured software systems.
In experiments, we choose four widely used real-world software systems to develop benchmark platforms under 42 different running environments.
We find that LONViZ enables both qualitative and quantitative analysis and disclose various interesting hidden patterns and properties of different software systems.
- Score: 9.770775293243934
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Most, if not all, modern software systems are highly configurable to tailor
both their functional and non-functional properties to a variety of
stakeholders. Due to the black-box nature, it is difficult, if not impossible,
to analyze and understand its behavior, such as the interaction between
combinations of configuration options with regard to the performance, in
particular, which is of great importance to advance the controllability of the
underlying software system. This paper proposes a tool, dubbed LONViZ, which is
the first of its kind, to facilitate the exploratory analysis of black-box
configurable software systems. It starts from a systematic sampling over the
configuration space of the underlying system. Then LONViZ seeks to construct a
structurally stable LON by synthesizing multiple repeats of sampling results.
Finally, exploratory analysis can be conducted on the stable LON from both
qualitative and quantitative perspectives. In experiments, we choose four
widely used real-world configurable software systems to develop benchmark
platforms under 42 different running environments. From our empirical study, we
find that LONViZ enables both qualitative and quantitative analysis and
disclose various interesting hidden patterns and properties of different
software systems.
Related papers
- Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs [56.391404083287235]
We introduce Cambrian-1, a family of multimodal LLMs (MLLMs) designed with a vision-centric approach.
Our study uses LLMs and visual instruction tuning as an interface to evaluate various visual representations.
We provide model weights, code, supporting tools, datasets, and detailed instruction-tuning and evaluation recipes.
arXiv Detail & Related papers (2024-06-24T17:59:42Z) - BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation [57.40024206484446]
We introduce the BEHAVIOR Vision Suite (BVS), a set of tools and assets to generate fully customized synthetic data for systematic evaluation of computer vision models.
BVS supports a large number of adjustable parameters at the scene level.
We showcase three example application scenarios.
arXiv Detail & Related papers (2024-05-15T17:57:56Z) - GNBG: A Generalized and Configurable Benchmark Generator for Continuous
Numerical Optimization [5.635586285644365]
It is crucial to use a benchmark test suite that encompasses a diverse range of problem instances with various characteristics.
Traditional benchmark suites often consist of numerous fixed test functions, making it challenging to align these with specific research objectives.
This paper introduces the Generalized Numerical Benchmark Generator (GNBG) for single-objective, box-constrained, continuous numerical optimization.
arXiv Detail & Related papers (2023-12-12T09:04:34Z) - Can LLMs Configure Software Tools [0.76146285961466]
In software engineering, the meticulous configuration of software tools is crucial in ensuring optimal performance within intricate systems.
In this study, we embark on an exploration of leveraging Large-Language Models (LLMs) to streamline the software configuration process.
Our work presents a novel approach that employs LLMs, such as Chat-GPT, to identify starting conditions and narrow down the search space, improving configuration efficiency.
arXiv Detail & Related papers (2023-12-11T05:03:02Z) - Multilayer Environment and Toolchain for Holistic NetwOrk Design and Analysis [2.7763199324745966]
This work analyses in detail the requirements for distributed systems assessment.
Our approach emphasizes setting up and assessing a broader spectrum of distributed systems.
We demonstrate the framework's capabilities to provide valuable insights across various use cases.
arXiv Detail & Related papers (2023-10-24T21:18:25Z) - Unicorn: Reasoning about Configurable System Performance through the
lens of Causality [12.877523121932114]
We propose a new method, called Unicorn, which captures intricate interactions between configuration options across the software- hardware stack.
Experiments indicate that Unicorn outperforms state-of-the-art performance optimization and debug methods.
Unlike the existing methods, the learned causal performance models reliably predict performance for new environments.
arXiv Detail & Related papers (2022-01-20T19:16:50Z) - An Overview of Recommender Systems and Machine Learning in Feature
Modeling and Configuration [55.67505546330206]
We give an overview of a potential new line of research which is related to the application of recommender systems and machine learning techniques.
In this paper, we give examples of the application of recommender systems and machine learning and discuss future research issues.
arXiv Detail & Related papers (2021-02-12T17:21:36Z) - DISPATCH: Design Space Exploration of Cyber-Physical Systems [5.273291582861981]
Design of cyber-physical systems (CPSs) is a challenging task that involves searching over a large search space of various CPS configurations.
We propose DIS, a two-step methodology for sample-efficient search over the design space.
arXiv Detail & Related papers (2020-09-21T23:14:51Z) - Integrated Benchmarking and Design for Reproducible and Accessible
Evaluation of Robotic Agents [61.36681529571202]
We describe a new concept for reproducible robotics research that integrates development and benchmarking.
One of the central components of this setup is the Duckietown Autolab, a standardized setup that is itself relatively low-cost and reproducible.
We validate the system by analyzing the repeatability of experiments conducted using the infrastructure and show that there is low variance across different robot hardware and across different remote labs.
arXiv Detail & Related papers (2020-09-09T15:31:29Z) - BUSTLE: Bottom-Up Program Synthesis Through Learning-Guided Exploration [72.88493072196094]
We present a new synthesis approach that leverages learning to guide a bottom-up search over programs.
In particular, we train a model to prioritize compositions of intermediate values during search conditioned on a set of input-output examples.
We show that the combination of learning and bottom-up search is remarkably effective, even with simple supervised learning approaches.
arXiv Detail & Related papers (2020-07-28T17:46:18Z) - NAS-Count: Counting-by-Density with Neural Architecture Search [74.92941571724525]
We automate the design of counting models with Neural Architecture Search (NAS)
We introduce an end-to-end searched encoder-decoder architecture, Automatic Multi-Scale Network (AMSNet)
arXiv Detail & Related papers (2020-02-29T09:18:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.