Towards Assessing Spread in Sets of Software Architecture Designs
- URL: http://arxiv.org/abs/2402.19171v1
- Date: Thu, 29 Feb 2024 13:52:39 GMT
- Title: Towards Assessing Spread in Sets of Software Architecture Designs
- Authors: Vittorio Cortellessa, J. Andres Diaz-Pace, Daniele Di Pompeo, Michele
Tucci
- Abstract summary: We propose a quality indicator for the spread that assesses the diversity of alternatives by taking into account architectural features.
We demonstrate how our architectural quality indicator can be applied to a dataset from the literature.
- Score: 2.2120851074630177
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Several approaches have recently used automated techniques to generate
architecture design alternatives by means of optimization techniques. These
approaches aim at improving an initial architecture with respect to quality
aspects, such as performance, reliability, or maintainability. In this context,
each optimization experiment usually produces a different set of architecture
alternatives that is characterized by specific settings. As a consequence, the
designer is left with the task of comparing such sets to identify the settings
that lead to better solution sets for the problem. To assess the quality of
solution sets, multi-objective optimization commonly relies on quality
indicators. Among these, the quality indicator for the maximum spread estimates
the diversity of the generated alternatives, providing a measure of how much of
the solution space has been explored. However, the maximum spread indicator is
computed only on the objective space and does not consider architectural
information (e.g., components structure, design decisions) from the
architectural space. In this paper, we propose a quality indicator for the
spread that assesses the diversity of alternatives by taking into account
architectural features. To compute the spread, we rely on a notion of distance
between alternatives according to the way they were generated during the
optimization. We demonstrate how our architectural quality indicator can be
applied to a dataset from the literature.
Related papers
- From Requirements to Architecture: An AI-Based Journey to
Semi-Automatically Generate Software Architectures [2.4150871564195007]
We propose a method to generate software architecture candidates based on requirements using artificial intelligence techniques.
We further envision an automatic evaluation and trade-off analysis of the generated architecture candidates.
arXiv Detail & Related papers (2024-01-25T10:56:58Z) - Interactive Multi-Objective Evolutionary Optimization of Software
Architectures [0.0]
Putting the human in the loop brings new challenges to the search-based software engineering field.
This paper explores how the interactive evolutionary computation can serve as a basis for integrating the human's judgment into the search process.
arXiv Detail & Related papers (2024-01-08T19:15:40Z) - Rethinking and Benchmarking Predict-then-Optimize Paradigm for
Combinatorial Optimization Problems [62.25108152764568]
Many web applications rely on solving optimization problems, such as energy cost-aware scheduling, budget allocation on web advertising, and graph matching on social networks.
We consider the performance of prediction and decision-making in a unified system.
We provide a comprehensive categorization of current approaches and integrate existing experimental scenarios.
arXiv Detail & Related papers (2023-11-13T13:19:34Z) - Introducing Interactions in Multi-Objective Optimization of Software
Architectures [2.920908475492581]
This study investigates the impact of designer interactions on software architecture optimization.
By directing the search towards regions of interest, the interaction uncovers architectures that remain unexplored in the fully automated process.
arXiv Detail & Related papers (2023-08-29T07:49:46Z) - Quality Indicators for Preference-based Evolutionary Multi-objective
Optimization Using a Reference Point: A Review and Analysis [5.074835777266041]
Some quality indicators have been proposed for benchmarking preference-based evolutionary multi-objective optimization algorithms.
This paper reviews existing regions of interest and quality indicators for preference-based evolutionary multi-objective optimization using the reference point.
We show that the ranking of preference-based evolutionary multi-objective optimization algorithms depends on the choice of quality indicators.
arXiv Detail & Related papers (2023-01-28T10:21:37Z) - Multi-Agent Reinforcement Learning for Microprocessor Design Space
Exploration [71.95914457415624]
Microprocessor architects are increasingly resorting to domain-specific customization in the quest for high-performance and energy-efficiency.
We propose an alternative formulation that leverages Multi-Agent RL (MARL) to tackle this problem.
Our evaluation shows that the MARL formulation consistently outperforms single-agent RL baselines.
arXiv Detail & Related papers (2022-11-29T17:10:24Z) - Slimmable Domain Adaptation [112.19652651687402]
We introduce a simple framework, Slimmable Domain Adaptation, to improve cross-domain generalization with a weight-sharing model bank.
Our framework surpasses other competing approaches by a very large margin on multiple benchmarks.
arXiv Detail & Related papers (2022-06-14T06:28:04Z) - Rethinking Architecture Selection in Differentiable NAS [74.61723678821049]
Differentiable Neural Architecture Search is one of the most popular NAS methods for its search efficiency and simplicity.
We propose an alternative perturbation-based architecture selection that directly measures each operation's influence on the supernet.
We find that several failure modes of DARTS can be greatly alleviated with the proposed selection method.
arXiv Detail & Related papers (2021-08-10T00:53:39Z) - iDARTS: Differentiable Architecture Search with Stochastic Implicit
Gradients [75.41173109807735]
Differentiable ARchiTecture Search (DARTS) has recently become the mainstream of neural architecture search (NAS)
We tackle the hypergradient computation in DARTS based on the implicit function theorem.
We show that the architecture optimisation with the proposed method, named iDARTS, is expected to converge to a stationary point.
arXiv Detail & Related papers (2021-06-21T00:44:11Z) - Pareto-Frontier-aware Neural Architecture Generation for Diverse Budgets [93.79297053429447]
Existing methods often perform an independent architecture search for each target budget.
We propose a general architecture generator that automatically produces effective architectures for an arbitrary budget merely via model inference.
Extensive experiments on three platforms (i.e., mobile, CPU, and GPU) show the superiority of the proposed method over existing NAS methods.
arXiv Detail & Related papers (2021-02-27T13:59:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.