On the Impact of Applying Machine Learning in the Decision-Making of
Self-Adaptive Systems
- URL: http://arxiv.org/abs/2103.10194v1
- Date: Thu, 18 Mar 2021 11:59:50 GMT
- Title: On the Impact of Applying Machine Learning in the Decision-Making of
Self-Adaptive Systems
- Authors: Omid Gheibi, Danny Weyns, Federico Quin
- Abstract summary: We use computational learning theory to determine a theoretical bound on the impact of the machine learning method on the predictions made by the verifier.
To conclude, we look at opportunities for future research in this area.
- Score: 17.93069260609691
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Recently, we have been witnessing an increasing use of machine learning
methods in self-adaptive systems. Machine learning methods offer a variety of
use cases for supporting self-adaptation, e.g., to keep runtime models up to
date, reduce large adaptation spaces, or update adaptation rules. Yet, since
machine learning methods apply in essence statistical methods, they may have an
impact on the decisions made by a self-adaptive system. Given the wide use of
formal approaches to provide guarantees for the decisions made by self-adaptive
systems, it is important to investigate the impact of applying machine learning
methods when such approaches are used. In this paper, we study one particular
instance that combines linear regression to reduce the adaptation space of a
self-adaptive system with statistical model checking to analyze the resulting
adaptation options. We use computational learning theory to determine a
theoretical bound on the impact of the machine learning method on the
predictions made by the verifier. We illustrate and evaluate the theoretical
result using a scenario of the DeltaIoT artifact. To conclude, we look at
opportunities for future research in this area.
Related papers
- Unlearning with Control: Assessing Real-world Utility for Large Language Model Unlearning [97.2995389188179]
Recent research has begun to approach large language models (LLMs) unlearning via gradient ascent (GA)
Despite their simplicity and efficiency, we suggest that GA-based methods face the propensity towards excessive unlearning.
We propose several controlling methods that can regulate the extent of excessive unlearning.
arXiv Detail & Related papers (2024-06-13T14:41:00Z) - Self-consistent Validation for Machine Learning Electronic Structure [81.54661501506185]
Method integrates machine learning with self-consistent field methods to achieve both low validation cost and interpret-ability.
This, in turn, enables exploration of the model's ability with active learning and instills confidence in its integration into real-world studies.
arXiv Detail & Related papers (2024-02-15T18:41:35Z) - Machine unlearning through fine-grained model parameters perturbation [26.653596302257057]
We propose fine-grained Top-K and Random-k parameters perturbed inexact machine unlearning strategies.
We also tackle the challenge of evaluating the effectiveness of machine unlearning.
arXiv Detail & Related papers (2024-01-09T07:14:45Z) - Fairness Implications of Heterogeneous Treatment Effect Estimation with
Machine Learning Methods in Policy-making [0.0]
We argue that standard AI Fairness approaches for predictive machine learning are not suitable for all causal machine learning applications.
We argue that policy-making is best seen as a joint decision where the causal machine learning model usually only has indirect power.
arXiv Detail & Related papers (2023-09-02T03:06:14Z) - MACE: An Efficient Model-Agnostic Framework for Counterfactual
Explanation [132.77005365032468]
We propose a novel framework of Model-Agnostic Counterfactual Explanation (MACE)
In our MACE approach, we propose a novel RL-based method for finding good counterfactual examples and a gradient-less descent method for improving proximity.
Experiments on public datasets validate the effectiveness with better validity, sparsity and proximity.
arXiv Detail & Related papers (2022-05-31T04:57:06Z) - Predictive machine learning for prescriptive applications: a coupled
training-validating approach [77.34726150561087]
We propose a new method for training predictive machine learning models for prescriptive applications.
This approach is based on tweaking the validation step in the standard training-validating-testing scheme.
Several experiments with synthetic data demonstrate promising results in reducing the prescription costs in both deterministic and real models.
arXiv Detail & Related papers (2021-10-22T15:03:20Z) - Adaptive Learning on Time Series: Method and Financial Applications [0.0]
We use Adaptive Learning to forecast S&P 500 returns across multiple forecast horizons.
We find that Adaptive Learning models are on par with, if not better than, the best of the parametric models a posteriori.
We present a financial application of the learning results and an interpretation of the learning regime during the 2020 market crash.
arXiv Detail & Related papers (2021-10-21T13:59:54Z) - Towards Better Adaptive Systems by Combining MAPE, Control Theory, and
Machine Learning [16.998805882711864]
Two established approaches to engineer adaptive systems are architecture-based adaptation that uses a Monitor-Analysis-Planning-Executing loop, and control-based adaptation that relies on principles of control theory (CT) to realize adaptation.
We are concerned with the question of how these approaches are related with one another and whether combining them and supporting them with machine learning can produce better adaptive systems.
We motivate the combined use of different adaptation approaches using a scenario of a cloud-based enterprise system and illustrate the analysis when combining the different approaches.
arXiv Detail & Related papers (2021-03-19T15:00:08Z) - Applying Machine Learning in Self-Adaptive Systems: A Systematic
Literature Review [15.953995937484176]
There is currently no systematic overview of the use of machine learning in self-adaptive systems.
We focus on self-adaptive systems that are based on a traditional Monitor-Analyze-Plan-Execute feedback loop (MAPE)
The research questions are centred on the problems that motivate the use of machine learning in self-adaptive systems, the key engineering aspects of learning in self-adaptation, and open challenges.
arXiv Detail & Related papers (2021-03-06T13:45:59Z) - Using Data Assimilation to Train a Hybrid Forecast System that Combines
Machine-Learning and Knowledge-Based Components [52.77024349608834]
We consider the problem of data-assisted forecasting of chaotic dynamical systems when the available data is noisy partial measurements.
We show that by using partial measurements of the state of the dynamical system, we can train a machine learning model to improve predictions made by an imperfect knowledge-based model.
arXiv Detail & Related papers (2021-02-15T19:56:48Z) - Anticipating the Long-Term Effect of Online Learning in Control [75.6527644813815]
AntLer is a design algorithm for learning-based control laws that anticipates learning.
We show that AntLer approximates an optimal solution arbitrarily accurately with probability one.
arXiv Detail & Related papers (2020-07-24T07:00:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.