Applying Machine Learning in Self-Adaptive Systems: A Systematic Literature Review

• URL: http://arxiv.org/abs/2103.04112v1
• Date: Sat, 6 Mar 2021 13:45:59 GMT
• Title: Applying Machine Learning in Self-Adaptive Systems: A Systematic Literature Review
• Authors: Omid Gheibi, Danny Weyns, and Federico Quin
• Abstract summary: There is currently no systematic overview of the use of machine learning in self-adaptive systems. We focus on self-adaptive systems that are based on a traditional Monitor-Analyze-Plan-Execute feedback loop (MAPE) The research questions are centred on the problems that motivate the use of machine learning in self-adaptive systems, the key engineering aspects of learning in self-adaptation, and open challenges.
• Score: 15.953995937484176
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently, we witness a rapid increase in the use of machine learning in self-adaptive systems. Machine learning has been used for a variety of reasons, ranging from learning a model of the environment of a system during operation to filtering large sets of possible configurations before analysing them. While a body of work on the use of machine learning in self-adaptive systems exists, there is currently no systematic overview of this area. Such overview is important for researchers to understand the state of the art and direct future research efforts. This paper reports the results of a systematic literature review that aims at providing such an overview. We focus on self-adaptive systems that are based on a traditional Monitor-Analyze-Plan-Execute feedback loop (MAPE). The research questions are centred on the problems that motivate the use of machine learning in self-adaptive systems, the key engineering aspects of learning in self-adaptation, and open challenges. The search resulted in 6709 papers, of which 109 were retained for data collection. Analysis of the collected data shows that machine learning is mostly used for updating adaptation rules and policies to improve system qualities, and managing resources to better balance qualities and resources. These problems are primarily solved using supervised and interactive learning with classification, regression and reinforcement learning as the dominant methods. Surprisingly, unsupervised learning that naturally fits automation is only applied in a small number of studies. Key open challenges in this area include the performance of learning, managing the effects of learning, and dealing with more complex types of goals. From the insights derived from this systematic literature review we outline an initial design process for applying machine learning in self-adaptive systems that are based on MAPE feedback loops.

Related papers

• A Systems Theoretic Approach to Online Machine Learning [3.6458439734112695]
  The machine learning formulation of online learning is incomplete from a systems theoretic perspective. The framework is formulated in terms of input-output systems and is further divided into system structure and system behavior. This work formally approaches concept drift as part of the system behavior characteristics.
  arXiv  Detail & Related papers  (2024-04-04T19:36:47Z)
• Application-Driven Innovation in Machine Learning [56.85396167616353]
  We describe the paradigm of application-driven research in machine learning. We show how this approach can productively synergize with methods-driven work. Despite these benefits, we find that reviewing, hiring, and teaching practices in machine learning often hold back application-driven innovation.
  arXiv  Detail & Related papers  (2024-03-26T04:59:27Z)
• ALT: An Automatic System for Long Tail Scenario Modeling [15.76033166478158]
  We present an automatic system named ALT to deal with this problem. Several efforts are taken to improve the algorithms used in our system, such as employing various automatic machine learning related techniques. To build the system, many optimizations are performed from a systematic perspective, and essential modules are armed.
  arXiv  Detail & Related papers  (2023-05-19T02:35:39Z)
• Awareness requirement and performance management for adaptive systems: a survey [13.406015141662879]
  Self-adaptive software can modify its behavior when the assessment indicates that the program is not performing as intended or when improved functionality or performance is available. This paper presents a review of self-adaptive systems in the context of requirement awareness and summarizes the most common methodologies applied.
  arXiv  Detail & Related papers  (2023-01-22T14:27:11Z)
• Deep Active Learning for Computer Vision: Past and Future [50.19394935978135]
  Despite its indispensable role for developing AI models, research on active learning is not as intensive as other research directions. By addressing data automation challenges and coping with automated machine learning systems, active learning will facilitate democratization of AI technologies.
  arXiv  Detail & Related papers  (2022-11-27T13:07:14Z)
• Don't Start From Scratch: Leveraging Prior Data to Automate Robotic Reinforcement Learning [70.70104870417784]
  Reinforcement learning (RL) algorithms hold the promise of enabling autonomous skill acquisition for robotic systems. In practice, real-world robotic RL typically requires time consuming data collection and frequent human intervention to reset the environment. In this work, we study how these challenges can be tackled by effective utilization of diverse offline datasets collected from previously seen tasks.
  arXiv  Detail & Related papers  (2022-07-11T08:31:22Z)
• Retrieval-Enhanced Machine Learning [110.5237983180089]
  We describe a generic retrieval-enhanced machine learning framework, which includes a number of existing models as special cases. REML challenges information retrieval conventions, presenting opportunities for novel advances in core areas, including optimization. REML research agenda lays a foundation for a new style of information access research and paves a path towards advancing machine learning and artificial intelligence.
  arXiv  Detail & Related papers  (2022-05-02T21:42:45Z)
• On the Impact of Applying Machine Learning in the Decision-Making of Self-Adaptive Systems [17.93069260609691]
  We use computational learning theory to determine a theoretical bound on the impact of the machine learning method on the predictions made by the verifier. To conclude, we look at opportunities for future research in this area.
  arXiv  Detail & Related papers  (2021-03-18T11:59:50Z)
• Knowledge as Invariance -- History and Perspectives of Knowledge-augmented Machine Learning [69.99522650448213]
  Research in machine learning is at a turning point. Research interests are shifting away from increasing the performance of highly parameterized models to exceedingly specific tasks. This white paper provides an introduction and discussion of this emerging field in machine learning research.
  arXiv  Detail & Related papers  (2020-12-21T15:07:19Z)
• Ethical behavior in humans and machines -- Evaluating training data quality for beneficial machine learning [0.0]
  This study describes new dimensions of data quality for supervised machine learning applications. The specific objective of this study is to describe how training data can be selected according to ethical assessments of the behavior it originates from.
  arXiv  Detail & Related papers  (2020-08-26T09:48:38Z)
• Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodology [53.063411515511056]
  We propose a process model for the development of machine learning applications. The first phase combines business and data understanding as data availability oftentimes affects the feasibility of the project. The sixth phase covers state-of-the-art approaches for monitoring and maintenance of a machine learning applications.
  arXiv  Detail & Related papers  (2020-03-11T08:25:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.