Continual learning on deployment pipelines for Machine Learning Systems
- URL: http://arxiv.org/abs/2212.02659v1
- Date: Mon, 5 Dec 2022 23:40:57 GMT
- Title: Continual learning on deployment pipelines for Machine Learning Systems
- Authors: Qiang Li and Chongyu Zhang
- Abstract summary: Deployment of machine learning systems is becoming an extremely important topic.
This paper compares the advantages and disadvantages of various technologies in theory and practice.
It also aims to raise awareness of the evaluation framework for the deployment of machine learning systems.
- Score: 4.884688557957589
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Following the development of digitization, a growing number of large Original
Equipment Manufacturers (OEMs) are adapting computer vision or natural language
processing in a wide range of applications such as anomaly detection and
quality inspection in plants. Deployment of such a system is becoming an
extremely important topic. Our work starts with the least-automated deployment
technologies of machine learning systems includes several iterations of
updates, and ends with a comparison of automated deployment techniques. The
objective is, on the one hand, to compare the advantages and disadvantages of
various technologies in theory and practice, so as to facilitate later adopters
to avoid making the generalized mistakes when implementing actual use cases,
and thereby choose a better strategy for their own enterprises. On the other
hand, to raise awareness of the evaluation framework for the deployment of
machine learning systems, to have more comprehensive and useful evaluation
metrics (e.g. table 2), rather than only focusing on a single factor (e.g.
company cost). This is especially important for decision-makers in the
industry.
Related papers
- Three Approaches to the Automation of Laser System Alignment and Their Resource Implications: A Case Study [1.3543803103181615]
We identify and examine three different automation approaches.
They are: artificial neural networks; practice-led, which mimics manual alignment practices; and design-led, modelling from first principles.
We demonstrate that the different automation approaches vary significantly in human resources, and measurement sampling budgets.
arXiv Detail & Related papers (2024-09-17T11:41:33Z) - Towards MLOps: A DevOps Tools Recommender System for Machine Learning
System [1.065497990128313]
MLOps and machine learning systems evolve on new data unlike traditional systems on requirements.
In this paper, we present a framework for recommendation system that processes the contextual information.
Four different approaches i.e., rule-based, random forest, decision trees and k-nearest neighbors were investigated.
arXiv Detail & Related papers (2024-02-20T09:57:49Z) - Machine Learning for QoS Prediction in Vehicular Communication:
Challenges and Solution Approaches [46.52224306624461]
We consider maximum throughput prediction enhancing, for example, streaming or high-definition mapping applications.
We highlight how confidence can be built on machine learning technologies by better understanding the underlying characteristics of the collected data.
We use explainable AI to show that machine learning can learn underlying principles of wireless networks without being explicitly programmed.
arXiv Detail & Related papers (2023-02-23T12:29:20Z) - Automating In-Network Machine Learning [2.857025628729502]
Planter is an open-source framework for mapping trained machine learning models to programmable devices.
We show that Planter-based in-network machine learning algorithms can run at line rate, have a negligible effect on latency, coexist with standard switching functionality, and have no or minor accuracy trade-offs.
arXiv Detail & Related papers (2022-05-18T09:42:22Z) - Flashlight: Enabling Innovation in Tools for Machine Learning [50.63188263773778]
We introduce Flashlight, an open-source library built to spur innovation in machine learning tools and systems.
We see Flashlight as a tool enabling research that can benefit widely used libraries downstream and bring machine learning and systems researchers closer together.
arXiv Detail & Related papers (2022-01-29T01:03:29Z) - From Machine Learning to Robotics: Challenges and Opportunities for
Embodied Intelligence [113.06484656032978]
Article argues that embodied intelligence is a key driver for the advancement of machine learning technology.
We highlight challenges and opportunities specific to embodied intelligence.
We propose research directions which may significantly advance the state-of-the-art in robot learning.
arXiv Detail & Related papers (2021-10-28T16:04:01Z) - Multi Agent System for Machine Learning Under Uncertainty in Cyber
Physical Manufacturing System [78.60415450507706]
Recent advancements in predictive machine learning has led to its application in various use cases in manufacturing.
Most research focused on maximising predictive accuracy without addressing the uncertainty associated with it.
In this paper, we determine the sources of uncertainty in machine learning and establish the success criteria of a machine learning system to function well under uncertainty.
arXiv Detail & Related papers (2021-07-28T10:28:05Z) - Machine Learning for Massive Industrial Internet of Things [69.52379407906017]
Industrial Internet of Things (IIoT) revolutionizes the future manufacturing facilities by integrating the Internet of Things technologies into industrial settings.
With the deployment of massive IIoT devices, it is difficult for the wireless network to support the ubiquitous connections with diverse quality-of-service (QoS) requirements.
We first summarize the requirements of the typical massive non-critical and critical IIoT use cases. We then identify unique characteristics in the massive IIoT scenario, and the corresponding machine learning solutions with its limitations and potential research directions.
arXiv Detail & Related papers (2021-03-10T20:10:53Z) - Applying Machine Learning in Self-Adaptive Systems: A Systematic
Literature Review [15.953995937484176]
There is currently no systematic overview of the use of machine learning in self-adaptive systems.
We focus on self-adaptive systems that are based on a traditional Monitor-Analyze-Plan-Execute feedback loop (MAPE)
The research questions are centred on the problems that motivate the use of machine learning in self-adaptive systems, the key engineering aspects of learning in self-adaptation, and open challenges.
arXiv Detail & Related papers (2021-03-06T13:45:59Z) - Technology Readiness Levels for Machine Learning Systems [107.56979560568232]
Development and deployment of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end.
We have developed a proven systems engineering approach for machine learning development and deployment.
Our "Machine Learning Technology Readiness Levels" framework defines a principled process to ensure robust, reliable, and responsible systems.
arXiv Detail & Related papers (2021-01-11T15:54:48Z) - Towards CRISP-ML(Q): A Machine Learning Process Model with Quality
Assurance Methodology [53.063411515511056]
We propose a process model for the development of machine learning applications.
The first phase combines business and data understanding as data availability oftentimes affects the feasibility of the project.
The sixth phase covers state-of-the-art approaches for monitoring and maintenance of a machine learning applications.
arXiv Detail & Related papers (2020-03-11T08:25:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.