Agility in Software 2.0 -- Notebook Interfaces and MLOps with Buttresses and Rebars

• URL: http://arxiv.org/abs/2111.14142v1
• Date: Sun, 28 Nov 2021 13:40:30 GMT
• Title: Agility in Software 2.0 -- Notebook Interfaces and MLOps with Buttresses and Rebars
• Authors: Markus Borg
• Abstract summary: We discuss two contemporary development phenomena that are fundamental in machine learning development. First, we present a solution that can remedy some of the intrinsic weaknesses of working in notebooks by supporting easy transitions to integrated development environments. Second, we propose reinforced engineering of AI systems by introducing metaphorical buttresses and rebars in the MLOps context.
• Score: 9.327920030279586
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Artificial intelligence through machine learning is increasingly used in the digital society. Solutions based on machine learning bring both great opportunities, thus coined "Software 2.0," but also great challenges for the engineering community to tackle. Due to the experimental approach used by data scientists when developing machine learning models, agility is an essential characteristic. In this keynote address, we discuss two contemporary development phenomena that are fundamental in machine learning development, i.e., notebook interfaces and MLOps. First, we present a solution that can remedy some of the intrinsic weaknesses of working in notebooks by supporting easy transitions to integrated development environments. Second, we propose reinforced engineering of AI systems by introducing metaphorical buttresses and rebars in the MLOps context. Machine learning-based solutions are dynamic in nature, and we argue that reinforced continuous engineering is required to quality assure the trustworthy AI systems of tomorrow.

Related papers

• Overview of Current Challenges in Multi-Architecture Software Engineering and a Vision for the Future [0.0]
  The presented system architecture is based on the concept of dynamic, knowledge graph-based WebAssembly Twins. The resulting systems are to possess advanced autonomous capabilities, with full transparency and controllability by the end user.
  arXiv  Detail & Related papers  (2024-10-28T13:03:09Z)
• Innovating for Tomorrow: The Convergence of SE and Green AI [2.013374581642707]
  Machine learning is changing the frontiers of existing software engineering processes. We reflect on the impact of adopting environmentally friendly practices to create AI-enabled software systems.
  arXiv  Detail & Related papers  (2024-06-26T07:47:04Z)
• Brain-Inspired Computational Intelligence via Predictive Coding [89.6335791546526]
  Predictive coding (PC) has shown promising performance in machine intelligence tasks. PC can model information processing in different brain areas, can be used in cognitive control and robotics.
  arXiv  Detail & Related papers  (2023-08-15T16:37:16Z)
• Selected Trends in Artificial Intelligence for Space Applications [69.3474006357492]
  This chapter focuses on differentiable intelligence and on-board machine learning. We discuss a few selected projects originating from the European Space Agency's (ESA) Advanced Concepts Team (ACT)
  arXiv  Detail & Related papers  (2022-12-10T07:49:50Z)
• Enabling Automated Machine Learning for Model-Driven AI Engineering [60.09869520679979]
  We propose a novel approach to enable Model-Driven Software Engineering and Model-Driven AI Engineering. In particular, we support Automated ML, thus assisting software engineers without deep AI knowledge in developing AI-intensive systems.
  arXiv  Detail & Related papers  (2022-03-06T10:12:56Z)
• Machine Learning for Massive Industrial Internet of Things [69.52379407906017]
  Industrial Internet of Things (IIoT) revolutionizes the future manufacturing facilities by integrating the Internet of Things technologies into industrial settings. With the deployment of massive IIoT devices, it is difficult for the wireless network to support the ubiquitous connections with diverse quality-of-service (QoS) requirements. We first summarize the requirements of the typical massive non-critical and critical IIoT use cases. We then identify unique characteristics in the massive IIoT scenario, and the corresponding machine learning solutions with its limitations and potential research directions.
  arXiv  Detail & Related papers  (2021-03-10T20:10:53Z)
• Technology Readiness Levels for Machine Learning Systems [107.56979560568232]
  Development and deployment of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end. We have developed a proven systems engineering approach for machine learning development and deployment. Our "Machine Learning Technology Readiness Levels" framework defines a principled process to ensure robust, reliable, and responsible systems.
  arXiv  Detail & Related papers  (2021-01-11T15:54:48Z)
• Advancing from Predictive Maintenance to Intelligent Maintenance with AI and IIoT [0.0]
  The paper first reviews the evolution of reliability modelling technology in the past 90 years and discusses major technologies developed in industry and academia. We then introduce the next generation maintenance framework - Intelligent Maintenance, and discuss its key components. This AI and IIoT based Intelligent Maintenance framework is composed of (1) latest machine learning algorithms including probabilistic reliability modelling with deep learning, (2) real-time data collection, transfer, and storage through wireless smart sensors, (3) Big Data technologies, (4) continuously integration and deployment of machine learning models, (5) mobile device and AR/VR applications for fast and better decision-making in the field.
  arXiv  Detail & Related papers  (2020-09-01T11:10:13Z)
• Technology Readiness Levels for AI & ML [79.22051549519989]
  Development of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end. Engineering systems follow well-defined processes and testing standards to streamline development for high-quality, reliable results. We propose a proven systems engineering approach for machine learning development and deployment.
  arXiv  Detail & Related papers  (2020-06-21T17:14:34Z)
• Quality Management of Machine Learning Systems [0.0]
  Artificial Intelligence (AI) has become a part of our daily lives due to major advances in Machine Learning (ML) techniques. For business/mission-critical systems, serious concerns about reliability and maintainability of AI applications remain. This paper presents a view of a holistic quality management framework for ML applications based on the current advances.
  arXiv  Detail & Related papers  (2020-06-16T21:34:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.