Concepts for Automated Machine Learning in Smart Grid Applications
- URL: http://arxiv.org/abs/2110.13585v1
- Date: Tue, 26 Oct 2021 11:34:41 GMT
- Title: Concepts for Automated Machine Learning in Smart Grid Applications
- Authors: Stefan Meisenbacher, Janik Pinter, Tim Martin, Veit Hagenmeyer, Ralf
Mikut
- Abstract summary: Large-scale application of machine learning methods in energy systems is impaired by the need for expert knowledge.
Process knowledge is required for the problem formalization, as well as the model validation and application.
We define five levels of automation for forecasting in alignment with the SAE standard for autonomous vehicles.
- Score: 0.2624902795082451
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Undoubtedly, the increase of available data and competitive machine learning
algorithms has boosted the popularity of data-driven modeling in energy
systems. Applications are forecasts for renewable energy generation and energy
consumption. Forecasts are elementary for sector coupling, where
energy-consuming sectors are interconnected with the power-generating sector to
address electricity storage challenges by adding flexibility to the power
system. However, the large-scale application of machine learning methods in
energy systems is impaired by the need for expert knowledge, which covers
machine learning expertise and a profound understanding of the application's
process. The process knowledge is required for the problem formalization, as
well as the model validation and application. The machine learning skills
include the processing steps of i) data pre-processing, ii) feature
engineering, extraction, and selection, iii) algorithm selection, iv)
hyperparameter optimization, and possibly v) post-processing of the model's
output. Tailoring a model for a particular application requires selecting the
data, designing various candidate models and organizing the data flow between
the processing steps, selecting the most suitable model, and monitoring the
model during operation - an iterative and time-consuming procedure. Automated
design and operation of machine learning aim to reduce the human effort to
address the increasing demand for data-driven models. We define five levels of
automation for forecasting in alignment with the SAE standard for autonomous
vehicles, where manual design and application reflect Automation level 0.
Related papers
- Knowledge Graph Modeling-Driven Large Language Model Operating System (LLM OS) for Task Automation in Process Engineering Problem-Solving [0.0]
We present the Process Engineering Operations Assistant (PEOA), an AI-driven framework designed to solve complex problems in the chemical and process industries.
The framework employs a modular architecture orchestrated by a meta-agent, which serves as the central coordinator.
The results demonstrate the framework effectiveness in automating calculations, accelerating prototyping, and providing AI-augmented decision support for industrial processes.
arXiv Detail & Related papers (2024-08-23T13:52:47Z) - Machine Learning Insides OptVerse AI Solver: Design Principles and
Applications [74.67495900436728]
We present a comprehensive study on the integration of machine learning (ML) techniques into Huawei Cloud's OptVerse AI solver.
We showcase our methods for generating complex SAT and MILP instances utilizing generative models that mirror multifaceted structures of real-world problem.
We detail the incorporation of state-of-the-art parameter tuning algorithms which markedly elevate solver performance.
arXiv Detail & Related papers (2024-01-11T15:02:15Z) - Code Generation for Machine Learning using Model-Driven Engineering and
SysML [0.0]
This work aims to facilitate the implementation of data-driven engineering in practice by extending the previous work of formalizing machine learning tasks.
The presented method is evaluated for feasibility in a case study to predict weather forecasts.
Results demonstrate the flexibility and the simplicity of the method reducing efforts for implementation.
arXiv Detail & Related papers (2023-07-10T15:00:20Z) - Advancing Reacting Flow Simulations with Data-Driven Models [50.9598607067535]
Key to effective use of machine learning tools in multi-physics problems is to couple them to physical and computer models.
The present chapter reviews some of the open opportunities for the application of data-driven reduced-order modeling of combustion systems.
arXiv Detail & Related papers (2022-09-05T16:48:34Z) - Enabling Automated Machine Learning for Model-Driven AI Engineering [60.09869520679979]
We propose a novel approach to enable Model-Driven Software Engineering and Model-Driven AI Engineering.
In particular, we support Automated ML, thus assisting software engineers without deep AI knowledge in developing AI-intensive systems.
arXiv Detail & Related papers (2022-03-06T10:12:56Z) - SOLIS -- The MLOps journey from data acquisition to actionable insights [62.997667081978825]
In this paper we present a unified deployment pipeline and freedom-to-operate approach that supports all requirements while using basic cross-platform tensor framework and script language engines.
This approach however does not supply the needed procedures and pipelines for the actual deployment of machine learning capabilities in real production grade systems.
arXiv Detail & Related papers (2021-12-22T14:45:37Z) - Automated Machine Learning Techniques for Data Streams [91.3755431537592]
This paper surveys the state-of-the-art open-source AutoML tools, applies them to data collected from streams, and measures how their performance changes over time.
The results show that off-the-shelf AutoML tools can provide satisfactory results but in the presence of concept drift, detection or adaptation techniques have to be applied to maintain the predictive accuracy over time.
arXiv Detail & Related papers (2021-06-14T11:42:46Z) - Towards CRISP-ML(Q): A Machine Learning Process Model with Quality
Assurance Methodology [53.063411515511056]
We propose a process model for the development of machine learning applications.
The first phase combines business and data understanding as data availability oftentimes affects the feasibility of the project.
The sixth phase covers state-of-the-art approaches for monitoring and maintenance of a machine learning applications.
arXiv Detail & Related papers (2020-03-11T08:25:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.