Transfer Learning as an Enhancement for Reconfiguration Management of
Cyber-Physical Production Systems
- URL: http://arxiv.org/abs/2105.14730v1
- Date: Mon, 31 May 2021 06:50:58 GMT
- Title: Transfer Learning as an Enhancement for Reconfiguration Management of
Cyber-Physical Production Systems
- Abstract summary: Reconfiguration demand is increasing due to frequent requirement changes for manufacturing systems.
Recent approaches aim at investigating feasible configuration alternatives from which they select the optimal one.
We propose the enhancement of the comprehensive reconfiguration management with transfer learning.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Reconfiguration demand is increasing due to frequent requirement changes for
manufacturing systems. Recent approaches aim at investigating feasible
configuration alternatives from which they select the optimal one. This relies
on processes whose behavior is not reliant on e.g. the production sequence.
However, when machine learning is used, components' behavior depends on the
process' specifics, requiring additional concepts to successfully conduct
reconfiguration management. Therefore, we propose the enhancement of the
comprehensive reconfiguration management with transfer learning. This provides
the ability to assess the machine learning dependent behavior of the different
CPPS configurations with reduced effort and further assists the recommissioning
of the chosen one. A real cyber-physical production system from the discrete
manufacturing domain is utilized to demonstrate the aforementioned proposal.
Related papers
- NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation [59.19858972597063]
LLM-powered multi-agent systems can now automate the full research pipeline from ideation to paper writing, but a fundamental question remains: automation for whom?<n>We propose NanoResearch, a multi-agent framework that addresses these gaps through tri-level co-evolution.<n>A skill bank distills recurring operations into compact procedural rules reusable across projects.<n>A memory module maintains user- and project-specific experience that grounds planning decisions in each user's research history.<n>A label-free policy learning converts free-form feedback into persistent parameter updates of the planner, reshaping subsequent coordination.
arXiv Detail & Related papers (2026-05-11T16:33:47Z) - Dynamics-Predictive Sampling for Active RL Finetuning of Large Reasoning Models [49.04912820721943]
Reinforcement learning (RL) finetuning has become a key technique for enhancing the reasoning abilities of large language models (LLMs)<n>Recent advances underscore the importance of online prompt selection methods, which typically concentrate training on partially solved or moderately challenging examples.<n>This work proposes Dynamics-Predictive Sampling (DPS), which online predicts and selects informative prompts by inferring their learning dynamics prior to costly rollouts.
arXiv Detail & Related papers (2026-03-11T15:31:14Z) - A Negotiation-Based Multi-Agent Reinforcement Learning Approach for Dynamic Scheduling of Reconfigurable Manufacturing Systems [0.0]
This study explores the application of multi agent reinforcement learning (MARL) for dynamic scheduling in soft planning of the RMS settings.<n>In the proposed framework, deep Qnetwork (DQN) agents trained in centralized training learn optimal job assignments in real time while adapting to events such as machine breakdowns and reconfiguration delays.
arXiv Detail & Related papers (2025-11-11T00:04:35Z) - Towards a Real-World Aligned Benchmark for Unlearning in Recommender Systems [49.766845975588275]
We propose a set of design desiderata and research questions to guide the development of a more realistic benchmark for unlearning in recommender systems.<n>We argue for an unlearning setup that reflects the sequential, time-sensitive nature of real-world deletion requests.<n>We present a preliminary experiment in a next-basket recommendation setting based on our proposed desiderata and find that unlearning also works for sequential recommendation models.
arXiv Detail & Related papers (2025-08-23T16:05:40Z) - Variability Modeling of Products, Processes, and Resources in
Cyber-Physical Production Systems Engineering [1.6333646796408297]
CPPSs execute a sequence of production steps to manufacture products from a product portfolio.
In CPPS engineering, domain experts start with manually determining feasible production step sequences and resources.
We present the Extended Iterative Process Sequence Exploration approach to derive variability models for products, processes, and resources.
arXiv Detail & Related papers (2024-02-15T11:08:54Z) - Machine Learning Insides OptVerse AI Solver: Design Principles and
Applications [74.67495900436728]
We present a comprehensive study on the integration of machine learning (ML) techniques into Huawei Cloud's OptVerse AI solver.
We showcase our methods for generating complex SAT and MILP instances utilizing generative models that mirror multifaceted structures of real-world problem.
We detail the incorporation of state-of-the-art parameter tuning algorithms which markedly elevate solver performance.
arXiv Detail & Related papers (2024-01-11T15:02:15Z) - Reinforcement Learning of Display Transfer Robots in Glass Flow Control
Systems: A Physical Simulation-Based Approach [6.229216953398305]
A flow control system is a critical concept for increasing the production capacity of manufacturing systems.
To solve the scheduling optimization problem related to the flow control, existing methods depend on a design by domain human experts.
We propose a method to implement a physical simulation environment and devise a feasible flow control system design using a transfer robot in display manufacturing.
arXiv Detail & Related papers (2023-10-12T02:10:29Z) - TranDRL: A Transformer-Driven Deep Reinforcement Learning Enabled Prescriptive Maintenance Framework [58.474610046294856]
Industrial systems demand reliable predictive maintenance strategies to enhance operational efficiency and reduce downtime.
This paper introduces an integrated framework that leverages the capabilities of the Transformer model-based neural networks and deep reinforcement learning (DRL) algorithms to optimize system maintenance actions.
arXiv Detail & Related papers (2023-09-29T02:27:54Z) - Empowering Private Tutoring by Chaining Large Language Models [87.76985829144834]
This work explores the development of a full-fledged intelligent tutoring system powered by state-of-the-art large language models (LLMs)
The system is into three inter-connected core processes-interaction, reflection, and reaction.
Each process is implemented by chaining LLM-powered tools along with dynamically updated memory modules.
arXiv Detail & Related papers (2023-09-15T02:42:03Z) - On Conditional and Compositional Language Model Differentiable Prompting [75.76546041094436]
Prompts have been shown to be an effective method to adapt a frozen Pretrained Language Model (PLM) to perform well on downstream tasks.
We propose a new model, Prompt Production System (PRopS), which learns to transform task instructions or input metadata, into continuous prompts.
arXiv Detail & Related papers (2023-07-04T02:47:42Z) - Learning Multi-Objective Curricula for Deep Reinforcement Learning [55.27879754113767]
Various automatic curriculum learning (ACL) methods have been proposed to improve the sample efficiency and final performance of deep reinforcement learning (DRL)
In this paper, we propose a unified automatic curriculum learning framework to create multi-objective but coherent curricula.
In addition to existing hand-designed curricula paradigms, we further design a flexible memory mechanism to learn an abstract curriculum.
arXiv Detail & Related papers (2021-10-06T19:30:25Z) - Few-shot Quality-Diversity Optimization [50.337225556491774]
Quality-Diversity (QD) optimization has been shown to be effective tools in dealing with deceptive minima and sparse rewards in Reinforcement Learning.
We show that, given examples from a task distribution, information about the paths taken by optimization in parameter space can be leveraged to build a prior population, which when used to initialize QD methods in unseen environments, allows for few-shot adaptation.
Experiments carried in both sparse and dense reward settings using robotic manipulation and navigation benchmarks show that it considerably reduces the number of generations that are required for QD optimization in these environments.
arXiv Detail & Related papers (2021-09-14T17:12:20Z) - Enhancing an Intelligent Digital Twin with a Self-organized
Reconfiguration Management based on Adaptive Process Models [0.0]
Shorter product life cycles and increasing individualization of production leads to an increased reconfiguration demand in industrial automation systems.
This paper presents an approach that enhances an intelligent Digital Twin with a self-organized reconfiguration management based on adaptive process models.
arXiv Detail & Related papers (2021-07-07T16:02:53Z) - MLComp: A Methodology for Machine Learning-based Performance Estimation
and Adaptive Selection of Pareto-Optimal Compiler Optimization Sequences [10.200899224740871]
We propose a novel Reinforcement Learning-based policy methodology for embedded software optimization.
We show that different Machine Learning models are automatically tested to choose the best-fitting one.
We also show that our framework can be trained efficiently for any target platform and application domain.
arXiv Detail & Related papers (2020-12-09T19:13:39Z) - Many-Objective Software Remodularization using NSGA-III [17.487053547108516]
We propose a novel many-objective search-based approach using NSGA-III.
The process aims at finding the optimal remodularization solutions that improve the structure of packages, minimize the number of changes, preserve semantics coherence, and re-use the history of changes.
arXiv Detail & Related papers (2020-05-13T18:34:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.