A reinforcement learning agent for maintenance of deteriorating systems with increasingly imperfect repairs

• URL: http://arxiv.org/abs/2505.20725v1
• Date: Tue, 27 May 2025 05:14:29 GMT
• Title: A reinforcement learning agent for maintenance of deteriorating systems with increasingly imperfect repairs
• Authors: Alberto Pliego Marugán, Jesús M. Pinar-Pérez, Fausto Pedro García Márquez,
• Abstract summary: Machine learning techniques are becoming increasingly used in engineering and maintenance, with reinforcement learning being one of the most promising.<n>In this paper, we propose a gamma degradation process together with a novel maintenance model in which repairs are increasingly imperfect.<n>To generate maintenance policies for this system, we developed a reinforcement-learning-based agent using a Double Deep Q-Network architecture.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Efficient maintenance has always been essential for the successful application of engineering systems. However, the challenges to be overcome in the implementation of Industry 4.0 necessitate new paradigms of maintenance optimization. Machine learning techniques are becoming increasingly used in engineering and maintenance, with reinforcement learning being one of the most promising. In this paper, we propose a gamma degradation process together with a novel maintenance model in which repairs are increasingly imperfect, i.e., the beneficial effect of system repairs decreases as more repairs are performed, reflecting the degradational behavior of real-world systems. To generate maintenance policies for this system, we developed a reinforcement-learning-based agent using a Double Deep Q-Network architecture. This agent presents two important advantages: it works without a predefined preventive threshold, and it can operate in a continuous degradation state space. Our agent learns to behave in different scenarios, showing great flexibility. In addition, we performed an analysis of how changes in the main parameters of the environment affect the maintenance policy proposed by the agent. The proposed approach is demonstrated to be appropriate and to significatively improve long-run cost as compared with other common maintenance strategies.

Related papers

• Improving Retrospective Language Agents via Joint Policy Gradient Optimization [57.35348425288859]
  RetroAct is a framework that jointly optimize both task-planning and self-reflective evolution capabilities in language agents.<n>We develop a two-stage joint optimization process that integrates imitation learning and reinforcement learning.<n>We conduct extensive experiments across various testing environments, demonstrating RetroAct has substantial improvements in task performance and decision-making processes.
  arXiv  Detail & Related papers  (2025-03-03T12:54:54Z)
• LLM-R: A Framework for Domain-Adaptive Maintenance Scheme Generation Combining Hierarchical Agents and RAG [7.864939415613373]
  This paper proposes a Maintenance Scheme Generation Method based on Large Language Models (LLM-R) The proposed method includes several key innovations. The experimental results show that the accuracy of the maintenance schemes generated by the proposed method reached 91.59%.
  arXiv  Detail & Related papers  (2024-11-07T07:07:34Z)
• A Retention-Centric Framework for Continual Learning with Guaranteed Model Developmental Safety [75.8161094916476]
  In real-world applications, learning-enabled systems often undergo iterative model development to address challenging or emerging tasks.<n>New or improving existing capabilities may inadvertently lose good capabilities of the old model, also known as catastrophic forgetting.<n>We propose a retention-centric framework with data-dependent constraints, and study how to continually develop a pretrained CLIP model for acquiring new or improving existing capabilities of image classification.
  arXiv  Detail & Related papers  (2024-10-04T22:34:58Z)
• Normalization and effective learning rates in reinforcement learning [52.59508428613934]
  Normalization layers have recently experienced a renaissance in the deep reinforcement learning and continual learning literature. We show that normalization brings with it a subtle but important side effect: an equivalence between growth in the norm of the network parameters and decay in the effective learning rate. We propose to make the learning rate schedule explicit with a simple re- parameterization which we call Normalize-and-Project.
  arXiv  Detail & Related papers  (2024-07-01T20:58:01Z)
• TranDRL: A Transformer-Driven Deep Reinforcement Learning Enabled Prescriptive Maintenance Framework [58.474610046294856]
  Industrial systems demand reliable predictive maintenance strategies to enhance operational efficiency and reduce downtime. This paper introduces an integrated framework that leverages the capabilities of the Transformer model-based neural networks and deep reinforcement learning (DRL) algorithms to optimize system maintenance actions.
  arXiv  Detail & Related papers  (2023-09-29T02:27:54Z)
• Reinforcement and Deep Reinforcement Learning-based Solutions for Machine Maintenance Planning, Scheduling Policies, and Optimization [1.6447597767676658]
  This paper presents a literature review on the applications of reinforcement and deep reinforcement learning for maintenance planning and optimization problems. By leveraging the condition monitoring data of systems and machines with reinforcement learning, smart maintenance planners can be developed, which is a precursor to achieving a smart factory.
  arXiv  Detail & Related papers  (2023-07-07T22:47:29Z)
• Continual Learning for Predictive Maintenance: Overview and Challenges [6.620789302906817]
  We present a brief introduction to predictive maintenance, non-stationary environments, and continual learning. We then discuss the current challenges of both predictive maintenance and continual learning, proposing future directions at the intersection of both areas.
  arXiv  Detail & Related papers  (2023-01-29T15:32:53Z)
• Prescriptive maintenance with causal machine learning [4.169130102668252]
  We learn the effect of maintenance conditional on a machine's characteristics from observational data on similar machines. We validate our proposed approach using real-life data on more than 4,000 maintenance contracts from an industrial partner.
  arXiv  Detail & Related papers  (2022-06-03T13:35:57Z)
• Coach-assisted Multi-Agent Reinforcement Learning Framework for Unexpected Crashed Agents [120.91291581594773]
  We present a formal formulation of a cooperative multi-agent reinforcement learning system with unexpected crashes. We propose a coach-assisted multi-agent reinforcement learning framework, which introduces a virtual coach agent to adjust the crash rate during training. To the best of our knowledge, this work is the first to study the unexpected crashes in the multi-agent system.
  arXiv  Detail & Related papers  (2022-03-16T08:22:45Z)
• Predictive Maintenance for Edge-Based Sensor Networks: A Deep Reinforcement Learning Approach [68.40429597811071]
  The risk of unplanned equipment downtime can be minimized through Predictive Maintenance of revenue generating assets. A model-free Deep Reinforcement Learning algorithm is proposed for predictive equipment maintenance from an equipment-based sensor network context. Unlike traditional black-box regression models, the proposed algorithm self-learns an optimal maintenance policy and provides actionable recommendation for each equipment.
  arXiv  Detail & Related papers  (2020-07-07T10:00:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.