Reinforcement and Deep Reinforcement Learning-based Solutions for Machine Maintenance Planning, Scheduling Policies, and Optimization

• URL: http://arxiv.org/abs/2307.03860v1
• Date: Fri, 7 Jul 2023 22:47:29 GMT
• Title: Reinforcement and Deep Reinforcement Learning-based Solutions for Machine Maintenance Planning, Scheduling Policies, and Optimization
• Authors: Oluwaseyi Ogunfowora and Homayoun Najjaran
• Abstract summary: This paper presents a literature review on the applications of reinforcement and deep reinforcement learning for maintenance planning and optimization problems. By leveraging the condition monitoring data of systems and machines with reinforcement learning, smart maintenance planners can be developed, which is a precursor to achieving a smart factory.
• Score: 1.6447597767676658
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Systems and machines undergo various failure modes that result in machine health degradation, so maintenance actions are required to restore them back to a state where they can perform their expected functions. Since maintenance tasks are inevitable, maintenance planning is essential to ensure the smooth operations of the production system and other industries at large. Maintenance planning is a decision-making problem that aims at developing optimum maintenance policies and plans that help reduces maintenance costs, extend asset life, maximize their availability, and ultimately ensure workplace safety. Reinforcement learning is a data-driven decision-making algorithm that has been increasingly applied to develop dynamic maintenance plans while leveraging the continuous information from condition monitoring of the system and machine states. By leveraging the condition monitoring data of systems and machines with reinforcement learning, smart maintenance planners can be developed, which is a precursor to achieving a smart factory. This paper presents a literature review on the applications of reinforcement and deep reinforcement learning for maintenance planning and optimization problems. To capture the common ideas without losing touch with the uniqueness of each publication, taxonomies used to categorize the systems were developed, and reviewed publications were highlighted, classified, and summarized based on these taxonomies. Adopted methodologies, findings, and well-defined interpretations of the reviewed studies were summarized in graphical and tabular representations to maximize the utility of the work for both researchers and practitioners. This work also highlights the research gaps, key insights from the literature, and areas for future work.

Related papers

• LLM-R: A Framework for Domain-Adaptive Maintenance Scheme Generation Combining Hierarchical Agents and RAG [7.864939415613373]
  This paper proposes a Maintenance Scheme Generation Method based on Large Language Models (LLM-R) The proposed method includes several key innovations. The experimental results show that the accuracy of the maintenance schemes generated by the proposed method reached 91.59%.
  arXiv  Detail & Related papers  (2024-11-07T07:07:34Z)
• Charting a Path to Efficient Onboarding: The Role of Software Visualization [49.1574468325115]
  The present study aims to explore the familiarity of managers, leaders, and developers with software visualization tools. This approach incorporated quantitative and qualitative analyses of data collected from practitioners using questionnaires and semi-structured interviews.
  arXiv  Detail & Related papers  (2024-01-17T21:30:45Z)
• TranDRL: A Transformer-Driven Deep Reinforcement Learning Enabled Prescriptive Maintenance Framework [58.474610046294856]
  Industrial systems demand reliable predictive maintenance strategies to enhance operational efficiency and reduce downtime. This paper introduces an integrated framework that leverages the capabilities of the Transformer model-based neural networks and deep reinforcement learning (DRL) algorithms to optimize system maintenance actions.
  arXiv  Detail & Related papers  (2023-09-29T02:27:54Z)
• Learning Goal-Conditioned Policies Offline with Self-Supervised Reward Shaping [94.89128390954572]
  We propose a novel self-supervised learning phase on the pre-collected dataset to understand the structure and the dynamics of the model. We evaluate our method on three continuous control tasks, and show that our model significantly outperforms existing approaches.
  arXiv  Detail & Related papers  (2023-01-05T15:07:10Z)
• An Offline Deep Reinforcement Learning for Maintenance Decision-Making [10.244120641608447]
  We present a maintenance framework based on offline supervised deep reinforcement learning. Using offline reinforcement learning makes it possible to learn the optimum maintenance policy from historical data.
  arXiv  Detail & Related papers  (2021-09-28T03:40:55Z)
• Reinforcement Learning based Condition-oriented Maintenance Scheduling for Flow Line Systems [31.64715462538063]
  This paper introduces a deep reinforcement learning approach for condition-oriented maintenance scheduling in flow line systems. Different policies are learned, analyzed and evaluated against a benchmark scheduling based on reward modelling. The evaluation of the learned policies shows that reinforcement learning based maintenance strategies meet the requirements of the presented use case and are suitable for maintenance scheduling in the shop floor.
  arXiv  Detail & Related papers  (2021-08-27T14:21:07Z)
• VisioRed: A Visualisation Tool for Interpretable Predictive Maintenance [5.845912816093006]
  Using machine learning, predictive and prescriptive maintenance attempt to anticipate and prevent eventual system failures. This paper introduces a visualisation tool incorporating interpretations to display information derived from predictive maintenance models, trained on time-series data.
  arXiv  Detail & Related papers  (2021-03-31T11:35:51Z)
• A Cognitive Approach based on the Actionable Knowledge Graph for supporting Maintenance Operations [3.3198770589233284]
  We propose a cognitive system that learns from past interventions to generate contextual recommendations for improving maintenance practices. The system uses formal conceptual models, incremental learning, and ranking algorithms to accomplish these objectives.
  arXiv  Detail & Related papers  (2020-11-18T21:53:00Z)
• Monitoring and explainability of models in production [58.720142291102135]
  Monitoring deployed models is crucial for continued provision of high quality machine learning enabled services. We discuss the challenges to successful implementation of solutions in each of these areas with some recent examples of production ready solutions using open source tools.
  arXiv  Detail & Related papers  (2020-07-13T10:37:05Z)
• Predictive Maintenance for Edge-Based Sensor Networks: A Deep Reinforcement Learning Approach [68.40429597811071]
  The risk of unplanned equipment downtime can be minimized through Predictive Maintenance of revenue generating assets. A model-free Deep Reinforcement Learning algorithm is proposed for predictive equipment maintenance from an equipment-based sensor network context. Unlike traditional black-box regression models, the proposed algorithm self-learns an optimal maintenance policy and provides actionable recommendation for each equipment.
  arXiv  Detail & Related papers  (2020-07-07T10:00:32Z)
• Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodology [53.063411515511056]
  We propose a process model for the development of machine learning applications. The first phase combines business and data understanding as data availability oftentimes affects the feasibility of the project. The sixth phase covers state-of-the-art approaches for monitoring and maintenance of a machine learning applications.
  arXiv  Detail & Related papers  (2020-03-11T08:25:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.