Industrial Machines Health Prognosis using a Transformer-based Framework

• URL: http://arxiv.org/abs/2411.14443v1
• Date: Tue, 05 Nov 2024 18:47:05 GMT
• Title: Industrial Machines Health Prognosis using a Transformer-based Framework
• Authors: David J Poland, Lemuel Puglisi, Daniele Ravi,
• Abstract summary: This article introduces Transformer Quantile Regression Neural Networks (TQRNNs) TQRNNs are a novel data-driven solution for real-time machine failure prediction in manufacturing contexts. Our findings demonstrate the model's effectiveness, achieving an accuracy rate of 70.84% with a 1-hour lead time for predicting machine breakdowns.
• Score: 0.0
• License:
• Abstract: This article introduces Transformer Quantile Regression Neural Networks (TQRNNs), a novel data-driven solution for real-time machine failure prediction in manufacturing contexts. Our objective is to develop an advanced predictive maintenance model capable of accurately identifying machine system breakdowns. To do so, TQRNNs employ a two-step approach: (i) a modified quantile regression neural network to segment anomaly outliers while maintaining low time complexity, and (ii) a concatenated transformer network aimed at facilitating accurate classification even within a large timeframe of up to one hour. We have implemented our proposed pipeline in a real-world beverage manufacturing industry setting. Our findings demonstrate the model's effectiveness, achieving an accuracy rate of 70.84% with a 1-hour lead time for predicting machine breakdowns. Additionally, our analysis shows that using TQRNNs can increase high-quality production, improving product yield from 78.38% to 89.62%. We believe that predictive maintenance assumes a pivotal role in modern manufacturing, minimizing unplanned downtime, reducing repair costs, optimizing production efficiency, and ensuring operational stability. Its potential to generate substantial cost savings while enhancing sustainability and competitiveness underscores its importance in contemporary manufacturing practices.

Related papers

• Enhanced Quantile Regression with Spiking Neural Networks for Long-Term System Health Prognostics [0.0]
  This paper presents a novel predictive maintenance framework centered on Enhanced Quantile Regression Neural Networks EQRNNs. We address the challenge of early failure detection through a hybrid approach that combines advanced neural architectures. The framework's effectiveness in processing complex, multi-modal sensor data while maintaining computational efficiency validates its applicability for Industry 4.0 manufacturing environments.
  arXiv  Detail & Related papers  (2025-01-09T09:11:40Z)
• PV-faultNet: Optimized CNN Architecture to detect defects resulting efficient PV production [0.0]
  This study presents PV-faultNet, a lightweight Convolutional Neural Network (CNN) architecture optimized for efficient and real-time defect detection in photovoltaic (PV) cells. The model includes only 2.92 million parameters, significantly reducing processing demands without sacrificing accuracy. It achieved high performance with 91% precision, 89% recall, and a 90% F1 score, demonstrating its effectiveness for scalable quality control in PV production.
  arXiv  Detail & Related papers  (2024-11-05T10:58:37Z)
• Sparse Attention-driven Quality Prediction for Production Process Optimization in Digital Twins [53.70191138561039]
  We propose to deploy a digital twin of the production line by encoding its operational logic in a data-driven approach. We adopt a quality prediction model for production process based on self-attention-enabled temporal convolutional neural networks. Our operation experiments on a specific tobacco shredding line demonstrate that the proposed digital twin-based production process optimization method fosters seamless integration between virtual and real production lines.
  arXiv  Detail & Related papers  (2024-05-20T09:28:23Z)
• A Computer Vision-Based Quality Assessment Technique for the automatic control of consumables for analytical laboratories [0.0]
  A novel automatic monitoring system is proposed in the context of production process of plastic consumables used in analysis laboratories. A hand-designed deep network model is used and compared with some state-of-the-art models for its ability to categorize different images of vials. Our model is remarkably superior in terms of its ability and requires significantly fewer resources.
  arXiv  Detail & Related papers  (2024-04-16T10:50:16Z)
• Strategic Data Augmentation with CTGAN for Smart Manufacturing: Enhancing Machine Learning Predictions of Paper Breaks in Pulp-and-Paper Production [3.2381236440149257]
  A significant challenge for predictive maintenance in the pulp-and-paper industry is the infrequency of paper breaks during the production process. In this article, operational data is analyzed from a paper manufacturing machine in which paper breaks are relatively rare but have a high economic impact. With the help of Conditional Generative Adrial Networks (CTGAN) and Synthetic Minority Oversampling Technique (SMOTE), we implement a novel data augmentation framework.
  arXiv  Detail & Related papers  (2023-11-15T19:47:15Z)
• TranDRL: A Transformer-Driven Deep Reinforcement Learning Enabled Prescriptive Maintenance Framework [58.474610046294856]
  Industrial systems demand reliable predictive maintenance strategies to enhance operational efficiency and reduce downtime. This paper introduces an integrated framework that leverages the capabilities of the Transformer model-based neural networks and deep reinforcement learning (DRL) algorithms to optimize system maintenance actions.
  arXiv  Detail & Related papers  (2023-09-29T02:27:54Z)
• A Generative Approach for Production-Aware Industrial Network Traffic Modeling [70.46446906513677]
  We investigate the network traffic data generated from a laser cutting machine deployed in a Trumpf factory in Germany. We analyze the traffic statistics, capture the dependencies between the internal states of the machine, and model the network traffic as a production state dependent process. We compare the performance of various generative models including variational autoencoder (VAE), conditional variational autoencoder (CVAE), and generative adversarial network (GAN)
  arXiv  Detail & Related papers  (2022-11-11T09:46:58Z)
• Effective Pre-Training Objectives for Transformer-based Autoencoders [97.99741848756302]
  We study trade-offs between efficiency, cost and accuracy of Transformer encoders. We combine features of common objectives and create new effective pre-training approaches.
  arXiv  Detail & Related papers  (2022-10-24T18:39:44Z)
• Fault-Aware Design and Training to Enhance DNNs Reliability with Zero-Overhead [67.87678914831477]
  Deep Neural Networks (DNNs) enable a wide series of technological advancements. Recent findings indicate that transient hardware faults may corrupt the models prediction dramatically. In this work, we propose to tackle the reliability issue both at training and model design time.
  arXiv  Detail & Related papers  (2022-05-28T13:09:30Z)
• Federated Learning with Unreliable Clients: Performance Analysis and Mechanism Design [76.29738151117583]
  Federated Learning (FL) has become a promising tool for training effective machine learning models among distributed clients. However, low quality models could be uploaded to the aggregator server by unreliable clients, leading to a degradation or even a collapse of training. We model these unreliable behaviors of clients and propose a defensive mechanism to mitigate such a security risk.
  arXiv  Detail & Related papers  (2021-05-10T08:02:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.