Data-driven Residual Generation for Early Fault Detection with Limited
Data
- URL: http://arxiv.org/abs/2110.15385v1
- Date: Tue, 28 Sep 2021 03:18:03 GMT
- Title: Data-driven Residual Generation for Early Fault Detection with Limited
Data
- Authors: Hamed Khorasgani, Ahmed Farahat, and Chetan Gupta
- Abstract summary: In many complex systems it is not feasible to develop highly accurate models for the systems.
Data-driven solutions have received an immense attention in the industries systems for several practical reasons.
Unlike the model-based methods it is straight forward to combine time series measurements such as pressure and voltage with other sources of information.
- Score: 4.129225533930966
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Traditionally, fault detection and isolation community has used system
dynamic equations to generate diagnosers and to analyze detectability and
isolability of the dynamic systems. Model-based fault detection and isolation
methods use system model to generate a set of residuals as the bases for fault
detection and isolation. However, in many complex systems it is not feasible to
develop highly accurate models for the systems and to keep the models updated
during the system lifetime. Recently, data-driven solutions have received an
immense attention in the industries systems for several practical reasons.
First, these methods do not require the initial investment and expertise for
developing accurate models. Moreover, it is possible to automatically update
and retrain the diagnosers as the system or the environment change over time.
Finally, unlike the model-based methods it is straight forward to combine time
series measurements such as pressure and voltage with other sources of
information such as system operating hours to achieve a higher accuracy. In
this paper, we extend the traditional model-based fault detection and isolation
concepts such as residuals, and detectable and isolable faults to the
data-driven domain. We then propose an algorithm to automatically generate
residuals from the normal operating data. We present the performance of our
proposed approach through a comparative case study.
Related papers
- Root Causing Prediction Anomalies Using Explainable AI [3.970146574042422]
We present a novel application of explainable AI (XAI) for root-causing performance degradation in machine learning models.
A single feature corruption can cause cascading feature, label and concept drifts.
We have successfully applied this technique to improve the reliability of models used in personalized advertising.
arXiv Detail & Related papers (2024-03-04T19:38:50Z) - Analysis of Numerical Integration in RNN-Based Residuals for Fault
Diagnosis of Dynamic Systems [0.6999740786886536]
The paper includes a case study of a heavy-duty truck's after-treatment system to highlight the potential of these techniques for improving fault diagnosis performance.
Data-driven modeling and machine learning are widely used to model the behavior of dynamic systems.
arXiv Detail & Related papers (2023-05-08T12:48:18Z) - Interactive System-wise Anomaly Detection [66.3766756452743]
Anomaly detection plays a fundamental role in various applications.
It is challenging for existing methods to handle the scenarios where the instances are systems whose characteristics are not readily observed as data.
We develop an end-to-end approach which includes an encoder-decoder module that learns system embeddings.
arXiv Detail & Related papers (2023-04-21T02:20:24Z) - Domain-aware Control-oriented Neural Models for Autonomous Underwater
Vehicles [2.4779082385578337]
We present control-oriented parametric models with varying levels of domain-awareness.
We employ universal differential equations to construct data-driven blackbox and graybox representations of the AUV dynamics.
arXiv Detail & Related papers (2022-08-15T17:01:14Z) - Causality-Based Multivariate Time Series Anomaly Detection [63.799474860969156]
We formulate the anomaly detection problem from a causal perspective and view anomalies as instances that do not follow the regular causal mechanism to generate the multivariate data.
We then propose a causality-based anomaly detection approach, which first learns the causal structure from data and then infers whether an instance is an anomaly relative to the local causal mechanism.
We evaluate our approach with both simulated and public datasets as well as a case study on real-world AIOps applications.
arXiv Detail & Related papers (2022-06-30T06:00:13Z) - Smart Meter Data Anomaly Detection using Variational Recurrent
Autoencoders with Attention [0.0]
This paper proposes an unsupervised anomaly detection method based on a Variational Recurrent Autoencoder with attention mechanism.
With "dirty" data from smart meters, our method pre-detects missing values and global anomalies to shrink their contribution while training.
arXiv Detail & Related papers (2022-06-08T19:39:51Z) - In-flight Novelty Detection with Convolutional Neural Networks [0.0]
This paper proposes that system output measurements are prioritised in real-time for the attention of preventative maintenance decision makers.
We present a data-driven system for online detection and prioritisation of anomalous data.
The system is capable of running in real-time on low-power embedded hardware and is currently in deployment on the Rolls-Royce Pearl 15 engine flight trials.
arXiv Detail & Related papers (2021-12-07T15:19:41Z) - Using Data Assimilation to Train a Hybrid Forecast System that Combines
Machine-Learning and Knowledge-Based Components [52.77024349608834]
We consider the problem of data-assisted forecasting of chaotic dynamical systems when the available data is noisy partial measurements.
We show that by using partial measurements of the state of the dynamical system, we can train a machine learning model to improve predictions made by an imperfect knowledge-based model.
arXiv Detail & Related papers (2021-02-15T19:56:48Z) - Anomaly Detection of Time Series with Smoothness-Inducing Sequential
Variational Auto-Encoder [59.69303945834122]
We present a Smoothness-Inducing Sequential Variational Auto-Encoder (SISVAE) model for robust estimation and anomaly detection of time series.
Our model parameterizes mean and variance for each time-stamp with flexible neural networks.
We show the effectiveness of our model on both synthetic datasets and public real-world benchmarks.
arXiv Detail & Related papers (2021-02-02T06:15:15Z) - A Novel Anomaly Detection Algorithm for Hybrid Production Systems based
on Deep Learning and Timed Automata [73.38551379469533]
DAD:DeepAnomalyDetection is a new approach for automatic model learning and anomaly detection in hybrid production systems.
It combines deep learning and timed automata for creating behavioral model from observations.
The algorithm has been applied to few data sets including two from real systems and has shown promising results.
arXiv Detail & Related papers (2020-10-29T08:27:43Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.