Autoencoder based Anomaly Detection and Explained Fault Localization in
Industrial Cooling Systems
- URL: http://arxiv.org/abs/2210.08011v1
- Date: Fri, 14 Oct 2022 09:28:49 GMT
- Title: Autoencoder based Anomaly Detection and Explained Fault Localization in
Industrial Cooling Systems
- Authors: Stephanie Holly, Robin Heel, Denis Katic, Leopold Schoeffl, Andreas
Stiftinger, Peter Holzner, Thomas Kaufmann, Bernhard Haslhofer, Daniel
Schall, Clemens Heitzinger and Jana Kemnitz
- Abstract summary: We present an autoencoder based end-to-end workflow for anomaly detection in large industrial cooling systems.
We identify system failures using a threshold on the total reconstruction error.
For fault localization, we compute the individual reconstruction error.
- Score: 0.32956425475258266
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Anomaly detection in large industrial cooling systems is very challenging due
to the high data dimensionality, inconsistent sensor recordings, and lack of
labels. The state of the art for automated anomaly detection in these systems
typically relies on expert knowledge and thresholds. However, data is viewed
isolated and complex, multivariate relationships are neglected. In this work,
we present an autoencoder based end-to-end workflow for anomaly detection
suitable for multivariate time series data in large industrial cooling systems,
including explained fault localization and root cause analysis based on expert
knowledge. We identify system failures using a threshold on the total
reconstruction error (autoencoder reconstruction error including all sensor
signals). For fault localization, we compute the individual reconstruction
error (autoencoder reconstruction error for each sensor signal) allowing us to
identify the signals that contribute most to the total reconstruction error.
Expert knowledge is provided via look-up table enabling root-cause analysis and
assignment to the affected subsystem. We demonstrated our findings in a cooling
system unit including 34 sensors over a 8-months time period using 4-fold cross
validation approaches and automatically created labels based on thresholds
provided by domain experts. Using 4-fold cross validation, we reached a
F1-score of 0.56, whereas the autoencoder results showed a higher consistency
score (CS of 0.92) compared to the automatically created labels (CS of 0.62) --
indicating that the anomaly is recognized in a very stable manner. The main
anomaly was found by the autoencoder and automatically created labels and was
also recorded in the log files. Further, the explained fault localization
highlighted the most affected component for the main anomaly in a very
consistent manner.
Related papers
- Representing Timed Automata and Timing Anomalies of Cyber-Physical
Production Systems in Knowledge Graphs [51.98400002538092]
This paper aims to improve model-based anomaly detection in CPPS by combining the learned timed automaton with a formal knowledge graph about the system.
Both the model and the detected anomalies are described in the knowledge graph in order to allow operators an easier interpretation of the model and the detected anomalies.
arXiv Detail & Related papers (2023-08-25T15:25:57Z) - PULL: Reactive Log Anomaly Detection Based On Iterative PU Learning [58.85063149619348]
We propose PULL, an iterative log analysis method for reactive anomaly detection based on estimated failure time windows.
Our evaluation shows that PULL consistently outperforms ten benchmark baselines across three different datasets.
arXiv Detail & Related papers (2023-01-25T16:34:43Z) - Detecting and Ranking Causal Anomalies in End-to-End Complex System [10.02817768857185]
We propose a framework called Ranking Causal Anomalies in End-to-End System (RCAE2E)
Based on these problems, we propose a framework called Ranking Causal Anomalies in End-to-End System (RCAE2E)
arXiv Detail & Related papers (2023-01-18T03:09:28Z) - A Robust and Explainable Data-Driven Anomaly Detection Approach For
Power Electronics [56.86150790999639]
We present two anomaly detection and classification approaches, namely the Matrix Profile algorithm and anomaly transformer.
The Matrix Profile algorithm is shown to be well suited as a generalizable approach for detecting real-time anomalies in streaming time-series data.
A series of custom filters is created and added to the detector to tune its sensitivity, recall, and detection accuracy.
arXiv Detail & Related papers (2022-09-23T06:09:35Z) - Denoising Architecture for Unsupervised Anomaly Detection in Time-Series [0.0]
We introduce the Denoising Architecture as a complement to this LSTM-Decoder model.
We demonstrate that the proposed architecture increases both the accuracy and the training speed, thereby, making the LSTM Autoencoder more efficient for unsupervised anomaly detection tasks.
arXiv Detail & Related papers (2022-08-30T15:23:45Z) - DeCorus: Hierarchical Multivariate Anomaly Detection at Cloud-Scale [0.0]
We describe the implementation of DeCorus an online log anomaly detection tool for network device syslog messages deployed at a cloud service provider.
We use real-world data sets that consist of $1.5$ billion network device syslog messages and hundreds of incident tickets to characterize the performance of DeCorus.
arXiv Detail & Related papers (2022-02-14T17:33:00Z) - Smart Metering System Capable of Anomaly Detection by Bi-directional
LSTM Autoencoder [0.6649973446180738]
Anomaly detection is concerned with a wide range of applications such as fault detection, system monitoring, and event detection.
This paper presents an anomaly detection process to find outliers observed in the smart metering system.
BiLSTM based autoencoder is used and finds the anomalous data point.
arXiv Detail & Related papers (2021-12-06T12:34:59Z) - DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly
detection in air transportation [68.8204255655161]
We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE)
It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase.
Results show that the DAE achieves better results in both accuracy and speed of detection.
arXiv Detail & Related papers (2021-09-08T14:07:55Z) - Bayesian Autoencoders for Drift Detection in Industrial Environments [69.93875748095574]
Autoencoders are unsupervised models which have been used for detecting anomalies in multi-sensor environments.
Anomalies can come either from real changes in the environment (real drift) or from faulty sensory devices (virtual drift)
arXiv Detail & Related papers (2021-07-28T10:19:58Z) - Unsupervised Anomaly Detection with Adversarial Mirrored AutoEncoders [51.691585766702744]
We propose a variant of Adversarial Autoencoder which uses a mirrored Wasserstein loss in the discriminator to enforce better semantic-level reconstruction.
We put forward an alternative measure of anomaly score to replace the reconstruction-based metric.
Our method outperforms the current state-of-the-art methods for anomaly detection on several OOD detection benchmarks.
arXiv Detail & Related papers (2020-03-24T08:26:58Z) - Anomaly Detection using Deep Autoencoders for in-situ Wastewater Systems
Monitoring Data [0.0]
This paper proposes an anomaly detection method based on a deep autoencoder for in-situ wastewater systems monitoring data.
Anomaly detection is then performed based on the reconstruction error of the decoding stage.
arXiv Detail & Related papers (2020-02-07T09:53:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.