Condition monitoring and anomaly detection in cyber-physical systems
- URL: http://arxiv.org/abs/2301.09030v1
- Date: Sun, 22 Jan 2023 00:58:01 GMT
- Title: Condition monitoring and anomaly detection in cyber-physical systems
- Authors: William Marfo, Deepak K. Tosh, Shirley V. Moore
- Abstract summary: This paper presents a comparative analysis of recent machine learning approaches for robust, cost-effective anomaly detection in cyber-physical systems.
For supervised cases, we achieve near-perfect accuracy of 98 percent.
In contrast, the best-case accuracy in the unsupervised cases was 63 percent.
- Score: 0.483420384410068
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The modern industrial environment is equipping myriads of smart manufacturing
machines where the state of each device can be monitored continuously. Such
monitoring can help identify possible future failures and develop a
cost-effective maintenance plan. However, it is a daunting task to perform
early detection with low false positives and negatives from the huge volume of
collected data. This requires developing a holistic machine learning framework
to address the issues in condition monitoring of high-priority components and
develop efficient techniques to detect anomalies that can detect and possibly
localize the faulty components. This paper presents a comparative analysis of
recent machine learning approaches for robust, cost-effective anomaly detection
in cyber-physical systems. While detection has been extensively studied, very
few researchers have analyzed the localization of the anomalies. We show that
supervised learning outperforms unsupervised algorithms. For supervised cases,
we achieve near-perfect accuracy of 98 percent (specifically for tree-based
algorithms). In contrast, the best-case accuracy in the unsupervised cases was
63 percent :the area under the receiver operating characteristic curve (AUC)
exhibits similar outcomes as an additional metric.
Related papers
- A Comprehensive Library for Benchmarking Multi-class Visual Anomaly Detection [52.228708947607636]
This paper introduces a comprehensive visual anomaly detection benchmark, ADer, which is a modular framework for new methods.
The benchmark includes multiple datasets from industrial and medical domains, implementing fifteen state-of-the-art methods and nine comprehensive metrics.
We objectively reveal the strengths and weaknesses of different methods and provide insights into the challenges and future directions of multi-class visual anomaly detection.
arXiv Detail & Related papers (2024-06-05T13:40:07Z) - Detection Latencies of Anomaly Detectors: An Overlooked Perspective ? [1.8492669447784602]
In this paper, we argue the relevance of measuring the temporal latency of attacks and errors.
We propose an evaluation approach for detectors to ensure a pragmatic trade-off between correct and in-time detection.
arXiv Detail & Related papers (2024-02-14T10:52:39Z) - Progressing from Anomaly Detection to Automated Log Labeling and
Pioneering Root Cause Analysis [53.24804865821692]
This study introduces a taxonomy for log anomalies and explores automated data labeling to mitigate labeling challenges.
The study envisions a future where root cause analysis follows anomaly detection, unraveling the underlying triggers of anomalies.
arXiv Detail & Related papers (2023-12-22T15:04:20Z) - PULL: Reactive Log Anomaly Detection Based On Iterative PU Learning [58.85063149619348]
We propose PULL, an iterative log analysis method for reactive anomaly detection based on estimated failure time windows.
Our evaluation shows that PULL consistently outperforms ten benchmark baselines across three different datasets.
arXiv Detail & Related papers (2023-01-25T16:34:43Z) - A Robust and Explainable Data-Driven Anomaly Detection Approach For
Power Electronics [56.86150790999639]
We present two anomaly detection and classification approaches, namely the Matrix Profile algorithm and anomaly transformer.
The Matrix Profile algorithm is shown to be well suited as a generalizable approach for detecting real-time anomalies in streaming time-series data.
A series of custom filters is created and added to the detector to tune its sensitivity, recall, and detection accuracy.
arXiv Detail & Related papers (2022-09-23T06:09:35Z) - Towards an Awareness of Time Series Anomaly Detection Models'
Adversarial Vulnerability [21.98595908296989]
We demonstrate that the performance of state-of-the-art anomaly detection methods is degraded substantially by adding only small adversarial perturbations to the sensor data.
We use different scoring metrics such as prediction errors, anomaly, and classification scores over several public and private datasets.
We demonstrate, for the first time, the vulnerabilities of anomaly detection systems against adversarial attacks.
arXiv Detail & Related papers (2022-08-24T01:55:50Z) - Functional Anomaly Detection: a Benchmark Study [4.444788548423704]
Anomaly detection can now rely on measurements sampled at a very high frequency.
It is the purpose of this paper to investigate the performance of recent techniques for anomaly detection in the functional setup on real datasets.
arXiv Detail & Related papers (2022-01-13T18:20:32Z) - Canonical Polyadic Decomposition and Deep Learning for Machine Fault
Detection [0.0]
It is impossible to collect enough data to learn all types of faults from a machine.
New algorithms, trained using data from healthy conditions only, were developed to perform unsupervised anomaly detection.
A key issue in the development of these algorithms is the noise in the signals, as it impacts the anomaly detection performance.
arXiv Detail & Related papers (2021-07-20T14:06:50Z) - Anomaly Detection in Cybersecurity: Unsupervised, Graph-Based and
Supervised Learning Methods in Adversarial Environments [63.942632088208505]
Inherent to today's operating environment is the practice of adversarial machine learning.
In this work, we examine the feasibility of unsupervised learning and graph-based methods for anomaly detection.
We incorporate a realistic adversarial training mechanism when training our supervised models to enable strong classification performance in adversarial environments.
arXiv Detail & Related papers (2021-05-14T10:05:10Z) - No Need to Know Physics: Resilience of Process-based Model-free Anomaly
Detection for Industrial Control Systems [95.54151664013011]
We present a novel framework to generate adversarial spoofing signals that violate physical properties of the system.
We analyze four anomaly detectors published at top security conferences.
arXiv Detail & Related papers (2020-12-07T11:02:44Z) - Smart Anomaly Detection in Sensor Systems: A Multi-Perspective Review [0.0]
Anomaly detection is concerned with identifying data patterns that deviate remarkably from the expected behaviour.
This is an important research problem, due to its broad set of application domains, from data analysis to e-health, cybersecurity, predictive maintenance, fault prevention, and industrial automation.
We review state-of-the-art methods that may be employed to detect anomalies in the specific area of sensor systems.
arXiv Detail & Related papers (2020-10-27T09:56:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.