Smart Metering System Capable of Anomaly Detection by Bi-directional LSTM Autoencoder

• URL: http://arxiv.org/abs/2112.03275v1
• Date: Mon, 6 Dec 2021 12:34:59 GMT
• Title: Smart Metering System Capable of Anomaly Detection by Bi-directional LSTM Autoencoder
• Authors: Sangkeum Lee, Hojun Jin, Sarvar Hussain Nengroo, Yoonmee Doh, Chungho Lee, Taewook Heo, Dongsoo Har
• Abstract summary: Anomaly detection is concerned with a wide range of applications such as fault detection, system monitoring, and event detection. This paper presents an anomaly detection process to find outliers observed in the smart metering system. BiLSTM based autoencoder is used and finds the anomalous data point.
• Score: 0.6649973446180738
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Anomaly detection is concerned with a wide range of applications such as fault detection, system monitoring, and event detection. Identifying anomalies from metering data obtained from smart metering system is a critical task to enhance reliability, stability, and efficiency of the power system. This paper presents an anomaly detection process to find outliers observed in the smart metering system. In the proposed approach, bi-directional long short-term memory (BiLSTM) based autoencoder is used and finds the anomalous data point. It calculates the reconstruction error through autoencoder with the non-anomalous data, and the outliers to be classified as anomalies are separated from the non-anomalous data by predefined threshold. Anomaly detection method based on the BiLSTM autoencoder is tested with the metering data corresponding to 4 types of energy sources electricity/water/heating/hot water collected from 985 households.

Related papers

• Anomaly Detection of Tabular Data Using LLMs [54.470648484612866]
  We show that pre-trained large language models (LLMs) are zero-shot batch-level anomaly detectors. We propose an end-to-end fine-tuning strategy to bring out the potential of LLMs in detecting real anomalies.
  arXiv  Detail & Related papers  (2024-06-24T04:17:03Z)
• An Improved Anomaly Detection Model for Automated Inspection of Power Line Insulators [0.0]
  Inspection of insulators is important to ensure reliable operation of the power system. Deep learning is being increasingly exploited to automate the inspection process. This article proposes the use of anomaly detection along with object detection in a two-stage approach for incipient fault detection.
  arXiv  Detail & Related papers  (2023-11-14T11:36:20Z)
• Autoencoder-based Anomaly Detection System for Online Data Quality Monitoring of the CMS Electromagnetic Calorimeter [0.0]
  A real-time autoencoder-based anomaly detection system using semi-supervised machine learning is presented. A novel method is introduced which maximizes the anomaly detection performance by exploiting the time-dependent evolution of anomalies. The performance of the system is validated with anomalies found in 2018 and 2022 LHC collision data.
  arXiv  Detail & Related papers  (2023-09-18T21:11:25Z)
• Interactive System-wise Anomaly Detection [66.3766756452743]
  Anomaly detection plays a fundamental role in various applications. It is challenging for existing methods to handle the scenarios where the instances are systems whose characteristics are not readily observed as data. We develop an end-to-end approach which includes an encoder-decoder module that learns system embeddings.
  arXiv  Detail & Related papers  (2023-04-21T02:20:24Z)
• A Bi-LSTM Autoencoder Framework for Anomaly Detection -- A Case Study of a Wind Power Dataset [2.094022863940315]
  Anomalies refer to data points or events that deviate from normal and homogeneous events. This study presents a novel framework for time series anomaly detection using a combination of Bi-LSTM architecture and Autoencoder. The Bi-LSTM Autoencoder model achieved a classification accuracy of 96.79% and outperformed more commonly used LSTM Autoencoder models.
  arXiv  Detail & Related papers  (2023-03-17T00:24:28Z)
• Autoencoder based Anomaly Detection and Explained Fault Localization in Industrial Cooling Systems [0.32956425475258266]
  We present an autoencoder based end-to-end workflow for anomaly detection in large industrial cooling systems. We identify system failures using a threshold on the total reconstruction error. For fault localization, we compute the individual reconstruction error.
  arXiv  Detail & Related papers  (2022-10-14T09:28:49Z)
• A Robust and Explainable Data-Driven Anomaly Detection Approach For Power Electronics [56.86150790999639]
  We present two anomaly detection and classification approaches, namely the Matrix Profile algorithm and anomaly transformer. The Matrix Profile algorithm is shown to be well suited as a generalizable approach for detecting real-time anomalies in streaming time-series data. A series of custom filters is created and added to the detector to tune its sensitivity, recall, and detection accuracy.
  arXiv  Detail & Related papers  (2022-09-23T06:09:35Z)
• Smart Meter Data Anomaly Detection using Variational Recurrent Autoencoders with Attention [0.0]
  This paper proposes an unsupervised anomaly detection method based on a Variational Recurrent Autoencoder with attention mechanism. With "dirty" data from smart meters, our method pre-detects missing values and global anomalies to shrink their contribution while training.
  arXiv  Detail & Related papers  (2022-06-08T19:39:51Z)
• DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly detection in air transportation [68.8204255655161]
  We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE) It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase. Results show that the DAE achieves better results in both accuracy and speed of detection.
  arXiv  Detail & Related papers  (2021-09-08T14:07:55Z)
• Unsupervised Anomaly Detection with Adversarial Mirrored AutoEncoders [51.691585766702744]
  We propose a variant of Adversarial Autoencoder which uses a mirrored Wasserstein loss in the discriminator to enforce better semantic-level reconstruction. We put forward an alternative measure of anomaly score to replace the reconstruction-based metric. Our method outperforms the current state-of-the-art methods for anomaly detection on several OOD detection benchmarks.
  arXiv  Detail & Related papers  (2020-03-24T08:26:58Z)
• Adaptive Anomaly Detection for IoT Data in Hierarchical Edge Computing [71.86955275376604]
  We propose an adaptive anomaly detection approach for hierarchical edge computing (HEC) systems to solve this problem. We design an adaptive scheme to select one of the models based on the contextual information extracted from input data, to perform anomaly detection. We evaluate our proposed approach using a real IoT dataset, and demonstrate that it reduces detection delay by 84% while maintaining almost the same accuracy as compared to offloading detection tasks to the cloud.
  arXiv  Detail & Related papers  (2020-01-10T05:29:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.