Adaptive Anomaly Detection for IoT Data in Hierarchical Edge Computing
- URL: http://arxiv.org/abs/2001.03314v1
- Date: Fri, 10 Jan 2020 05:29:17 GMT
- Title: Adaptive Anomaly Detection for IoT Data in Hierarchical Edge Computing
- Authors: Mao V. Ngo, Hakima Chaouchi, Tie Luo, Tony Q.S. Quek
- Abstract summary: We propose an adaptive anomaly detection approach for hierarchical edge computing (HEC) systems to solve this problem.
We design an adaptive scheme to select one of the models based on the contextual information extracted from input data, to perform anomaly detection.
We evaluate our proposed approach using a real IoT dataset, and demonstrate that it reduces detection delay by 84% while maintaining almost the same accuracy as compared to offloading detection tasks to the cloud.
- Score: 71.86955275376604
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Advances in deep neural networks (DNN) greatly bolster real-time detection of
anomalous IoT data. However, IoT devices can barely afford complex DNN models
due to limited computational power and energy supply. While one can offload
anomaly detection tasks to the cloud, it incurs long delay and requires large
bandwidth when thousands of IoT devices stream data to the cloud concurrently.
In this paper, we propose an adaptive anomaly detection approach for
hierarchical edge computing (HEC) systems to solve this problem. Specifically,
we first construct three anomaly detection DNN models of increasing complexity,
and associate them with the three layers of HEC from bottom to top, i.e., IoT
devices, edge servers, and cloud. Then, we design an adaptive scheme to select
one of the models based on the contextual information extracted from input
data, to perform anomaly detection. The selection is formulated as a contextual
bandit problem and is characterized by a single-step Markov decision process,
with an objective of achieving high detection accuracy and low detection delay
simultaneously. We evaluate our proposed approach using a real IoT dataset, and
demonstrate that it reduces detection delay by 84% while maintaining almost the
same accuracy as compared to offloading detection tasks to the cloud. In
addition, our evaluation also shows that it outperforms other baseline schemes.
Related papers
- A Robust and Explainable Data-Driven Anomaly Detection Approach For
Power Electronics [56.86150790999639]
We present two anomaly detection and classification approaches, namely the Matrix Profile algorithm and anomaly transformer.
The Matrix Profile algorithm is shown to be well suited as a generalizable approach for detecting real-time anomalies in streaming time-series data.
A series of custom filters is created and added to the detector to tune its sensitivity, recall, and detection accuracy.
arXiv Detail & Related papers (2022-09-23T06:09:35Z) - Exploring Scalable, Distributed Real-Time Anomaly Detection for Bridge
Health Monitoring [15.920402427606959]
Modern real-time Structural Health Monitoring systems can generate a considerable amount of information.
Current cloud-based solutions cannot scale if the raw data has to be collected from thousands of buildings.
This paper presents a full-stack deployment of an efficient and scalable anomaly detection pipeline for SHM systems.
arXiv Detail & Related papers (2022-03-04T15:37:20Z) - DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly
detection in air transportation [68.8204255655161]
We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE)
It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase.
Results show that the DAE achieves better results in both accuracy and speed of detection.
arXiv Detail & Related papers (2021-09-08T14:07:55Z) - Adaptive Anomaly Detection for Internet of Things in Hierarchical Edge
Computing: A Contextual-Bandit Approach [81.5261621619557]
We propose an adaptive anomaly detection scheme with hierarchical edge computing (HEC)
We first construct multiple anomaly detection DNN models with increasing complexity, and associate each of them to a corresponding HEC layer.
Then, we design an adaptive model selection scheme that is formulated as a contextual-bandit problem and solved by using a reinforcement learning policy network.
arXiv Detail & Related papers (2021-08-09T08:45:47Z) - TELESTO: A Graph Neural Network Model for Anomaly Classification in
Cloud Services [77.454688257702]
Machine learning (ML) and artificial intelligence (AI) are applied on IT system operation and maintenance.
One direction aims at the recognition of re-occurring anomaly types to enable remediation automation.
We propose a method that is invariant to dimensionality changes of given data.
arXiv Detail & Related papers (2021-02-25T14:24:49Z) - Deep Anomaly Detection for Time-series Data in Industrial IoT: A
Communication-Efficient On-device Federated Learning Approach [40.992167455141946]
This paper proposes a new communication-efficient on-device federated learning (FL)-based deep anomaly detection framework for sensing time-series data in IIoT.
We first introduce a FL framework to enable decentralized edge devices to collaboratively train an anomaly detection model, which can improve its generalization ability.
Second, we propose an Attention Mechanism-based Convolutional Neural Network-Long Short Term Memory (AMCNN-LSTM) model to accurately detect anomalies.
Third, to adapt the proposed framework to the timeliness of industrial anomaly detection, we propose a gradient compression mechanism based on Top-textitk selection to
arXiv Detail & Related papers (2020-07-19T16:47:26Z) - Contextual-Bandit Anomaly Detection for IoT Data in Distributed
Hierarchical Edge Computing [65.78881372074983]
IoT devices can hardly afford complex deep neural networks (DNN) models, and offloading anomaly detection tasks to the cloud incurs long delay.
We propose and build a demo for an adaptive anomaly detection approach for distributed hierarchical edge computing (HEC) systems.
We show that our proposed approach significantly reduces detection delay without sacrificing accuracy, as compared to offloading detection tasks to the cloud.
arXiv Detail & Related papers (2020-04-15T06:13:33Z) - Anomaly Detection using Deep Autoencoders for in-situ Wastewater Systems
Monitoring Data [0.0]
This paper proposes an anomaly detection method based on a deep autoencoder for in-situ wastewater systems monitoring data.
Anomaly detection is then performed based on the reconstruction error of the decoding stage.
arXiv Detail & Related papers (2020-02-07T09:53:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.