A Federated Learning Approach to Anomaly Detection in Smart Buildings
- URL: http://arxiv.org/abs/2010.10293v3
- Date: Wed, 23 Jun 2021 20:16:15 GMT
- Title: A Federated Learning Approach to Anomaly Detection in Smart Buildings
- Authors: Raed Abdel Sater and A. Ben Hamza
- Abstract summary: We formulate the anomaly detection problem in a federated learning setting by leveraging the multi-task learning paradigm.
We propose a novel privacy-by-design federated learning model using a stacked long short-time memory (LSTM) model.
We demonstrate that it is more than twice as fast during training convergence compared to the centralized LSTM.
- Score: 5.177947445379688
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Internet of Things (IoT) sensors in smart buildings are becoming increasingly
ubiquitous, making buildings more livable, energy efficient, and sustainable.
These devices sense the environment and generate multivariate temporal data of
paramount importance for detecting anomalies and improving the prediction of
energy usage in smart buildings. However, detecting these anomalies in
centralized systems is often plagued by a huge delay in response time. To
overcome this issue, we formulate the anomaly detection problem in a federated
learning setting by leveraging the multi-task learning paradigm, which aims at
solving multiple tasks simultaneously while taking advantage of the
similarities and differences across tasks. We propose a novel privacy-by-design
federated learning model using a stacked long short-time memory (LSTM) model,
and we demonstrate that it is more than twice as fast during training
convergence compared to the centralized LSTM. The effectiveness of our
federated learning approach is demonstrated on three real-world datasets
generated by the IoT production system at General Electric Current smart
building, achieving state-of-the-art performance compared to baseline methods
in both classification and regression tasks. Our experimental results
demonstrate the effectiveness of the proposed framework in reducing the overall
training cost without compromising the prediction performance.
Related papers
- Normalization and effective learning rates in reinforcement learning [52.59508428613934]
Normalization layers have recently experienced a renaissance in the deep reinforcement learning and continual learning literature.
We show that normalization brings with it a subtle but important side effect: an equivalence between growth in the norm of the network parameters and decay in the effective learning rate.
We propose to make the learning rate schedule explicit with a simple re- parameterization which we call Normalize-and-Project.
arXiv Detail & Related papers (2024-07-01T20:58:01Z) - Effective Intrusion Detection in Heterogeneous Internet-of-Things Networks via Ensemble Knowledge Distillation-based Federated Learning [52.6706505729803]
We introduce Federated Learning (FL) to collaboratively train a decentralized shared model of Intrusion Detection Systems (IDS)
FLEKD enables a more flexible aggregation method than conventional model fusion techniques.
Experiment results show that the proposed approach outperforms local training and traditional FL in terms of both speed and performance.
arXiv Detail & Related papers (2024-01-22T14:16:37Z) - GATGPT: A Pre-trained Large Language Model with Graph Attention Network
for Spatiotemporal Imputation [19.371155159744934]
In real-world settings, such data often contain missing elements due to issues like sensor malfunctions and data transmission errors.
The objective oftemporal imputation is to estimate these missing values by understanding the inherent spatial and temporal relationships in the observed time series.
Traditionally, intricatetemporal imputation has relied on specific architectures, which suffer from limited applicability and high computational complexity.
In contrast our approach integrates pre-trained large language models (LLMs) into intricatetemporal imputation, introducing a groundbreaking framework, GATGPT.
arXiv Detail & Related papers (2023-11-24T08:15:11Z) - Time-sensitive Learning for Heterogeneous Federated Edge Intelligence [52.83633954857744]
We investigate real-time machine learning in a federated edge intelligence (FEI) system.
FEI systems exhibit heterogenous communication and computational resource distribution.
We propose a time-sensitive federated learning (TS-FL) framework to minimize the overall run-time for collaboratively training a shared ML model.
arXiv Detail & Related papers (2023-01-26T08:13:22Z) - Spatio-Temporal Federated Learning for Massive Wireless Edge Networks [23.389249751372393]
An edge server and numerous mobile devices (clients) jointly learn a global model without transporting huge amount of data collected by the mobile devices to the edge server.
The proposed FL approach exploits spatial and temporal correlations between learning updates from different mobile devices scheduled to join STFL in various trainings.
An analytical framework of STFL is proposed and employed to study the learning capability of STFL via its convergence performance.
arXiv Detail & Related papers (2021-10-27T16:46:45Z) - Adaptive Anomaly Detection for Internet of Things in Hierarchical Edge
Computing: A Contextual-Bandit Approach [81.5261621619557]
We propose an adaptive anomaly detection scheme with hierarchical edge computing (HEC)
We first construct multiple anomaly detection DNN models with increasing complexity, and associate each of them to a corresponding HEC layer.
Then, we design an adaptive model selection scheme that is formulated as a contextual-bandit problem and solved by using a reinforcement learning policy network.
arXiv Detail & Related papers (2021-08-09T08:45:47Z) - Unsupervised Monocular Depth Learning with Integrated Intrinsics and
Spatio-Temporal Constraints [61.46323213702369]
This work presents an unsupervised learning framework that is able to predict at-scale depth maps and egomotion.
Our results demonstrate strong performance when compared to the current state-of-the-art on multiple sequences of the KITTI driving dataset.
arXiv Detail & Related papers (2020-11-02T22:26:58Z) - Towards Smart Sustainable Cities: Addressing semantic heterogeneity in
building management systems using discriminative models [0.0]
Building Management Systems (BMS) are crucial in the drive towards smart sustainable cities.
In this paper, we address the problem of inferring the semantics of IoT devices using machine learning models.
Our study highlights the potential of Image Encoded Time Series (IETS) as a robust alternative to statistical feature-based inference methods.
arXiv Detail & Related papers (2020-08-17T15:39:11Z) - Fast-Convergent Federated Learning [82.32029953209542]
Federated learning is a promising solution for distributing machine learning tasks through modern networks of mobile devices.
We propose a fast-convergent federated learning algorithm, called FOLB, which performs intelligent sampling of devices in each round of model training.
arXiv Detail & Related papers (2020-07-26T14:37:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.