SECOE: Alleviating Sensors Failure in Machine Learning-Coupled IoT
Systems
- URL: http://arxiv.org/abs/2210.02144v1
- Date: Wed, 5 Oct 2022 10:58:39 GMT
- Title: SECOE: Alleviating Sensors Failure in Machine Learning-Coupled IoT
Systems
- Authors: Yousef AlShehri and Lakshmish Ramaswamy
- Abstract summary: This paper proposes SECOE, a proactive approach for alleviating potentially simultaneous sensor failures.
SECOE includes a novel technique to minimize the number of models in the ensemble by harnessing the correlations among sensors.
Experiments reveal that SECOE effectively preserves prediction accuracy in the presence of sensor failures.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Machine learning (ML) applications continue to revolutionize many domains. In
recent years, there has been considerable research interest in building novel
ML applications for a variety of Internet of Things (IoT) domains, such as
precision agriculture, smart cities, and smart manufacturing. IoT domains are
characterized by continuous streams of data originating from diverse,
geographically distributed sensors, and they often require a real-time or
semi-real-time response. IoT characteristics pose several fundamental
challenges to designing and implementing effective ML applications.
Sensor/network failures that result in data stream interruptions is one such
challenge. Unfortunately, the performance of many ML applications quickly
degrades when faced with data incompleteness. Current techniques to handle data
incompleteness are based upon data imputation ( i.e., they try to fill-in
missing data). Unfortunately, these techniques may fail, especially when
multiple sensors' data streams become concurrently unavailable (due to
simultaneous sensor failures). With the aim of building robust IoT-coupled ML
applications, this paper proposes SECOE, a unique, proactive approach for
alleviating potentially simultaneous sensor failures. The fundamental idea
behind SECOE is to create a carefully chosen ensemble of ML models in which
each model is trained assuming a set of failed sensors (i.e., the training set
omits corresponding values). SECOE includes a novel technique to minimize the
number of models in the ensemble by harnessing the correlations among sensors.
We demonstrate the efficacy of the SECOE approach through a series of
experiments involving three distinct datasets. The experimental findings reveal
that SECOE effectively preserves prediction accuracy in the presence of sensor
failures.
Related papers
- An Energy-Efficient Ensemble Approach for Mitigating Data Incompleteness in IoT Applications [0.0]
It is important to build IoT-based Machine Learning systems that are robust against data incompleteness while simultaneously being energy efficient.
ENAMLE is a proactive, energy-aware technique for mitigating the impact of concurrent missing data.
We present extensive experimental studies on two distinct datasets that demonstrate the energy efficiency of ENAMLE.
arXiv Detail & Related papers (2024-03-15T15:01:48Z) - A Plug-in Tiny AI Module for Intelligent and Selective Sensor Data
Transmission [10.174575604689391]
We propose a novel sensing module to equip sensing frameworks with intelligent data transmission capabilities.
We integrate a highly efficient machine learning model placed near the sensor.
This model provides prompt feedback for the sensing system to transmit only valuable data while discarding irrelevant information.
arXiv Detail & Related papers (2024-02-03T05:41:39Z) - Effective Intrusion Detection in Heterogeneous Internet-of-Things Networks via Ensemble Knowledge Distillation-based Federated Learning [52.6706505729803]
We introduce Federated Learning (FL) to collaboratively train a decentralized shared model of Intrusion Detection Systems (IDS)
FLEKD enables a more flexible aggregation method than conventional model fusion techniques.
Experiment results show that the proposed approach outperforms local training and traditional FL in terms of both speed and performance.
arXiv Detail & Related papers (2024-01-22T14:16:37Z) - Missing Value Imputation for Multi-attribute Sensor Data Streams via
Message Propagation (Extended Version) [25.022656067909523]
We propose a message propagation imputation network (MPIN) that is able to recover the missing values of data instances in a time window.
MPIN can outperform the existing data imputers by wide margins and that the continuous imputation framework is efficient and accurate.
arXiv Detail & Related papers (2023-11-13T14:01:04Z) - DynImp: Dynamic Imputation for Wearable Sensing Data Through Sensory and
Temporal Relatedness [78.98998551326812]
We argue that traditional methods have rarely made use of both times-series dynamics of the data as well as the relatedness of the features from different sensors.
We propose a model, termed as DynImp, to handle different time point's missingness with nearest neighbors along feature axis.
We show that the method can exploit the multi-modality features from related sensors and also learn from history time-series dynamics to reconstruct the data under extreme missingness.
arXiv Detail & Related papers (2022-09-26T21:59:14Z) - Online Data Selection for Federated Learning with Limited Storage [53.46789303416799]
Federated Learning (FL) has been proposed to achieve distributed machine learning among networked devices.
The impact of on-device storage on the performance of FL is still not explored.
In this work, we take the first step to consider the online data selection for FL with limited on-device storage.
arXiv Detail & Related papers (2022-09-01T03:27:33Z) - Anomaly Detection and Inter-Sensor Transfer Learning on Smart
Manufacturing Datasets [6.114996271792091]
In many cases, the goal of the smart manufacturing system is to rapidly detect (or anticipate) failures to reduce operational cost and eliminate downtime.
This often boils down to detecting anomalies within the sensor date acquired from the system.
The smart manufacturing application domain poses certain salient technical challenges.
We show that predictive failure classification can be achieved, thus paving the way for predictive maintenance.
arXiv Detail & Related papers (2022-06-13T17:51:24Z) - DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly
detection in air transportation [68.8204255655161]
We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE)
It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase.
Results show that the DAE achieves better results in both accuracy and speed of detection.
arXiv Detail & Related papers (2021-09-08T14:07:55Z) - Adaptive Anomaly Detection for Internet of Things in Hierarchical Edge
Computing: A Contextual-Bandit Approach [81.5261621619557]
We propose an adaptive anomaly detection scheme with hierarchical edge computing (HEC)
We first construct multiple anomaly detection DNN models with increasing complexity, and associate each of them to a corresponding HEC layer.
Then, we design an adaptive model selection scheme that is formulated as a contextual-bandit problem and solved by using a reinforcement learning policy network.
arXiv Detail & Related papers (2021-08-09T08:45:47Z) - Anomaly Detection through Transfer Learning in Agriculture and
Manufacturing IoT Systems [4.193524211159057]
In this paper, we analyze data from sensors deployed in an agricultural farm with data from seven different kinds of sensors, and from an advanced manufacturing testbed with vibration sensors.
We show how in these two application domains, predictive failure classification can be achieved, thus paving the way for predictive maintenance.
arXiv Detail & Related papers (2021-02-11T02:37:27Z) - Contextual-Bandit Anomaly Detection for IoT Data in Distributed
Hierarchical Edge Computing [65.78881372074983]
IoT devices can hardly afford complex deep neural networks (DNN) models, and offloading anomaly detection tasks to the cloud incurs long delay.
We propose and build a demo for an adaptive anomaly detection approach for distributed hierarchical edge computing (HEC) systems.
We show that our proposed approach significantly reduces detection delay without sacrificing accuracy, as compared to offloading detection tasks to the cloud.
arXiv Detail & Related papers (2020-04-15T06:13:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.