RelSen: An Optimization-based Framework for Simultaneously Sensor Reliability Monitoring and Data Cleaning

• URL: http://arxiv.org/abs/2004.08762v3
• Date: Thu, 6 Aug 2020 13:23:25 GMT
• Title: RelSen: An Optimization-based Framework for Simultaneously Sensor Reliability Monitoring and Data Cleaning
• Authors: Cheng Feng, Xiao Liang, Daniel Schneegass, PengWei Tian
• Abstract summary: In most sensing applications, sensors are known to be error-prone and their measurements can become misleading at any unexpected time. Existing studies often regard sensor reliability monitoring and sensor data cleaning as separate problems. We propose RelSen, a novel optimization-based framework to address the two problems simultaneously via utilizing the mutual dependence between them.
• Score: 7.359795285967954
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Recent advances in the Internet of Things (IoT) technology have led to a surge on the popularity of sensing applications. As a result, people increasingly rely on information obtained from sensors to make decisions in their daily life. Unfortunately, in most sensing applications, sensors are known to be error-prone and their measurements can become misleading at any unexpected time. Therefore, in order to enhance the reliability of sensing applications, apart from the physical phenomena/processes of interest, we believe it is also highly important to monitor the reliability of sensors and clean the sensor data before analysis on them being conducted. Existing studies often regard sensor reliability monitoring and sensor data cleaning as separate problems. In this work, we propose RelSen, a novel optimization-based framework to address the two problems simultaneously via utilizing the mutual dependence between them. Furthermore, RelSen is not application-specific as its implementation assumes a minimal prior knowledge of the process dynamics under monitoring. This significantly improves its generality and applicability in practice. In our experiments, we apply RelSen on an outdoor air pollution monitoring system and a condition monitoring system for a cement rotary kiln. Experimental results show that our framework can timely identify unreliable sensors and remove sensor measurement errors caused by three types of most commonly observed sensor faults.

Related papers

• Detection of Sensor-To-Sensor Variations using Explainable AI [2.2956649873563952]
  chemi-resistive gas sensing devices are plagued by issues of sensor variations during manufacturing. This study proposes a novel approach for detecting sensor-to-sensor variations in sensing devices using the explainable AI (XAI) method of SHapley Additive exPlanations (SHAP) The methodology is tested using artificial and realistic Ozone concentration profiles to train a Gated Recurrent Unit (GRU) model.
  arXiv  Detail & Related papers  (2023-06-19T11:00:54Z)
• Self-Supervised Anomaly Detection of Rogue Soil Moisture Sensors [2.374304682010306]
  A sensor is considered rogue when it provides incorrect measurements over time. Existing methods assume that well-behaving sensors are known or that a large majority of the sensors is well-behaving. We present a self-supervised anomalous sensor detector based on a neural network with a contrastive loss, followed by DBSCAN.
  arXiv  Detail & Related papers  (2023-05-09T14:47:16Z)
• On the Importance of Accurate Geometry Data for Dense 3D Vision Tasks [61.74608497496841]
  Training on inaccurate or corrupt data induces model bias and hampers generalisation capabilities. This paper investigates the effect of sensor errors for the dense 3D vision tasks of depth estimation and reconstruction.
  arXiv  Detail & Related papers  (2023-03-26T22:32:44Z)
• Environmental Sensor Placement with Convolutional Gaussian Neural Processes [65.13973319334625]
  It is challenging to place sensors in a way that maximises the informativeness of their measurements, particularly in remote regions like Antarctica. Probabilistic machine learning models can suggest informative sensor placements by finding sites that maximally reduce prediction uncertainty. This paper proposes using a convolutional Gaussian neural process (ConvGNP) to address these issues.
  arXiv  Detail & Related papers  (2022-11-18T17:25:14Z)
• Anomaly Detection and Inter-Sensor Transfer Learning on Smart Manufacturing Datasets [6.114996271792091]
  In many cases, the goal of the smart manufacturing system is to rapidly detect (or anticipate) failures to reduce operational cost and eliminate downtime. This often boils down to detecting anomalies within the sensor date acquired from the system. The smart manufacturing application domain poses certain salient technical challenges. We show that predictive failure classification can be achieved, thus paving the way for predictive maintenance.
  arXiv  Detail & Related papers  (2022-06-13T17:51:24Z)
• Sensor Sampling Trade-Offs for Air Quality Monitoring With Low-Cost Sensors [0.1957338076370071]
  We show the impact of the data sampling strategy in the calibration of tropospheric ozone, nitrogen dioxide and nitrogen monoxide low-cost sensors. Specifically, we show how a sampling strategy that minimizes the duty cycle of the sensing subsystem can reduce power consumption while maintaining data quality.
  arXiv  Detail & Related papers  (2021-12-14T11:05:55Z)
• Bandit Quickest Changepoint Detection [55.855465482260165]
  Continuous monitoring of every sensor can be expensive due to resource constraints. We derive an information-theoretic lower bound on the detection delay for a general class of finitely parameterized probability distributions. We propose a computationally efficient online sensing scheme, which seamlessly balances the need for exploration of different sensing options with exploitation of querying informative actions.
  arXiv  Detail & Related papers  (2021-07-22T07:25:35Z)
• Complex-valued Convolutional Neural Networks for Enhanced Radar Signal Denoising and Interference Mitigation [73.0103413636673]
  We propose the use of Complex-Valued Convolutional Neural Networks (CVCNNs) to address the issue of mutual interference between radar sensors. CVCNNs increase data efficiency, speeds up network training and substantially improves the conservation of phase information during interference removal.
  arXiv  Detail & Related papers  (2021-04-29T10:06:29Z)
• Anomaly Detection through Transfer Learning in Agriculture and Manufacturing IoT Systems [4.193524211159057]
  In this paper, we analyze data from sensors deployed in an agricultural farm with data from seven different kinds of sensors, and from an advanced manufacturing testbed with vibration sensors. We show how in these two application domains, predictive failure classification can be achieved, thus paving the way for predictive maintenance.
  arXiv  Detail & Related papers  (2021-02-11T02:37:27Z)
• Real-time detection of uncalibrated sensors using Neural Networks [62.997667081978825]
  An online machine-learning based uncalibration detector for temperature, humidity and pressure sensors was developed. The solution integrates an Artificial Neural Network as main component which learns from the behavior of the sensors under calibrated conditions. The obtained results show that the proposed solution is able to detect uncalibrations for deviation values of 0.25 degrees, 1% RH and 1.5 Pa, respectively.
  arXiv  Detail & Related papers  (2021-02-02T15:44:39Z)
• Energy Aware Deep Reinforcement Learning Scheduling for Sensors Correlated in Time and Space [62.39318039798564]
  We propose a scheduling mechanism capable of taking advantage of correlated information. The proposed mechanism is capable of determining the frequency with which sensors should transmit their updates. We show that our solution can significantly extend the sensors' lifetime.
  arXiv  Detail & Related papers  (2020-11-19T09:53:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.