Leveraging unsupervised data and domain adaptation for deep regression
in low-cost sensor calibration
- URL: http://arxiv.org/abs/2210.00521v1
- Date: Sun, 2 Oct 2022 13:47:45 GMT
- Title: Leveraging unsupervised data and domain adaptation for deep regression
in low-cost sensor calibration
- Authors: Swapnil Dey, Vipul Arora, Sachchida Nand Tripathi
- Abstract summary: Air quality monitoring is becoming an essential task with rising awareness about air quality.
Low cost air quality sensors are easy to deploy but are not as reliable as the costly and bulky reference monitors.
In this paper, we translate the task of sensor calibration into a semi-supervised domain adaptation problem.
- Score: 2.5845893156827158
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Air quality monitoring is becoming an essential task with rising awareness
about air quality. Low cost air quality sensors are easy to deploy but are not
as reliable as the costly and bulky reference monitors. The low quality sensors
can be calibrated against the reference monitors with the help of deep
learning. In this paper, we translate the task of sensor calibration into a
semi-supervised domain adaptation problem and propose a novel solution for the
same. The problem is challenging because it is a regression problem with
covariate shift and label gap. We use histogram loss instead of mean squared or
mean absolute error, which is commonly used for regression, and find it useful
against covariate shift. To handle the label gap, we propose weighting of
samples for adversarial entropy optimization. In experimental evaluations, the
proposed scheme outperforms many competitive baselines, which are based on
semi-supervised and supervised domain adaptation, in terms of R2 score and mean
absolute error. Ablation studies show the relevance of each proposed component
in the entire scheme.
Related papers
- Provably Outlier-resistant Semi-parametric Regression for Transferable Calibration of Low-cost Air-quality Sensors [2.9079895220997294]
We present a case study for the calibration of Low-cost air-quality (LCAQ) CO sensors from one of the largest multi-site-multi-season-multi-sensor-multi-pollutant mobile air-quality monitoring network deployments in India.<n>LCAQ sensors have been shown to play a critical role in the establishment of dense, expansive air-quality monitoring networks.
arXiv Detail & Related papers (2025-11-25T00:33:26Z) - ReSURE: Regularizing Supervision Unreliability for Multi-turn Dialogue Fine-tuning [72.05731026796335]
Multi-turn dialogue systems often suffer from degraded performance when exposed to low-quality data.<n>We propose ReSURE, an adaptive learning method that dynamically down-weights unreliable supervision without explicit filtering.<n>Experiments on both single-source and mixed-quality datasets show improved stability and response quality.
arXiv Detail & Related papers (2025-08-27T15:54:01Z) - CaLiV: LiDAR-to-Vehicle Calibration of Arbitrary Sensor Setups via Object Reconstruction [0.8437187555622164]
In autonomous systems, sensor calibration is essential for a safe and efficient navigation in dynamic environments.
Many existing LiDAR calibration methods require overlapping fields of view, while others use external sensing devices or postulate a feature-rich environment.
In this work, we propose a novel target-based technique for extrinsic Sensor-to-Sensor and Sensor-to-Vehicle calibration of multi-LiDAR systems called CaLiV.
This algorithm works for non-overlapping FoVs, as well as arbitrary calibration targets, and does not require any external sensing devices.
arXiv Detail & Related papers (2025-03-31T08:08:21Z) - Efficient Unsupervised Domain Adaptation Regression for Spatial-Temporal Air Quality Sensor Fusion [6.963971634605796]
We propose a novel unsupervised domain adaptation (UDA) method specifically tailored for regression tasks on graph-structured data.
We incorporate spatial-temporal graph neural networks (STGNNs) to model the relationships between sensors.
Our approach allows low-cost IoT sensors to learn calibration parameters from expensive reference sensors.
arXiv Detail & Related papers (2024-11-11T12:20:57Z) - PseudoCal: A Source-Free Approach to Unsupervised Uncertainty
Calibration in Domain Adaptation [87.69789891809562]
Unsupervised domain adaptation (UDA) has witnessed remarkable advancements in improving the accuracy of models for unlabeled target domains.
The calibration of predictive uncertainty in the target domain, a crucial aspect of the safe deployment of UDA models, has received limited attention.
We propose PseudoCal, a source-free calibration method that exclusively relies on unlabeled target data.
arXiv Detail & Related papers (2023-07-14T17:21:41Z) - Modelling calibration uncertainty in networks of environmental sensors [2.016542873726103]
Networks of low-cost sensors are becoming ubiquitous, but often suffer from low accuracies and drift.
We propose a variational approach to model the calibration across the network of sensors.
We demonstrate the approach on both synthetic and real air pollution data, and find it can perform better than the state of the art.
arXiv Detail & Related papers (2022-05-04T10:38:45Z) - Toward Minimal Misalignment at Minimal Cost in One-Stage and Anchor-Free
Object Detection [6.486325109549893]
classification and regression branches have different sensibility to the features from the same scale level and the same spatial location.
We propose a point-based prediction method, which is based on the assumption that the high classification confidence point has the high regression quality, leads to the misalignment problem.
We aim to resolve the phenomenon at minimal cost: a minor adjustment of the head network and a new label assignment method replacing the rigid one.
arXiv Detail & Related papers (2021-12-16T14:22:13Z) - Regressive Domain Adaptation for Unsupervised Keypoint Detection [67.2950306888855]
Domain adaptation (DA) aims at transferring knowledge from a labeled source domain to an unlabeled target domain.
We present a method of regressive domain adaptation (RegDA) for unsupervised keypoint detection.
Our method brings large improvement by 8% to 11% in terms of PCK on different datasets.
arXiv Detail & Related papers (2021-03-10T16:45:22Z) - Real-time detection of uncalibrated sensors using Neural Networks [62.997667081978825]
An online machine-learning based uncalibration detector for temperature, humidity and pressure sensors was developed.
The solution integrates an Artificial Neural Network as main component which learns from the behavior of the sensors under calibrated conditions.
The obtained results show that the proposed solution is able to detect uncalibrations for deviation values of 0.25 degrees, 1% RH and 1.5 Pa, respectively.
arXiv Detail & Related papers (2021-02-02T15:44:39Z) - Dense Label Encoding for Boundary Discontinuity Free Rotation Detection [69.75559390700887]
This paper explores a relatively less-studied methodology based on classification.
We propose new techniques to push its frontier in two aspects.
Experiments and visual analysis on large-scale public datasets for aerial images show the effectiveness of our approach.
arXiv Detail & Related papers (2020-11-19T05:42:02Z) - Detecting Rewards Deterioration in Episodic Reinforcement Learning [63.49923393311052]
In many RL applications, once training ends, it is vital to detect any deterioration in the agent performance as soon as possible.
We consider an episodic framework, where the rewards within each episode are not independent, nor identically-distributed, nor Markov.
We define the mean-shift in a way corresponding to deterioration of a temporal signal (such as the rewards), and derive a test for this problem with optimal statistical power.
arXiv Detail & Related papers (2020-10-22T12:45:55Z) - Certainty Equivalent Perception-Based Control [29.216967322052785]
We show a uniform error bound on non kernel regression under a dynamically-achievable dense sampling scheme.
This allows for a finite-time convergence rate on the sub-optimality of using the regressor in closed-loop for waypoint tracking.
arXiv Detail & Related papers (2020-08-27T18:45:40Z) - Unbiased Risk Estimators Can Mislead: A Case Study of Learning with
Complementary Labels [92.98756432746482]
We study a weakly supervised problem called learning with complementary labels.
We show that the quality of gradient estimation matters more in risk minimization.
We propose a novel surrogate complementary loss(SCL) framework that trades zero bias with reduced variance.
arXiv Detail & Related papers (2020-07-05T04:19:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.