Learning When to See for Long-term Traffic Data Collection on
Power-constrained Devices
- URL: http://arxiv.org/abs/2401.14504v1
- Date: Thu, 25 Jan 2024 20:50:34 GMT
- Title: Learning When to See for Long-term Traffic Data Collection on
Power-constrained Devices
- Authors: Ruixuan Zhang, Wenyu Han, Zilin Bian, Kaan Ozbay, Chen Feng
- Abstract summary: We introduce a novel learning-based framework that strategically decides observation timings for battery-powered devices.
We reconstruct the full data stream from sparsely sampled observations, resulting in minimal performance loss.
We evaluate the performance of the proposed method on PeMS data by an RNN (Recurrent Neural Network) predictor and estimator, and a DRQN (Deep Recurrent Q-Network) controller.
- Score: 7.712009864814493
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Collecting traffic data is crucial for transportation systems and urban
planning, and is often more desirable through easy-to-deploy but
power-constrained devices, due to the unavailability or high cost of power and
network infrastructure. The limited power means an inevitable trade-off between
data collection duration and accuracy/resolution. We introduce a novel
learning-based framework that strategically decides observation timings for
battery-powered devices and reconstructs the full data stream from sparsely
sampled observations, resulting in minimal performance loss and a significantly
prolonged system lifetime. Our framework comprises a predictor, a controller,
and an estimator. The predictor utilizes historical data to forecast future
trends within a fixed time horizon. The controller uses the forecasts to
determine the next optimal timing for data collection. Finally, the estimator
reconstructs the complete data profile from the sampled observations. We
evaluate the performance of the proposed method on PeMS data by an RNN
(Recurrent Neural Network) predictor and estimator, and a DRQN (Deep Recurrent
Q-Network) controller, and compare it against the baseline that uses Kalman
filter and uniform sampling. The results indicate that our method outperforms
the baseline, primarily due to the inclusion of more representative data points
in the profile, resulting in an overall 10\% improvement in estimation
accuracy. Source code will be publicly available.
Related papers
- Tackling Data Heterogeneity in Federated Time Series Forecasting [61.021413959988216]
Time series forecasting plays a critical role in various real-world applications, including energy consumption prediction, disease transmission monitoring, and weather forecasting.
Most existing methods rely on a centralized training paradigm, where large amounts of data are collected from distributed devices to a central cloud server.
We propose a novel framework, Fed-TREND, to address data heterogeneity by generating informative synthetic data as auxiliary knowledge carriers.
arXiv Detail & Related papers (2024-11-24T04:56:45Z) - Physics-guided Active Sample Reweighting for Urban Flow Prediction [75.24539704456791]
Urban flow prediction is a nuanced-temporal modeling that estimates the throughput of transportation services like buses, taxis and ride-driven models.
Some recent prediction solutions bring remedies with the notion of physics-guided machine learning (PGML)
We develop a atized physics-guided network (PN), and propose a data-aware framework Physics-guided Active Sample Reweighting (P-GASR)
arXiv Detail & Related papers (2024-07-18T15:44:23Z) - Urban Traffic Forecasting with Integrated Travel Time and Data Availability in a Conformal Graph Neural Network Framework [0.6554326244334868]
State-of-the-art models often struggle to consider the data in the best way possible.
We propose a novel framework to incorporate travel times between stations into a weighted adjacency matrix of a Graph Neural Network architecture.
arXiv Detail & Related papers (2024-07-17T01:11:07Z) - Computationally and Memory-Efficient Robust Predictive Analytics Using Big Data [0.0]
This study navigates through the challenges of data uncertainties, storage limitations, and predictive data-driven modeling using big data.
We utilize Robust Principal Component Analysis (RPCA) for effective noise reduction and outlier elimination, and Optimal Sensor Placement (OSP) for efficient data compression and storage.
arXiv Detail & Related papers (2024-03-27T22:39:08Z) - Enhancing Mean-Reverting Time Series Prediction with Gaussian Processes:
Functional and Augmented Data Structures in Financial Forecasting [0.0]
We explore the application of Gaussian Processes (GPs) for predicting mean-reverting time series with an underlying structure.
GPs offer the potential to forecast not just the average prediction but the entire probability distribution over a future trajectory.
This is particularly beneficial in financial contexts, where accurate predictions alone may not suffice if incorrect volatility assessments lead to capital losses.
arXiv Detail & Related papers (2024-02-23T06:09:45Z) - Robustness Verification of Deep Neural Networks using Star-Based
Reachability Analysis with Variable-Length Time Series Input [6.146046338698173]
This paper presents a case study of the robustness verification approach for time series regression NNs (TSRegNN) using set-based formal methods.
It focuses on utilizing variable-length input data to streamline input manipulation and enhance network architecture generalizability.
Overall, the paper offers a comprehensive case study for validating and verifying NN-based analytics of time-series data in real-world applications.
arXiv Detail & Related papers (2023-07-26T02:15:11Z) - LargeST: A Benchmark Dataset for Large-Scale Traffic Forecasting [65.71129509623587]
Road traffic forecasting plays a critical role in smart city initiatives and has experienced significant advancements thanks to the power of deep learning.
However, the promising results achieved on current public datasets may not be applicable to practical scenarios.
We introduce the LargeST benchmark dataset, which includes a total of 8,600 sensors in California with a 5-year time coverage.
arXiv Detail & Related papers (2023-06-14T05:48:36Z) - A Meta-Learning Approach to Predicting Performance and Data Requirements [163.4412093478316]
We propose an approach to estimate the number of samples required for a model to reach a target performance.
We find that the power law, the de facto principle to estimate model performance, leads to large error when using a small dataset.
We introduce a novel piecewise power law (PPL) that handles the two data differently.
arXiv Detail & Related papers (2023-03-02T21:48:22Z) - Probabilistic Time Series Forecasting for Adaptive Monitoring in Edge
Computing Environments [0.06999740786886537]
In this paper, we propose a sampling-based and cloud-located approach for monitoring critical infrastructures.
We evaluate our prototype implementation for the monitoring pipeline on a publicly available streaming dataset.
arXiv Detail & Related papers (2022-11-24T17:35:14Z) - Time-to-Green predictions for fully-actuated signal control systems with
supervised learning [56.66331540599836]
This paper proposes a time series prediction framework using aggregated traffic signal and loop detector data.
We utilize state-of-the-art machine learning models to predict future signal phases' duration.
Results based on an empirical data set from a fully-actuated signal control system in Zurich, Switzerland, show that machine learning models outperform conventional prediction methods.
arXiv Detail & Related papers (2022-08-24T07:50:43Z) - Evaluating Short-Term Forecasting of Multiple Time Series in IoT
Environments [67.24598072875744]
Internet of Things (IoT) environments are monitored via a large number of IoT enabled sensing devices.
To alleviate this issue, sensors are often configured to operate at relatively low sampling frequencies.
This can hamper dramatically subsequent decision-making, such as forecasting.
arXiv Detail & Related papers (2022-06-15T19:46:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.