Deep convolutional generative adversarial networks for traffic data
imputation encoding time series as images
- URL: http://arxiv.org/abs/2005.04188v1
- Date: Tue, 5 May 2020 19:14:02 GMT
- Title: Deep convolutional generative adversarial networks for traffic data
imputation encoding time series as images
- Authors: Tongge Huang, Pranamesh Chakraborty, Anuj Sharma
- Abstract summary: We have developed a generative adversarial network (GAN) based traffic sensor data imputation framework (TGAN)
In this study, we have developed a novel time-dependent encoding method called the Gramian Angular Summation Field (GASF)
This study shows that the proposed model can significantly improve the traffic data imputation accuracy in terms of Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE) compared to state-of-the-art models on the benchmark dataset.
- Score: 7.053891669775769
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Sufficient high-quality traffic data are a crucial component of various
Intelligent Transportation System (ITS) applications and research related to
congestion prediction, speed prediction, incident detection, and other traffic
operation tasks. Nonetheless, missing traffic data are a common issue in sensor
data which is inevitable due to several reasons, such as malfunctioning, poor
maintenance or calibration, and intermittent communications. Such missing data
issues often make data analysis and decision-making complicated and
challenging. In this study, we have developed a generative adversarial network
(GAN) based traffic sensor data imputation framework (TSDIGAN) to efficiently
reconstruct the missing data by generating realistic synthetic data. In recent
years, GANs have shown impressive success in image data generation. However,
generating traffic data by taking advantage of GAN based modeling is a
challenging task, since traffic data have strong time dependency. To address
this problem, we propose a novel time-dependent encoding method called the
Gramian Angular Summation Field (GASF) that converts the problem of traffic
time-series data generation into that of image generation. We have evaluated
and tested our proposed model using the benchmark dataset provided by Caltrans
Performance Management Systems (PeMS). This study shows that the proposed model
can significantly improve the traffic data imputation accuracy in terms of Mean
Absolute Error (MAE) and Root Mean Squared Error (RMSE) compared to
state-of-the-art models on the benchmark dataset. Further, the model achieves
reasonably high accuracy in imputation tasks even under a very high missing
data rate ($>$ 50\%), which shows the robustness and efficiency of the proposed
model.
Related papers
- Improving Traffic Flow Predictions with SGCN-LSTM: A Hybrid Model for Spatial and Temporal Dependencies [55.2480439325792]
This paper introduces the Signal-Enhanced Graph Convolutional Network Long Short Term Memory (SGCN-LSTM) model for predicting traffic speeds across road networks.
Experiments on the PEMS-BAY road network traffic dataset demonstrate the SGCN-LSTM model's effectiveness.
arXiv Detail & Related papers (2024-11-01T00:37:00Z) - FastSTI: A Fast Conditional Pseudo Numerical Diffusion Model for Spatio-temporal Traffic Data Imputation [4.932317347331121]
High-temporal traffic data is crucial for intelligent transportation systems (ITS) and their data-driven applications.
Recent studies of diffusion probability models have demonstrated the superiority of deep generative models in imputation.
Fast on two types of real-world traffic datasets proves its ability to impute higher-quality samples in only six steps.
arXiv Detail & Related papers (2024-10-20T01:45:51Z) - Graph Pruning Based Spatial and Temporal Graph Convolutional Network with Transfer Learning for Traffic Prediction [0.0]
This study proposes a novel Spatial-temporal Convolutional Network (TL-GPSTGN) based on graph pruning and transfer learning framework.
The results demonstrate the exceptional predictive accuracy of TL-GPSTGN on a single dataset, as well as its robust migration performance across different datasets.
arXiv Detail & Related papers (2024-09-25T00:59:23Z) - Large-Scale Traffic Data Imputation with Spatiotemporal Semantic
Understanding [26.86356769330179]
This study proposes Graph Transformer for Traffic Imputation (GT-TDI) model to impute large-scale traffic data with semantic understanding of a network.
The proposed model takes incomplete data, social connectivity of sensors, and semantic descriptions as input to perform tasks with the help of Graph Neural Networks (GNN) and Transformer.
The results show that proposed GT-TDI model outperforms existing methods in complex missing patterns and diverse missing rates.
arXiv Detail & Related papers (2023-01-27T13:02:19Z) - Adaptive Anomaly Detection for Internet of Things in Hierarchical Edge
Computing: A Contextual-Bandit Approach [81.5261621619557]
We propose an adaptive anomaly detection scheme with hierarchical edge computing (HEC)
We first construct multiple anomaly detection DNN models with increasing complexity, and associate each of them to a corresponding HEC layer.
Then, we design an adaptive model selection scheme that is formulated as a contextual-bandit problem and solved by using a reinforcement learning policy network.
arXiv Detail & Related papers (2021-08-09T08:45:47Z) - Predicting traffic signals on transportation networks using
spatio-temporal correlations on graphs [56.48498624951417]
This paper proposes a traffic propagation model that merges multiple heat diffusion kernels into a data-driven prediction model to forecast traffic signals.
We optimize the model parameters using Bayesian inference to minimize the prediction errors and, consequently, determine the mixing ratio of the two approaches.
The proposed model demonstrates prediction accuracy comparable to that of the state-of-the-art deep neural networks with lower computational effort.
arXiv Detail & Related papers (2021-04-27T18:17:42Z) - Deep Cellular Recurrent Network for Efficient Analysis of Time-Series
Data with Spatial Information [52.635997570873194]
This work proposes a novel deep cellular recurrent neural network (DCRNN) architecture to process complex multi-dimensional time series data with spatial information.
The proposed architecture achieves state-of-the-art performance while utilizing substantially less trainable parameters when compared to comparable methods in the literature.
arXiv Detail & Related papers (2021-01-12T20:08:18Z) - Deep traffic light detection by overlaying synthetic context on
arbitrary natural images [49.592798832978296]
We propose a method to generate artificial traffic-related training data for deep traffic light detectors.
This data is generated using basic non-realistic computer graphics to blend fake traffic scenes on top of arbitrary image backgrounds.
It also tackles the intrinsic data imbalance problem in traffic light datasets, caused mainly by the low amount of samples of the yellow state.
arXiv Detail & Related papers (2020-11-07T19:57:22Z) - IGANI: Iterative Generative Adversarial Networks for Imputation with
Application to Traffic Data [2.741266294612776]
This work introduces a novel iterative GAN architecture, called Iterative Generative Adversarial Networks for Imputation (IGANI)
IGANI imputes data in two steps and maintains the invertibility of the generative imputer, which will be shown to be a sufficient condition for the convergence of the proposed GAN-based imputation.
It is shown that our proposed algorithm mostly produces more accurate results compared to those of previous GAN-based imputation architectures.
arXiv Detail & Related papers (2020-08-11T16:46:02Z) - Contextual-Bandit Anomaly Detection for IoT Data in Distributed
Hierarchical Edge Computing [65.78881372074983]
IoT devices can hardly afford complex deep neural networks (DNN) models, and offloading anomaly detection tasks to the cloud incurs long delay.
We propose and build a demo for an adaptive anomaly detection approach for distributed hierarchical edge computing (HEC) systems.
We show that our proposed approach significantly reduces detection delay without sacrificing accuracy, as compared to offloading detection tasks to the cloud.
arXiv Detail & Related papers (2020-04-15T06:13:33Z) - A Nonconvex Low-Rank Tensor Completion Model for Spatiotemporal Traffic
Data Imputation [13.48205738743634]
Missing data imputation is common in intemporal traffic data collected from various sensing systems.
We present an efficient algorithm to obtain the optimal solution for each variable.
The proposed model also outperforms other baseline models in extreme missing scenarios.
arXiv Detail & Related papers (2020-03-23T13:27:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.