Enhancing Traffic Prediction with Learnable Filter Module
- URL: http://arxiv.org/abs/2310.16063v1
- Date: Tue, 24 Oct 2023 09:16:13 GMT
- Title: Enhancing Traffic Prediction with Learnable Filter Module
- Authors: Yuanshao Zhu, Yongchao Ye, Xiangyu Zhao, and James J.Q. Yu
- Abstract summary: Noise in traffic data can be challenging to model due to its nature and can lead to overfitting risks.
We propose a learnable filter module to filter out noise in traffic data adaptively.
We demonstrate that the proposed module is lightweight, easy to integrate with existing models, and can significantly improve traffic prediction performance.
- Score: 42.44466196331814
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Modeling future traffic conditions often relies heavily on complex
spatial-temporal neural networks to capture spatial and temporal correlations,
which can overlook the inherent noise in the data. This noise, often
manifesting as unexpected short-term peaks or drops in traffic observation, is
typically caused by traffic accidents or inherent sensor vibration. In
practice, such noise can be challenging to model due to its stochastic nature
and can lead to overfitting risks if a neural network is designed to learn this
behavior. To address this issue, we propose a learnable filter module to filter
out noise in traffic data adaptively. This module leverages the Fourier
transform to convert the data to the frequency domain, where noise is filtered
based on its pattern. The denoised data is then recovered to the time domain
using the inverse Fourier transform. Our approach focuses on enhancing the
quality of the input data for traffic prediction models, which is a critical
yet often overlooked aspect in the field. We demonstrate that the proposed
module is lightweight, easy to integrate with existing models, and can
significantly improve traffic prediction performance. Furthermore, we validate
our approach with extensive experimental results on real-world datasets,
showing that it effectively mitigates noise and enhances prediction accuracy.
Related papers
- Navigating Spatio-Temporal Heterogeneity: A Graph Transformer Approach for Traffic Forecasting [13.309018047313801]
Traffic forecasting has emerged as a crucial research area in the development of smart cities.
Recent advancements in network modeling for most-temporal correlations are starting to see diminishing returns in performance.
To tackle these challenges, we introduce the Spatio-Temporal Graph Transformer (STGormer)
We design two straightforward yet effective spatial encoding methods based on the structure and integrate time position into the vanilla transformer to capture-temporal traffic patterns.
arXiv Detail & Related papers (2024-08-20T13:18:21Z) - Continual Learning of Range-Dependent Transmission Loss for Underwater Acoustic using Conditional Convolutional Neural Net [0.0]
This research aims to improve the accuracy of deep-learning models for predicting underwater radiated noise in far-field scenarios.
We propose a novel range-conditional convolutional neural network that incorporates ocean bathymetry data into the input.
Our proposed architecture effectively captures transmission loss over a range-dependent, varying bathymetry profile.
arXiv Detail & Related papers (2024-04-11T19:13:38Z) - Learning with Noisy Foundation Models [95.50968225050012]
This paper is the first work to comprehensively understand and analyze the nature of noise in pre-training datasets.
We propose a tuning method (NMTune) to affine the feature space to mitigate the malignant effect of noise and improve generalization.
arXiv Detail & Related papers (2024-03-11T16:22:41Z) - Dynamic Frequency Domain Graph Convolutional Network for Traffic
Forecasting [33.538633286142264]
Time-Shift of traffic patterns and noise induced by random factors hinder data-driven spatial dependence modeling.
We propose a novel dynamic frequency domain graph convolution network (DFDGCN) to capture spatial dependencies.
Our model is effective and outperforms the baselines in experiments on four real-world datasets.
arXiv Detail & Related papers (2023-12-19T08:20:09Z) - Understanding and Mitigating the Label Noise in Pre-training on
Downstream Tasks [91.15120211190519]
This paper aims to understand the nature of noise in pre-training datasets and to mitigate its impact on downstream tasks.
We propose a light-weight black-box tuning method (NMTune) to affine the feature space to mitigate the malignant effect of noise.
arXiv Detail & Related papers (2023-09-29T06:18:15Z) - Newell's theory based feature transformations for spatio-temporal
traffic prediction [0.0]
We propose a traffic flow physics-based transformation feature for Deep learning (DL) models for traffic flow forecasting.
This transformation incorporates Newell's uncongested and congested filters of traffic flows at the target locations, enabling the models to learn broader dynamics of the system.
An important advantage of our framework is its ability to be transferred to new locations where data is unavailable.
arXiv Detail & Related papers (2023-07-12T06:31:43Z) - PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for
Traffic Flow Prediction [78.05103666987655]
spatial-temporal Graph Neural Network (GNN) models have emerged as one of the most promising methods to solve this problem.
We propose a novel propagation delay-aware dynamic long-range transFormer, namely PDFormer, for accurate traffic flow prediction.
Our method can not only achieve state-of-the-art performance but also exhibit competitive computational efficiency.
arXiv Detail & Related papers (2023-01-19T08:42:40Z) - STformer: A Noise-Aware Efficient Spatio-Temporal Transformer
Architecture for Traffic Forecasting [7.230415327436048]
We propose a novel noise-aware efficient-temporal architecture for accurate traffic forecasting, named STformer.
STformer consists of two components, which are the noise-aware temporal self-attention (NATSA) and the graph-based sparse spatial self-attention (GBS3A)
Experiments on four real-world traffic datasets show that STformer outperforms state-of-the-art baselines with lower computational cost.
arXiv Detail & Related papers (2021-12-06T02:17:39Z) - Predicting traffic signals on transportation networks using
spatio-temporal correlations on graphs [56.48498624951417]
This paper proposes a traffic propagation model that merges multiple heat diffusion kernels into a data-driven prediction model to forecast traffic signals.
We optimize the model parameters using Bayesian inference to minimize the prediction errors and, consequently, determine the mixing ratio of the two approaches.
The proposed model demonstrates prediction accuracy comparable to that of the state-of-the-art deep neural networks with lower computational effort.
arXiv Detail & Related papers (2021-04-27T18:17:42Z) - Deep traffic light detection by overlaying synthetic context on
arbitrary natural images [49.592798832978296]
We propose a method to generate artificial traffic-related training data for deep traffic light detectors.
This data is generated using basic non-realistic computer graphics to blend fake traffic scenes on top of arbitrary image backgrounds.
It also tackles the intrinsic data imbalance problem in traffic light datasets, caused mainly by the low amount of samples of the yellow state.
arXiv Detail & Related papers (2020-11-07T19:57:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.