Traffic Forecasting on New Roads Using Spatial Contrastive Pre-Training (SCPT)

• URL: http://arxiv.org/abs/2305.05237v4
• Date: Thu, 21 Sep 2023 14:16:23 GMT
• Title: Traffic Forecasting on New Roads Using Spatial Contrastive Pre-Training (SCPT)
• Authors: Arian Prabowo, Hao Xue, Wei Shao, Piotr Koniusz, Flora D. Salim
• Abstract summary: We introduce a novel setup called a-temporal (ST) split to evaluate the models' capabilities to generalize to unseen roads. We also present a novel framework called Spatial Contrastive Pre-Training ( SCPT) where we introduce a spatial encoder module to extract latent features from unseen roads. The SCPT framework also incorporates a new layer, named the gated addition (SGA) layer, to effectively combine the latent features from the output of the spatial encoder to existing backbones.
• Score: 39.055098754375294
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: New roads are being constructed all the time. However, the capabilities of previous deep forecasting models to generalize to new roads not seen in the training data (unseen roads) are rarely explored. In this paper, we introduce a novel setup called a spatio-temporal (ST) split to evaluate the models' capabilities to generalize to unseen roads. In this setup, the models are trained on data from a sample of roads, but tested on roads not seen in the training data. Moreover, we also present a novel framework called Spatial Contrastive Pre-Training (SCPT) where we introduce a spatial encoder module to extract latent features from unseen roads during inference time. This spatial encoder is pre-trained using contrastive learning. During inference, the spatial encoder only requires two days of traffic data on the new roads and does not require any re-training. We also show that the output from the spatial encoder can be used effectively to infer latent node embeddings on unseen roads during inference time. The SCPT framework also incorporates a new layer, named the spatially gated addition (SGA) layer, to effectively combine the latent features from the output of the spatial encoder to existing backbones. Additionally, since there is limited data on the unseen roads, we argue that it is better to decouple traffic signals to trivial-to-capture periodic signals and difficult-to-capture Markovian signals, and for the spatial encoder to only learn the Markovian signals. Finally, we empirically evaluated SCPT using the ST split setup on four real-world datasets. The results showed that adding SCPT to a backbone consistently improves forecasting performance on unseen roads. More importantly, the improvements are greater when forecasting further into the future. The codes are available on GitHub: https://github.com/cruiseresearchgroup/forecasting-on-new-roads .

Related papers

• Leveraging GNSS and Onboard Visual Data from Consumer Vehicles for Robust Road Network Estimation [18.236615392921273]
  This paper addresses the challenge of road graph construction for autonomous vehicles. We propose using global navigation satellite system (GNSS) traces and basic image data acquired from these standard sensors in consumer vehicles. We exploit the spatial information in the data by framing the problem as a road centerline semantic segmentation task using a convolutional neural network.
  arXiv  Detail & Related papers  (2024-08-03T02:57:37Z)
• Temporal Graph Learning Recurrent Neural Network for Traffic Forecasting [27.20703077756038]
  We propose Temporal Graph Learning Recurrent Neural Network (TGLRN) to address these problems. More precisely, to effectively model the nature of time series, we leverage Recurrent Neural Networks (RNNs) to dynamically construct a graph at each time step. Experimental results on four commonly used real-world benchmark datasets show the effectiveness of TGLRN.
  arXiv  Detail & Related papers  (2024-06-04T19:08:40Z)
• Pre-training on Synthetic Driving Data for Trajectory Prediction [61.520225216107306]
  We propose a pipeline-level solution to mitigate the issue of data scarcity in trajectory forecasting. We adopt HD map augmentation and trajectory synthesis for generating driving data, and then we learn representations by pre-training on them. We conduct extensive experiments to demonstrate the effectiveness of our data expansion and pre-training strategies.
  arXiv  Detail & Related papers  (2023-09-18T19:49:22Z)
• Disentangling Spatial and Temporal Learning for Efficient Image-to-Video Transfer Learning [59.26623999209235]
  We present DiST, which disentangles the learning of spatial and temporal aspects of videos. The disentangled learning in DiST is highly efficient because it avoids the back-propagation of massive pre-trained parameters. Extensive experiments on five benchmarks show that DiST delivers better performance than existing state-of-the-art methods by convincing gaps.
  arXiv  Detail & Related papers  (2023-09-14T17:58:33Z)
• Navigating Uncertainty: The Role of Short-Term Trajectory Prediction in Autonomous Vehicle Safety [3.3659635625913564]
  We have developed a dataset for short-term trajectory prediction tasks using the CARLA simulator. This dataset is extensive and incorporates what is considered complex scenarios - pedestrians crossing the road, vehicles overtaking. An end-to-end short-term trajectory prediction model using convolutional neural networks (CNN) and long short-term memory (LSTM) networks has also been developed.
  arXiv  Detail & Related papers  (2023-07-11T14:28:33Z)
• RNTrajRec: Road Network Enhanced Trajectory Recovery with Spatial-Temporal Transformer [15.350300338463969]
  We propose a road network enhanced transformer-based framework, namely RNTrajRec, for trajectory recovery. RNTrajRec first uses a graph model, namely GridGNN, to learn the embedding features of each road segment. It then introduces a Sub-Graph Generation module to represent each GPS point as a sub-graph structure of the road network around the GPS point.
  arXiv  Detail & Related papers  (2022-11-23T11:28:32Z)
• Real Time Monocular Vehicle Velocity Estimation using Synthetic Data [78.85123603488664]
  We look at the problem of estimating the velocity of road vehicles from a camera mounted on a moving car. We propose a two-step approach where first an off-the-shelf tracker is used to extract vehicle bounding boxes and then a small neural network is used to regress the vehicle velocity.
  arXiv  Detail & Related papers  (2021-09-16T13:10:27Z)
• Space Meets Time: Local Spacetime Neural Network For Traffic Flow Forecasting [11.495992519252585]
  We argue that such correlations are universal and play a pivotal role in traffic flow. We propose a new spacetime interval learning framework that constructs a local-spacetime context of a traffic sensor. The proposed STNN model can be applied on any unseen traffic networks.
  arXiv  Detail & Related papers  (2021-09-11T09:04:35Z)
• Learning Spatio-Temporal Transformer for Visual Tracking [108.11680070733598]
  We present a new tracking architecture with an encoder-decoder transformer as the key component. The whole method is end-to-end, does not need any postprocessing steps such as cosine window and bounding box smoothing. The proposed tracker achieves state-of-the-art performance on five challenging short-term and long-term benchmarks, while running real-time speed, being 6x faster than Siam R-CNN.
  arXiv  Detail & Related papers  (2021-03-31T15:19:19Z)
• Road Network Metric Learning for Estimated Time of Arrival [93.0759529610483]
  In this paper, we propose the Road Network Metric Learning framework for Estimated Time of Arrival (ETA) It consists of two components: (1) a main regression task to predict the travel time, and (2) an auxiliary metric learning task to improve the quality of link embedding vectors. We show that our method outperforms the state-of-the-art model and the promotion concentrates on the cold links with few data.
  arXiv  Detail & Related papers  (2020-06-24T04:45:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.