Towards Scalable and Structured Spatiotemporal Forecasting
- URL: http://arxiv.org/abs/2509.18115v1
- Date: Wed, 10 Sep 2025 03:25:24 GMT
- Title: Towards Scalable and Structured Spatiotemporal Forecasting
- Authors: Hongyi Chen, Xiucheng Li, Xinyang Chen, Jing Li, Kehai Chen, Liqiang Nie,
- Abstract summary: We propose a novel Spatial Balance Attention block fortemporal forecasting.<n>We partition the spatial graph into a set subgraphs and instantiate-graph Attention to learn local spatial correlation within each subgraph.<n>We develop a multiscale forecasting model by progressively increasing the subgraph scales.
- Score: 67.74910348499974
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we propose a novel Spatial Balance Attention block for spatiotemporal forecasting. To strike a balance between obeying spatial proximity and capturing global correlation, we partition the spatial graph into a set of subgraphs and instantiate Intra-subgraph Attention to learn local spatial correlation within each subgraph; to capture the global spatial correlation, we further aggregate the nodes to produce subgraph representations and achieve message passing among the subgraphs via Inter-subgraph Attention. Building on the proposed Spatial Balance Attention block, we develop a multiscale spatiotemporal forecasting model by progressively increasing the subgraph scales. The resulting model is both scalable and able to produce structured spatial correlation, and meanwhile, it is easy to implement. We evaluate its efficacy and efficiency against the existing models on real-world spatiotemporal datasets from medium to large sizes. The experimental results show that it can achieve performance improvements up to 7.7% over the baseline methods at low running costs.
Related papers
- S$^2$Transformer: Scalable Structured Transformers for Global Station Weather Forecasting [67.93713728260646]
Existing time series forecasting methods often ignore or unidirectionally model spatial correlation when conducting large-scale global station forecasting.<n>This contradicts the nature underlying observations of the global weather system limiting forecast performance.<n>We propose a novel Structured Spatial Attention in this paper.<n>It partitions the spatial graph into a set of subgraphs and instantiates Intra-subgraph Attention to learn local spatial correlation within each subgraph.<n>It aggregates nodes into subgraph representations for message passing among the subgraphs via Inter-subgraph Attention -- considering both spatial proximity and global correlation.
arXiv Detail & Related papers (2025-09-10T05:33:28Z) - Ada-TransGNN: An Air Quality Prediction Model Based On Adaptive Graph Convolutional Networks [7.944991952472549]
We propose a Transformer-based data prediction method that integrates global spatial semantics and temporal behavior.<n>We show that our model outperforms existing state-of-the-art prediction models in shortterm and long-term predictions.
arXiv Detail & Related papers (2025-08-25T10:22:03Z) - STEI-PCN: an efficient pure convolutional network for traffic prediction via spatial-temporal encoding and inferring [13.472378581383628]
This paper proposes an efficient pure convolutional network for traffic prediction via spatial-temporal encoding and inferring.<n>Three layers of temporal dilated causal convolutional network are used to capture long-range temporal correlations.<n>The model integrates the gated-activated original, local synchronous joint spatial-temporal, and long-range temporal features to achieve comprehensive prediction.
arXiv Detail & Related papers (2025-04-10T18:32:56Z) - Adaptive Graph Spatial-Temporal Transformer Network for Traffic Flow
Forecasting [6.867331860819595]
Traffic forecasting can be highly challenging due to complex spatial-temporal correlations and non-linear traffic patterns.
Existing works mostly model such spatial-temporal dependencies by considering spatial correlations and temporal correlations separately.
We propose to directly model the cross-spatial-temporal correlations on the spatial-temporal graph using local multi-head self-attentions.
arXiv Detail & Related papers (2022-07-09T19:21:00Z) - Optimal Propagation for Graph Neural Networks [51.08426265813481]
We propose a bi-level optimization approach for learning the optimal graph structure.
We also explore a low-rank approximation model for further reducing the time complexity.
arXiv Detail & Related papers (2022-05-06T03:37:00Z) - Spatio-Temporal Joint Graph Convolutional Networks for Traffic
Forecasting [75.10017445699532]
Recent have shifted their focus towards formulating traffic forecasting as atemporal graph modeling problem.
We propose a novel approach for accurate traffic forecasting on road networks over multiple future time steps.
arXiv Detail & Related papers (2021-11-25T08:45:14Z) - Channelized Axial Attention for Semantic Segmentation [70.14921019774793]
We propose the Channelized Axial Attention (CAA) to seamlessly integratechannel attention and axial attention with reduced computationalcomplexity.
Our CAA not onlyrequires much less computation resources compared with otherdual attention models such as DANet, but also outperforms the state-of-the-art ResNet-101-based segmentation models on alltested datasets.
arXiv Detail & Related papers (2021-01-19T03:08:03Z) - Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow
Forecasting [35.072979313851235]
spatial-temporal data forecasting of traffic flow is a challenging task because of complicated spatial dependencies and dynamical trends of temporal pattern between different roads.
Existing frameworks typically utilize given spatial adjacency graph and sophisticated mechanisms for modeling spatial and temporal correlations.
This paper proposes Spatial-Temporal Fusion Graph Neural Networks (STFGNN) for traffic flow forecasting.
arXiv Detail & Related papers (2020-12-15T14:03:17Z) - On the spatial attention in Spatio-Temporal Graph Convolutional Networks
for skeleton-based human action recognition [97.14064057840089]
Graphal networks (GCNs) promising performance in skeleton-based human action recognition by modeling a sequence of skeletons as a graph.
Most of the recently proposed G-temporal-based methods improve the performance by learning the graph structure at each layer of the network.
arXiv Detail & Related papers (2020-11-07T19:03:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.