Graph Neural Processes for Spatio-Temporal Extrapolation
- URL: http://arxiv.org/abs/2305.18719v1
- Date: Tue, 30 May 2023 03:55:37 GMT
- Title: Graph Neural Processes for Spatio-Temporal Extrapolation
- Authors: Junfeng Hu, Yuxuan Liang, Zhencheng Fan, Hongyang Chen, Yu Zheng,
Roger Zimmermann
- Abstract summary: We study the task of extrapolation-temporal processes that generates data at target locations from surrounding contexts in a graph.
Existing methods either use learning-grained models like Neural Networks or statistical approaches like Gaussian for this task.
We propose Spatio Graph Neural Processes (STGNP), a neural latent variable model which commands these capabilities simultaneously.
- Score: 36.01312116818714
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We study the task of spatio-temporal extrapolation that generates data at
target locations from surrounding contexts in a graph. This task is crucial as
sensors that collect data are sparsely deployed, resulting in a lack of
fine-grained information due to high deployment and maintenance costs. Existing
methods either use learning-based models like Neural Networks or statistical
approaches like Gaussian Processes for this task. However, the former lacks
uncertainty estimates and the latter fails to capture complex spatial and
temporal correlations effectively. To address these issues, we propose
Spatio-Temporal Graph Neural Processes (STGNP), a neural latent variable model
which commands these capabilities simultaneously. Specifically, we first learn
deterministic spatio-temporal representations by stacking layers of causal
convolutions and cross-set graph neural networks. Then, we learn latent
variables for target locations through vertical latent state transitions along
layers and obtain extrapolations. Importantly during the transitions, we
propose Graph Bayesian Aggregation (GBA), a Bayesian graph aggregator that
aggregates contexts considering uncertainties in context data and graph
structure. Extensive experiments show that STGNP has desirable properties such
as uncertainty estimates and strong learning capabilities, and achieves
state-of-the-art results by a clear margin.
Related papers
- Graph Pruning Based Spatial and Temporal Graph Convolutional Network with Transfer Learning for Traffic Prediction [0.0]
This study proposes a novel Spatial-temporal Convolutional Network (TL-GPSTGN) based on graph pruning and transfer learning framework.
The results demonstrate the exceptional predictive accuracy of TL-GPSTGN on a single dataset, as well as its robust migration performance across different datasets.
arXiv Detail & Related papers (2024-09-25T00:59:23Z) - Graph Structure Learning with Interpretable Bayesian Neural Networks [10.957528713294874]
We introduce novel iterations with independently interpretable parameters.
These parameters influence characteristics of the estimated graph, such as edge sparsity.
After unrolling these iterations, prior knowledge over such graph characteristics shape prior distributions.
Fast execution and parameter efficiency allow for high-fidelity posterior approximation.
arXiv Detail & Related papers (2024-06-20T23:27:41Z) - Automated Spatio-Temporal Graph Contrastive Learning [18.245433428868775]
We develop an automated-temporal augmentation scheme with a parameterized contrastive view generator.
AutoST can adapt to the heterogeneous graph with multi-view semantics well preserved.
Experiments for three downstream-temporal mining tasks on several real-world datasets demonstrate the significant performance gain.
arXiv Detail & Related papers (2023-05-06T03:52:33Z) - Uncovering the Missing Pattern: Unified Framework Towards Trajectory
Imputation and Prediction [60.60223171143206]
Trajectory prediction is a crucial undertaking in understanding entity movement or human behavior from observed sequences.
Current methods often assume that the observed sequences are complete while ignoring the potential for missing values.
This paper presents a unified framework, the Graph-based Conditional Variational Recurrent Neural Network (GC-VRNN), which can perform trajectory imputation and prediction simultaneously.
arXiv Detail & Related papers (2023-03-28T14:27:27Z) - Graph Convolutional Networks for Traffic Forecasting with Missing Values [0.5774786149181392]
We propose a Graph Convolutional Network model with the ability to handle the complex missing values in the Spatio-temporal context.
We propose as well a dynamic graph learning module based on the learned local-global features.
The experimental results on real-life datasets show the reliability of our proposed method.
arXiv Detail & Related papers (2022-12-13T08:04:38Z) - Inducing Gaussian Process Networks [80.40892394020797]
We propose inducing Gaussian process networks (IGN), a simple framework for simultaneously learning the feature space as well as the inducing points.
The inducing points, in particular, are learned directly in the feature space, enabling a seamless representation of complex structured domains.
We report on experimental results for real-world data sets showing that IGNs provide significant advances over state-of-the-art methods.
arXiv Detail & Related papers (2022-04-21T05:27:09Z) - Convolutional generative adversarial imputation networks for
spatio-temporal missing data in storm surge simulations [86.5302150777089]
Generative Adversarial Imputation Nets (GANs) and GAN-based techniques have attracted attention as unsupervised machine learning methods.
We name our proposed method as Con Conval Generative Adversarial Imputation Nets (Conv-GAIN)
arXiv Detail & Related papers (2021-11-03T03:50:48Z) - Distributionally Robust Semi-Supervised Learning Over Graphs [68.29280230284712]
Semi-supervised learning (SSL) over graph-structured data emerges in many network science applications.
To efficiently manage learning over graphs, variants of graph neural networks (GNNs) have been developed recently.
Despite their success in practice, most of existing methods are unable to handle graphs with uncertain nodal attributes.
Challenges also arise due to distributional uncertainties associated with data acquired by noisy measurements.
A distributionally robust learning framework is developed, where the objective is to train models that exhibit quantifiable robustness against perturbations.
arXiv Detail & Related papers (2021-10-20T14:23:54Z) - Spatio-Temporal Graph Scattering Transform [54.52797775999124]
Graph neural networks may be impractical in some real-world scenarios due to a lack of sufficient high-quality training data.
We put forth a novel mathematically designed framework to analyze-temporal data.
arXiv Detail & Related papers (2020-12-06T19:49:55Z) - Block-Approximated Exponential Random Graphs [77.4792558024487]
An important challenge in the field of exponential random graphs (ERGs) is the fitting of non-trivial ERGs on large graphs.
We propose an approximative framework to such non-trivial ERGs that result in dyadic independence (i.e., edge independent) distributions.
Our methods are scalable to sparse graphs consisting of millions of nodes.
arXiv Detail & Related papers (2020-02-14T11:42:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.