Pay Attention to Evolution: Time Series Forecasting with Deep
Graph-Evolution Learning
- URL: http://arxiv.org/abs/2008.12833v4
- Date: Wed, 26 May 2021 19:58:48 GMT
- Title: Pay Attention to Evolution: Time Series Forecasting with Deep
Graph-Evolution Learning
- Authors: Gabriel Spadon, Shenda Hong, Bruno Brandoli, Stan Matwin, Jose F.
Rodrigues-Jr, and Jimeng Sun
- Abstract summary: This work presents a novel neural network architecture for time-series forecasting.
We named our method Recurrent Graph Evolution Neural Network (ReGENN)
An extensive set of experiments was conducted comparing ReGENN with dozens of ensemble methods and classical statistical ones.
- Score: 33.79957892029931
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Time-series forecasting is one of the most active research topics in
artificial intelligence. Applications in real-world time series should consider
two factors for achieving reliable predictions: modeling dynamic dependencies
among multiple variables and adjusting the model's intrinsic hyperparameters. A
still open gap in that literature is that statistical and ensemble learning
approaches systematically present lower predictive performance than deep
learning methods. They generally disregard the data sequence aspect entangled
with multivariate data represented in more than one time series. Conversely,
this work presents a novel neural network architecture for time-series
forecasting that combines the power of graph evolution with deep recurrent
learning on distinct data distributions; we named our method Recurrent Graph
Evolution Neural Network (ReGENN). The idea is to infer multiple multivariate
relationships between co-occurring time-series by assuming that the temporal
data depends not only on inner variables and intra-temporal relationships
(i.e., observations from itself) but also on outer variables and inter-temporal
relationships (i.e., observations from other-selves). An extensive set of
experiments was conducted comparing ReGENN with dozens of ensemble methods and
classical statistical ones, showing sound improvement of up to 64.87% over the
competing algorithms. Furthermore, we present an analysis of the intermediate
weights arising from ReGENN, showing that by looking at inter and
intra-temporal relationships simultaneously, time-series forecasting is majorly
improved if paying attention to how multiple multivariate data synchronously
evolve.
Related papers
- PDETime: Rethinking Long-Term Multivariate Time Series Forecasting from
the perspective of partial differential equations [49.80959046861793]
We present PDETime, a novel LMTF model inspired by the principles of Neural PDE solvers.
Our experimentation across seven diversetemporal real-world LMTF datasets reveals that PDETime adapts effectively to the intrinsic nature of the data.
arXiv Detail & Related papers (2024-02-25T17:39:44Z) - TimeGraphs: Graph-based Temporal Reasoning [64.18083371645956]
TimeGraphs is a novel approach that characterizes dynamic interactions as a hierarchical temporal graph.
Our approach models the interactions using a compact graph-based representation, enabling adaptive reasoning across diverse time scales.
We evaluate TimeGraphs on multiple datasets with complex, dynamic agent interactions, including a football simulator, the Resistance game, and the MOMA human activity dataset.
arXiv Detail & Related papers (2024-01-06T06:26:49Z) - A Pattern Discovery Approach to Multivariate Time Series Forecasting [27.130141538089152]
State-of-the-art deep learning methods fail to construct models for full time series because model complexity grows exponentially with time series length.
We propose a novel pattern discovery method that can automatically capture diverse and complex time series patterns.
We also propose a learnable correlation matrix, that enables the model to capture distinct correlations among multiple time series.
arXiv Detail & Related papers (2022-12-20T14:54:04Z) - Learning the Evolutionary and Multi-scale Graph Structure for
Multivariate Time Series Forecasting [50.901984244738806]
We show how to model the evolutionary and multi-scale interactions of time series.
In particular, we first provide a hierarchical graph structure cooperated with the dilated convolution to capture the scale-specific correlations.
A unified neural network is provided to integrate the components above to get the final prediction.
arXiv Detail & Related papers (2022-06-28T08:11:12Z) - Multi-scale Attention Flow for Probabilistic Time Series Forecasting [68.20798558048678]
We propose a novel non-autoregressive deep learning model, called Multi-scale Attention Normalizing Flow(MANF)
Our model avoids the influence of cumulative error and does not increase the time complexity.
Our model achieves state-of-the-art performance on many popular multivariate datasets.
arXiv Detail & Related papers (2022-05-16T07:53:42Z) - Synergetic Learning of Heterogeneous Temporal Sequences for
Multi-Horizon Probabilistic Forecasting [48.8617204809538]
We propose Variational Synergetic Multi-Horizon Network (VSMHN), a novel deep conditional generative model.
To learn complex correlations across heterogeneous sequences, a tailored encoder is devised to combine the advances in deep point processes models and variational recurrent neural networks.
Our model can be trained effectively using variational inference and generates predictions with Monte-Carlo simulation.
arXiv Detail & Related papers (2021-01-31T11:00:55Z) - Multivariate Time-series Anomaly Detection via Graph Attention Network [27.12694738711663]
Anomaly detection on multivariate time-series is of great importance in both data mining research and industrial applications.
One major limitation is that they do not capture the relationships between different time-series explicitly.
We propose a novel self-supervised framework for multivariate time-series anomaly detection to address this issue.
arXiv Detail & Related papers (2020-09-04T07:46:19Z) - Connecting the Dots: Multivariate Time Series Forecasting with Graph
Neural Networks [91.65637773358347]
We propose a general graph neural network framework designed specifically for multivariate time series data.
Our approach automatically extracts the uni-directed relations among variables through a graph learning module.
Our proposed model outperforms the state-of-the-art baseline methods on 3 of 4 benchmark datasets.
arXiv Detail & Related papers (2020-05-24T04:02:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.