Neural Additive Vector Autoregression Models for Causal Discovery in Time Series

• URL: http://arxiv.org/abs/2010.09429v2
• Date: Mon, 18 Oct 2021 08:39:02 GMT
• Title: Neural Additive Vector Autoregression Models for Causal Discovery in Time Series
• Authors: Bart Bussmann, Jannes Nys, Steven Latr\'e
• Abstract summary: We propose a neural approach to causal structure learning that can discover nonlinear relationships. We train deep neural networks that extract the (additive) Granger causal influences from the time evolution in time series. The method achieves state-of-the-art results on various benchmark data sets for causal discovery.
• Score: 1.160208922584163
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Causal structure discovery in complex dynamical systems is an important challenge for many scientific domains. Although data from (interventional) experiments is usually limited, large amounts of observational time series data sets are usually available. Current methods that learn causal structure from time series often assume linear relationships. Hence, they may fail in realistic settings that contain nonlinear relations between the variables. We propose Neural Additive Vector Autoregression (NAVAR) models, a neural approach to causal structure learning that can discover nonlinear relationships. We train deep neural networks that extract the (additive) Granger causal influences from the time evolution in multi-variate time series. The method achieves state-of-the-art results on various benchmark data sets for causal discovery, while providing clear interpretations of the mapped causal relations.

Related papers

• CausalFormer: An Interpretable Transformer for Temporal Causal Discovery [24.608536564444137]
  We propose an interpretable transformer-based causal discovery model termed CausalFormer. The causality-aware transformer learns the causal representation of time series data using a prediction task. The decomposition-based causality detector interprets the global structure of the trained causality-aware transformer.
  arXiv  Detail & Related papers  (2024-06-24T15:09:29Z)
• Embracing the black box: Heading towards foundation models for causal discovery from time series data [8.073449277052495]
  Causal Pretraining is a methodology that aims to learn a direct mapping from time series to the underlying causal graphs in a supervised manner. Our empirical findings suggest that causal discovery in a supervised manner is possible, assuming that the training and test time series samples share most of their dynamics. We provide examples where causal discovery for real-world data with causally pretrained neural networks is possible within limits.
  arXiv  Detail & Related papers  (2024-02-14T16:49:13Z)
• Correlation-aware Spatial-Temporal Graph Learning for Multivariate Time-series Anomaly Detection [67.60791405198063]
  We propose a correlation-aware spatial-temporal graph learning (termed CST-GL) for time series anomaly detection. CST-GL explicitly captures the pairwise correlations via a multivariate time series correlation learning module. A novel anomaly scoring component is further integrated into CST-GL to estimate the degree of an anomaly in a purely unsupervised manner.
  arXiv  Detail & Related papers  (2023-07-17T11:04:27Z)
• Causal discovery for time series with constraint-based model and PMIME measure [0.0]
  We present a novel approach for discovering causality in time series data that combines a causal discovery algorithm with an information theoretic-based measure. We evaluate the performance of our approach on several simulated data sets, showing promising results.
  arXiv  Detail & Related papers  (2023-05-31T09:38:50Z)
• Amortized Inference for Causal Structure Learning [72.84105256353801]
  Learning causal structure poses a search problem that typically involves evaluating structures using a score or independence test. We train a variational inference model to predict the causal structure from observational/interventional data. Our models exhibit robust generalization capabilities under substantial distribution shift.
  arXiv  Detail & Related papers  (2022-05-25T17:37:08Z)
• Consistency of mechanistic causal discovery in continuous-time using Neural ODEs [85.7910042199734]
  We consider causal discovery in continuous-time for the study of dynamical systems. We propose a causal discovery algorithm based on penalized Neural ODEs.
  arXiv  Detail & Related papers  (2021-05-06T08:48:02Z)
• Pay Attention to Evolution: Time Series Forecasting with Deep Graph-Evolution Learning [33.79957892029931]
  This work presents a novel neural network architecture for time-series forecasting. We named our method Recurrent Graph Evolution Neural Network (ReGENN) An extensive set of experiments was conducted comparing ReGENN with dozens of ensemble methods and classical statistical ones.
  arXiv  Detail & Related papers  (2020-08-28T20:10:07Z)
• Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Data [63.15776078733762]
  We propose Amortized Causal Discovery, a novel framework to learn to infer causal relations from time-series data. We demonstrate experimentally that this approach, implemented as a variational model, leads to significant improvements in causal discovery performance.
  arXiv  Detail & Related papers  (2020-06-18T19:59:12Z)
• Learning Causal Models Online [103.87959747047158]
  Predictive models can rely on spurious correlations in the data for making predictions. One solution for achieving strong generalization is to incorporate causal structures in the models. We propose an online algorithm that continually detects and removes spurious features.
  arXiv  Detail & Related papers  (2020-06-12T20:49:20Z)
• Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks [91.65637773358347]
  We propose a general graph neural network framework designed specifically for multivariate time series data. Our approach automatically extracts the uni-directed relations among variables through a graph learning module. Our proposed model outperforms the state-of-the-art baseline methods on 3 of 4 benchmark datasets.
  arXiv  Detail & Related papers  (2020-05-24T04:02:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.