TS-CausalNN: Learning Temporal Causal Relations from Non-linear Non-stationary Time Series Data

• URL: http://arxiv.org/abs/2404.01466v1
• Date: Mon, 1 Apr 2024 20:33:29 GMT
• Title: TS-CausalNN: Learning Temporal Causal Relations from Non-linear Non-stationary Time Series Data
• Authors: Omar Faruque, Sahara Ali, Xue Zheng, Jianwu Wang,
• Abstract summary: We propose a Time-Series Causal Neural Network (TS-CausalNN) to discover contemporaneous and lagged causal relations simultaneously. In addition to the simple parallel design, an advantage of the proposed model is that it naturally handles the non-stationarity and non-linearity of the data.
• Score: 0.42156176975445486
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The growing availability and importance of time series data across various domains, including environmental science, epidemiology, and economics, has led to an increasing need for time-series causal discovery methods that can identify the intricate relationships in the non-stationary, non-linear, and often noisy real world data. However, the majority of current time series causal discovery methods assume stationarity and linear relations in data, making them infeasible for the task. Further, the recent deep learning-based methods rely on the traditional causal structure learning approaches making them computationally expensive. In this paper, we propose a Time-Series Causal Neural Network (TS-CausalNN) - a deep learning technique to discover contemporaneous and lagged causal relations simultaneously. Our proposed architecture comprises (i) convolutional blocks comprising parallel custom causal layers, (ii) acyclicity constraint, and (iii) optimization techniques using the augmented Lagrangian approach. In addition to the simple parallel design, an advantage of the proposed model is that it naturally handles the non-stationarity and non-linearity of the data. Through experiments on multiple synthetic and real world datasets, we demonstrate the empirical proficiency of our proposed approach as compared to several state-of-the-art methods. The inferred graphs for the real world dataset are in good agreement with the domain understanding.

Related papers

• Learning Divergence Fields for Shift-Robust Graph Representations [73.11818515795761]
  In this work, we propose a geometric diffusion model with learnable divergence fields for the challenging problem with interdependent data. We derive a new learning objective through causal inference, which can guide the model to learn generalizable patterns of interdependence that are insensitive across domains.
  arXiv  Detail & Related papers  (2024-06-07T14:29:21Z)
• Identifiable Feature Learning for Spatial Data with Nonlinear ICA [18.480534062833673]
  We introduce a new nonlinear ICA framework that employs latent components which apply naturally to data with higher-dimensional dependency structures. In particular, we develop a new learning and algorithm that extends variational methods to handle the combination of a deep neural network mixing function with the TP prior inducing computational efficacy.
  arXiv  Detail & Related papers  (2023-11-28T15:00:11Z)
• Correlation-aware Spatial-Temporal Graph Learning for Multivariate Time-series Anomaly Detection [67.60791405198063]
  We propose a correlation-aware spatial-temporal graph learning (termed CST-GL) for time series anomaly detection. CST-GL explicitly captures the pairwise correlations via a multivariate time series correlation learning module. A novel anomaly scoring component is further integrated into CST-GL to estimate the degree of an anomaly in a purely unsupervised manner.
  arXiv  Detail & Related papers  (2023-07-17T11:04:27Z)
• NODAGS-Flow: Nonlinear Cyclic Causal Structure Learning [8.20217860574125]
  We propose a novel framework for learning nonlinear cyclic causal models from interventional data, called NODAGS-Flow. We show significant performance improvements with our approach compared to state-of-the-art methods with respect to structure recovery and predictive performance.
  arXiv  Detail & Related papers  (2023-01-04T23:28:18Z)
• PIETS: Parallelised Irregularity Encoders for Forecasting with Heterogeneous Time-Series [5.911865723926626]
  Heterogeneity and irregularity of multi-source data sets present a significant challenge to time-series analysis. In this work, we design a novel architecture, PIETS, to model heterogeneous time-series. We show that PIETS is able to effectively model heterogeneous temporal data and outperforms other state-of-the-art approaches in the prediction task.
  arXiv  Detail & Related papers  (2021-09-30T20:01:19Z)
• Learning Neural Causal Models with Active Interventions [83.44636110899742]
  We introduce an active intervention-targeting mechanism which enables a quick identification of the underlying causal structure of the data-generating process. Our method significantly reduces the required number of interactions compared with random intervention targeting. We demonstrate superior performance on multiple benchmarks from simulated to real-world data.
  arXiv  Detail & Related papers  (2021-09-06T13:10:37Z)
• A Procedural World Generation Framework for Systematic Evaluation of Continual Learning [2.599882743586164]
  We introduce a computer graphics simulation framework that repeatedly renders only upcoming urban scene fragments. At its core lies a modular parametric generative model with adaptable generative factors.
  arXiv  Detail & Related papers  (2021-06-04T16:31:43Z)
• Leveraging Pre-Images to Discover Nonlinear Relationships in Multivariate Environments [0.0]
  Causal discovery offers a crucial functionality in scientific discovery using artificial intelligence. It became apparent that many real-world temporal observations are nonlinearly related to each other. We show that our method outperforms state-of-the-art causal discovery methods when the observations are restricted by time and are nonlinearly related.
  arXiv  Detail & Related papers  (2021-06-01T22:42:51Z)
• Consistency of mechanistic causal discovery in continuous-time using Neural ODEs [85.7910042199734]
  We consider causal discovery in continuous-time for the study of dynamical systems. We propose a causal discovery algorithm based on penalized Neural ODEs.
  arXiv  Detail & Related papers  (2021-05-06T08:48:02Z)
• Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks [91.65637773358347]
  We propose a general graph neural network framework designed specifically for multivariate time series data. Our approach automatically extracts the uni-directed relations among variables through a graph learning module. Our proposed model outperforms the state-of-the-art baseline methods on 3 of 4 benchmark datasets.
  arXiv  Detail & Related papers  (2020-05-24T04:02:18Z)
• Discovering Nonlinear Relations with Minimum Predictive Information Regularization [67.7764810514585]
  We introduce a novel minimum predictive information regularization method to infer directional relations from time series. Our method substantially outperforms other methods for learning nonlinear relations in synthetic datasets.
  arXiv  Detail & Related papers  (2020-01-07T04:28:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.