Exploring Neural Granger Causality with xLSTMs: Unveiling Temporal Dependencies in Complex Data

• URL: http://arxiv.org/abs/2502.09981v1
• Date: Fri, 14 Feb 2025 08:07:03 GMT
• Title: Exploring Neural Granger Causality with xLSTMs: Unveiling Temporal Dependencies in Complex Data
• Authors: Harsh Poonia, Felix Divo, Kristian Kersting, Devendra Singh Dhami,
• Abstract summary: Causality in time series can be difficult to determine, especially in the presence of non-linear dependencies. We propose Granger causal xLSTMs (GC-xLSTM) for capturing long-range relations between variables. Our experimental evaluations on three datasets demonstrate the overall efficacy of our proposed GC-xLSTM model.
• Score: 20.773694998061707
• License:
• Abstract: Causality in time series can be difficult to determine, especially in the presence of non-linear dependencies. The concept of Granger causality helps analyze potential relationships between variables, thereby offering a method to determine whether one time series can predict-Granger cause-future values of another. Although successful, Granger causal methods still struggle with capturing long-range relations between variables. To this end, we leverage the recently successful Extended Long Short-Term Memory (xLSTM) architecture and propose Granger causal xLSTMs (GC-xLSTM). It first enforces sparsity between the time series components by using a novel dynamic lass penalty on the initial projection. Specifically, we adaptively improve the model and identify sparsity candidates. Our joint optimization procedure then ensures that the Granger causal relations are recovered in a robust fashion. Our experimental evaluations on three datasets demonstrate the overall efficacy of our proposed GC-xLSTM model.

Related papers

• Bayesian Vector AutoRegression with Factorised Granger-Causal Graphs [10.030023978159978]
  We study the problem of automatically discovering Granger causal relations from observational time-series data. We propose a new Bayesian VAR model with a hierarchical factorised prior distribution over binary Granger causal graphs. We develop an efficient algorithm to infer the posterior over binary Granger causal graphs.
  arXiv  Detail & Related papers  (2024-02-06T01:01:23Z)
• Robust Detection of Lead-Lag Relationships in Lagged Multi-Factor Models [61.10851158749843]
  Key insights can be obtained by discovering lead-lag relationships inherent in the data. We develop a clustering-driven methodology for robust detection of lead-lag relationships in lagged multi-factor models.
  arXiv  Detail & Related papers  (2023-05-11T10:30:35Z)
• GLACIAL: Granger and Learning-based Causality Analysis for Longitudinal Imaging Studies [8.709178038700033]
  We propose an approach named GLACIAL (Granger and LeArning-based CausalIty Analysis for Longitudinal studies) to fill this methodological gap. In this paper, we propose an approach named GLACIAL (Granger and LeArning-based CausalIty Analysis for Longitudinal studies) to fill this methodological gap.
  arXiv  Detail & Related papers  (2022-10-13T23:42:13Z)
• From Gradient Flow on Population Loss to Learning with Stochastic Gradient Descent [50.4531316289086]
  Gradient Descent (SGD) has been the method of choice for learning large-scale non-root models. An overarching paper is providing general conditions SGD converges, assuming that GF on the population loss converges. We provide a unified analysis for GD/SGD not only for classical settings like convex losses, but also for more complex problems including Retrieval Matrix sq-root.
  arXiv  Detail & Related papers  (2022-10-13T03:55:04Z)
• Jacobian Granger Causal Neural Networks for Analysis of Stationary and Nonstationary Data [19.347558051611827]
  We introduce a neural network-based approach to Granger causality using the Jacobian as a measure of variable importance. The resulting approach performs consistently well compared to other approaches in identifying Granger causal variables.
  arXiv  Detail & Related papers  (2022-05-19T14:07:54Z)
• Deep Recurrent Modelling of Granger Causality with Latent Confounding [0.0]
  We propose a deep learning-based approach to model non-linear Granger causality by directly accounting for latent confounders. We demonstrate the model performance on non-linear time series for which the latent confounder influences the cause and effect with different time lags.
  arXiv  Detail & Related papers  (2022-02-23T03:26:22Z)
• BCD Nets: Scalable Variational Approaches for Bayesian Causal Discovery [97.79015388276483]
  A structural equation model (SEM) is an effective framework to reason over causal relationships represented via a directed acyclic graph (DAG) Recent advances enabled effective maximum-likelihood point estimation of DAGs from observational data. We propose BCD Nets, a variational framework for estimating a distribution over DAGs characterizing a linear-Gaussian SEM.
  arXiv  Detail & Related papers  (2021-12-06T03:35:21Z)
• An Empirical Study: Extensive Deep Temporal Point Process [61.14164208094238]
  We first review recent research emphasis and difficulties in modeling asynchronous event sequences with deep temporal point process. We propose a Granger causality discovery framework for exploiting the relations among multi-types of events.
  arXiv  Detail & Related papers  (2021-10-19T10:15:00Z)
• Overcoming Catastrophic Forgetting with Gaussian Mixture Replay [79.0660895390689]
  We present a rehearsal-based approach for continual learning (CL) based on Gaussian Mixture Models (GMM) We mitigate catastrophic forgetting (CF) by generating samples from previous tasks and merging them with current training data. We evaluate GMR on multiple image datasets, which are divided into class-disjoint sub-tasks.
  arXiv  Detail & Related papers  (2021-04-19T11:41:34Z)
• Inductive Granger Causal Modeling for Multivariate Time Series [49.29373497269468]
  We propose an Inductive GRanger cAusal modeling (InGRA) framework for inductive Granger causality learning and common causal structure detection. In particular, we train one global model for individuals with different Granger causal structures through a novel attention mechanism, called Granger causal attention. The model can detect common causal structures for different individuals and infer Granger causal structures for newly arrived individuals.
  arXiv  Detail & Related papers  (2021-02-10T07:48:00Z)
• Dynamic Window-level Granger Causality of Multi-channel Time Series [28.302491046127443]
  We present the dynamic window-level Granger causality method (DWGC) for multi-channel time series data. We propose the causality indexing trick in our DWGC method to reweight the original time series data.
  arXiv  Detail & Related papers  (2020-06-14T03:53:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.