Learning Granger Causality from Instance-wise Self-attentive Hawkes Processes

• URL: http://arxiv.org/abs/2402.03726v2
• Date: Thu, 29 Feb 2024 10:14:00 GMT
• Title: Learning Granger Causality from Instance-wise Self-attentive Hawkes Processes
• Authors: Dongxia Wu, Tsuyoshi Id\'e, Aur\'elie Lozano, Georgios Kollias, Ji\v{r}\'i Navr\'atil, Naoki Abe, Yi-An Ma, Rose Yu
• Abstract summary: Instance-wise Self-Attentive Hawkes Processes (ISAHP) is a novel deep learning framework that can directly infer the Granger causality at the instance level. ISAHP is capable of discovering complex instance-level causal structures that cannot be handled by classical models.
• Score: 24.956802640469554
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We address the problem of learning Granger causality from asynchronous, interdependent, multi-type event sequences. In particular, we are interested in discovering instance-level causal structures in an unsupervised manner. Instance-level causality identifies causal relationships among individual events, providing more fine-grained information for decision-making. Existing work in the literature either requires strong assumptions, such as linearity in the intensity function, or heuristically defined model parameters that do not necessarily meet the requirements of Granger causality. We propose Instance-wise Self-Attentive Hawkes Processes (ISAHP), a novel deep learning framework that can directly infer the Granger causality at the event instance level. ISAHP is the first neural point process model that meets the requirements of Granger causality. It leverages the self-attention mechanism of the transformer to align with the principles of Granger causality. We empirically demonstrate that ISAHP is capable of discovering complex instance-level causal structures that cannot be handled by classical models. We also show that ISAHP achieves state-of-the-art performance in proxy tasks involving type-level causal discovery and instance-level event type prediction.

Related papers

• Granger Causality in Extremes [0.0]
  We introduce a rigorous framework for identifying causal links from extreme events in time series. Our framework is designed to infer causality mainly from extreme events by leveraging the causal tail coefficient. We also propose a novel inference method for detecting the presence of Granger causality in extremes from data.
  arXiv  Detail & Related papers  (2024-07-12T18:41:07Z)
• Jacobian Regularizer-based Neural Granger Causality [45.902407376192656]
  We propose a Jacobian Regularizer-based Neural Granger Causality (JRNGC) approach. Our method eliminates the sparsity constraints of weights by leveraging an input-output Jacobian matrix regularizer. Our proposed approach achieves competitive performance with the state-of-the-art methods for learning summary Granger causality and full-time Granger causality.
  arXiv  Detail & Related papers  (2024-05-14T17:13:50Z)
• TNPAR: Topological Neural Poisson Auto-Regressive Model for Learning Granger Causal Structure from Event Sequences [27.289511320823895]
  Learning Granger causality from event sequences is a challenging but essential task across various applications. We devise a unified topological neural Poisson auto-regressive model with two processes. Experiments on simulated and real-world data demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-06-25T03:31:47Z)
• Deep Recurrent Modelling of Granger Causality with Latent Confounding [0.0]
  We propose a deep learning-based approach to model non-linear Granger causality by directly accounting for latent confounders. We demonstrate the model performance on non-linear time series for which the latent confounder influences the cause and effect with different time lags.
  arXiv  Detail & Related papers  (2022-02-23T03:26:22Z)
• Effect Identification in Cluster Causal Diagrams [51.42809552422494]
  We introduce a new type of graphical model called cluster causal diagrams (for short, C-DAGs) C-DAGs allow for the partial specification of relationships among variables based on limited prior knowledge. We develop the foundations and machinery for valid causal inferences over C-DAGs.
  arXiv  Detail & Related papers  (2022-02-22T21:27:31Z)
• Discovering Latent Causal Variables via Mechanism Sparsity: A New Principle for Nonlinear ICA [81.4991350761909]
  Independent component analysis (ICA) refers to an ensemble of methods which formalize this goal and provide estimation procedure for practical application. We show that the latent variables can be recovered up to a permutation if one regularizes the latent mechanisms to be sparse.
  arXiv  Detail & Related papers  (2021-07-21T14:22:14Z)
• Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning [76.00395335702572]
  A central goal for AI and causality is the joint discovery of abstract representations and causal structure. Existing environments for studying causal induction are poorly suited for this objective because they have complicated task-specific causal graphs. In this work, our goal is to facilitate research in learning representations of high-level variables as well as causal structures among them.
  arXiv  Detail & Related papers  (2021-07-02T05:44:56Z)
• Variational Causal Networks: Approximate Bayesian Inference over Causal Structures [132.74509389517203]
  We introduce a parametric variational family modelled by an autoregressive distribution over the space of discrete DAGs. In experiments, we demonstrate that the proposed variational posterior is able to provide a good approximation of the true posterior.
  arXiv  Detail & Related papers  (2021-06-14T17:52:49Z)
• Inductive Granger Causal Modeling for Multivariate Time Series [49.29373497269468]
  We propose an Inductive GRanger cAusal modeling (InGRA) framework for inductive Granger causality learning and common causal structure detection. In particular, we train one global model for individuals with different Granger causal structures through a novel attention mechanism, called Granger causal attention. The model can detect common causal structures for different individuals and infer Granger causal structures for newly arrived individuals.
  arXiv  Detail & Related papers  (2021-02-10T07:48:00Z)
• CAUSE: Learning Granger Causality from Event Sequences using Attribution Methods [25.04848774593105]
  We study the problem of learning Granger causality between event types from asynchronous, interdependent, multi-type event sequences. We propose CAUSE (Causality from AttribUtions on Sequence of Events), a novel framework for the studied task. We demonstrate that CAUSE achieves superior performance on correctly inferring the inter-type Granger causality over a range of state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-02-18T22:21:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.