Rank-Based Causal Discovery for Post-Nonlinear Models

• URL: http://arxiv.org/abs/2302.12341v1
• Date: Thu, 23 Feb 2023 21:19:23 GMT
• Title: Rank-Based Causal Discovery for Post-Nonlinear Models
• Authors: Grigor Keropyan, David Strieder, Mathias Drton
• Abstract summary: Post-nonlinear (PNL) causal models constitute one of the most flexible options for such restricted subclasses. We propose a new approach for PNL causal discovery that uses rank-based methods to estimate the functional parameters.
• Score: 2.4493299476776778
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Learning causal relationships from empirical observations is a central task in scientific research. A common method is to employ structural causal models that postulate noisy functional relations among a set of interacting variables. To ensure unique identifiability of causal directions, researchers consider restricted subclasses of structural causal models. Post-nonlinear (PNL) causal models constitute one of the most flexible options for such restricted subclasses, containing in particular the popular additive noise models as a further subclass. However, learning PNL models is not well studied beyond the bivariate case. The existing methods learn non-linear functional relations by minimizing residual dependencies and subsequently test independence from residuals to determine causal orientations. However, these methods can be prone to overfitting and, thus, difficult to tune appropriately in practice. As an alternative, we propose a new approach for PNL causal discovery that uses rank-based methods to estimate the functional parameters. This new approach exploits natural invariances of PNL models and disentangles the estimation of the non-linear functions from the independence tests used to find causal orientations. We prove consistency of our method and validate our results in numerical experiments.

Related papers

• Enabling Causal Discovery in Post-Nonlinear Models with Normalizing Flows [6.954510776782872]
  Post-nonlinear (PNL) causal models stand out as a versatile and adaptable framework for modeling causal relationships. We introduce CAF-PoNo, harnessing the power of the normalizing flows architecture to enforce the crucial invertibility constraint in PNL models. Our method precisely reconstructs the hidden noise, which plays a vital role in cause-effect identification.
  arXiv  Detail & Related papers  (2024-07-06T07:19:21Z)
• Identifiable Latent Polynomial Causal Models Through the Lens of Change [82.14087963690561]
  Causal representation learning aims to unveil latent high-level causal representations from observed low-level data. One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as identifiability.
  arXiv  Detail & Related papers  (2023-10-24T07:46:10Z)
• Shortcuts for causal discovery of nonlinear models by score matching [32.01302470630594]
  We define and characterize a score-sortability pattern of nonlinear additive noise models. We show the score-sortability of the most common synthetic benchmarks in the literature. Our findings remark the lack of diversity in the data as an important limitation in the evaluation of nonlinear causal discovery approaches.
  arXiv  Detail & Related papers  (2023-10-22T10:09:52Z)
• Less is More: Mitigate Spurious Correlations for Open-Domain Dialogue Response Generation Models by Causal Discovery [52.95935278819512]
  We conduct the first study on spurious correlations for open-domain response generation models based on a corpus CGDIALOG curated in our work. Inspired by causal discovery algorithms, we propose a novel model-agnostic method for training and inference of response generation model.
  arXiv  Detail & Related papers  (2023-03-02T06:33:48Z)
• NODAGS-Flow: Nonlinear Cyclic Causal Structure Learning [8.20217860574125]
  We propose a novel framework for learning nonlinear cyclic causal models from interventional data, called NODAGS-Flow. We show significant performance improvements with our approach compared to state-of-the-art methods with respect to structure recovery and predictive performance.
  arXiv  Detail & Related papers  (2023-01-04T23:28:18Z)
• Causal Inference via Nonlinear Variable Decorrelation for Healthcare Applications [60.26261850082012]
  We introduce a novel method with a variable decorrelation regularizer to handle both linear and nonlinear confounding. We employ association rules as new representations using association rule mining based on the original features to increase model interpretability.
  arXiv  Detail & Related papers  (2022-09-29T17:44:14Z)
• Data-Driven Influence Functions for Optimization-Based Causal Inference [105.5385525290466]
  We study a constructive algorithm that approximates Gateaux derivatives for statistical functionals by finite differencing. We study the case where probability distributions are not known a priori but need to be estimated from data.
  arXiv  Detail & Related papers  (2022-08-29T16:16:22Z)
• Estimation of Bivariate Structural Causal Models by Variational Gaussian Process Regression Under Likelihoods Parametrised by Normalising Flows [74.85071867225533]
  Causal mechanisms can be described by structural causal models. One major drawback of state-of-the-art artificial intelligence is its lack of explainability.
  arXiv  Detail & Related papers  (2021-09-06T14:52:58Z)
• Disentangling Observed Causal Effects from Latent Confounders using Method of Moments [67.27068846108047]
  We provide guarantees on identifiability and learnability under mild assumptions. We develop efficient algorithms based on coupled tensor decomposition with linear constraints to obtain scalable and guaranteed solutions.
  arXiv  Detail & Related papers  (2021-01-17T07:48:45Z)
• Causal network learning with non-invertible functional relationships [7.845605663563046]
  Several recent results have established the identifiability of causal DAGs with non-Gaussian and/or nonlinear structural equation models (SEMs) In this paper, we focus on nonlinear SEMs defined by non-invertible functions, which exist in many data domains. We develop a method to incorporate this test in structure learning of DAGs that contain both linear and nonlinear causal relations.
  arXiv  Detail & Related papers  (2020-04-20T21:32:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.