Causal Representation Learning in Temporal Data via Single-Parent Decoding

• URL: http://arxiv.org/abs/2410.07013v1
• Date: Wed, 9 Oct 2024 15:57:50 GMT
• Title: Causal Representation Learning in Temporal Data via Single-Parent Decoding
• Authors: Philippe Brouillard, Sébastien Lachapelle, Julia Kaltenborn, Yaniv Gurwicz, Dhanya Sridhar, Alexandre Drouin, Peer Nowack, Jakob Runge, David Rolnick,
• Abstract summary: Scientific research often seeks to understand the causal structure underlying high-level variables in a system. Scientists typically collect low-level measurements, such as geographically distributed temperature readings. We propose a differentiable method, Causal Discovery with Single-parent Decoding, that simultaneously learns the underlying latents and a causal graph over them.
• Score: 66.34294989334728
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Scientific research often seeks to understand the causal structure underlying high-level variables in a system. For example, climate scientists study how phenomena, such as El Ni\~no, affect other climate processes at remote locations across the globe. However, scientists typically collect low-level measurements, such as geographically distributed temperature readings. From these, one needs to learn both a mapping to causally-relevant latent variables, such as a high-level representation of the El Ni\~no phenomenon and other processes, as well as the causal model over them. The challenge is that this task, called causal representation learning, is highly underdetermined from observational data alone, requiring other constraints during learning to resolve the indeterminacies. In this work, we consider a temporal model with a sparsity assumption, namely single-parent decoding: each observed low-level variable is only affected by a single latent variable. Such an assumption is reasonable in many scientific applications that require finding groups of low-level variables, such as extracting regions from geographically gridded measurement data in climate research or capturing brain regions from neural activity data. We demonstrate the identifiability of the resulting model and propose a differentiable method, Causal Discovery with Single-parent Decoding (CDSD), that simultaneously learns the underlying latents and a causal graph over them. We assess the validity of our theoretical results using simulated data and showcase the practical validity of our method in an application to real-world data from the climate science field.

Related papers

• Discovering Latent Structural Causal Models from Spatio-Temporal Data [23.400027588427964]
  We present SPACY (SPAtiotemporal Causal discoverY), a novel framework based on variational inference. We show that SPACY outperforms state-of-the-art baselines on synthetic data, remains scalable for large grids, and identifies key known phenomena from real-world climate data.
  arXiv  Detail & Related papers  (2024-11-08T05:12:16Z)
• Hypothesizing Missing Causal Variables with LLMs [55.28678224020973]
  We formulate a novel task where the input is a partial causal graph with missing variables, and the output is a hypothesis about the missing variables to complete the partial graph. We show the strong ability of LLMs to hypothesize the mediation variables between a cause and its effect. We also observe surprising results where some of the open-source models outperform the closed GPT-4 model.
  arXiv  Detail & Related papers  (2024-09-04T10:37:44Z)
• Smoke and Mirrors in Causal Downstream Tasks [59.90654397037007]
  This paper looks at the causal inference task of treatment effect estimation, where the outcome of interest is recorded in high-dimensional observations. We compare 6 480 models fine-tuned from state-of-the-art visual backbones, and find that the sampling and modeling choices significantly affect the accuracy of the causal estimate. Our results suggest that future benchmarks should carefully consider real downstream scientific questions, especially causal ones.
  arXiv  Detail & Related papers  (2024-05-27T13:26:34Z)
• On the Identification of Temporally Causal Representation with Instantaneous Dependence [50.14432597910128]
  Temporally causal representation learning aims to identify the latent causal process from time series observations. Most methods require the assumption that the latent causal processes do not have instantaneous relations. We propose an textbfIDentification framework for instantanetextbfOus textbfLatent dynamics.
  arXiv  Detail & Related papers  (2024-05-24T08:08:05Z)
• Marrying Causal Representation Learning with Dynamical Systems for Science [20.370707645572676]
  Causal representation learning promises to extend causal models to hidden causal variables from raw entangled measurements. In this paper, we draw a clear connection between the two and their key assumptions. We learn explicitly controllable models that isolate the trajectory-specific parameters for further downstream tasks.
  arXiv  Detail & Related papers  (2024-05-22T18:00:41Z)
• Learning Causal Representations from General Environments: Identifiability and Intrinsic Ambiguity [27.630223763160515]
  We provide the first identifiability results based on data that stem from general environments. We show that for linear causal models, while the causal graph can be fully recovered, the latent variables are only identified up to the surrounded-node ambiguity (SNA) We also propose an algorithm, textttLiNGCReL which provably recovers the ground-truth model up to SNA.
  arXiv  Detail & Related papers  (2023-11-21T01:09:11Z)
• Multi-variable Hard Physical Constraints for Climate Model Downscaling [17.402215838651557]
  Global Climate Models (GCMs) are the primary tool to simulate climate evolution and assess the impacts of climate change. They often operate at a coarse spatial resolution that limits their accuracy in reproducing local-scale phenomena. This study investigates the scope of this problem and, through an application on temperature, lays the foundation for a framework introducing multi-variable hard constraints.
  arXiv  Detail & Related papers  (2023-08-02T11:42:02Z)
• Evaluating Loss Functions and Learning Data Pre-Processing for Climate Downscaling Deep Learning Models [0.0]
  We study the effects of loss functions and non-linear data pre-processing methods for deep learning models in the context of climate downscaling. Our findings reveal that L1 loss and L2 loss perform similarly on some more balanced data like temperature data while for some imbalanced data like precipitation data, L2 loss performs significantly better than L1 loss.
  arXiv  Detail & Related papers  (2023-06-19T19:58:42Z)
• Nonparametric Identifiability of Causal Representations from Unknown Interventions [63.1354734978244]
  We study causal representation learning, the task of inferring latent causal variables and their causal relations from mixtures of the variables. Our goal is to identify both the ground truth latents and their causal graph up to a set of ambiguities which we show to be irresolvable from interventional data.
  arXiv  Detail & Related papers  (2023-06-01T10:51:58Z)
• Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning [76.00395335702572]
  A central goal for AI and causality is the joint discovery of abstract representations and causal structure. Existing environments for studying causal induction are poorly suited for this objective because they have complicated task-specific causal graphs. In this work, our goal is to facilitate research in learning representations of high-level variables as well as causal structures among them.
  arXiv  Detail & Related papers  (2021-07-02T05:44:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.