Joint Causal Structure and Cluster Discovery Using Variational Inference

• URL: http://arxiv.org/abs/2608.22212v1
• Date: Sun, 23 Aug 2026 04:32:36 GMT
• Title: Joint Causal Structure and Cluster Discovery Using Variational Inference
• Abstract summary: Causal discovery aims to understand the relationships between individual random variables.<n>Existing methods assume that knowledge of such groups or clusters is explicitly available when modeling interactions.<n>We present a novel approach based on variational inference to simultaneously infer both the latent clusters and causal structures.
• Score: 12.348487219726865
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Causal discovery aims to understand the relationships between individual random variables. In many applications, such as brain imaging and climate modeling, it is more meaningful to consider interactions among groups of variables. Existing methods assume that knowledge of such groups or clusters is explicitly available when modeling interactions. However, in practice, these clusters as well as the causal relationships among them, are latent. In this paper, we present a novel approach based on variational inference to simultaneously infer both the latent clusters and causal structures. We learn an approximate posterior over clusters and graph-structure by considering variational distributions based on categorical and Bernoulli models respectively. We derive variational lower bounds and estimation techniques to learn variational and model parameters. The effectiveness of our proposed methods for cluster and causal discovery are demonstrated on both synthetic and real data sets.

Related papers

• CASL-VAE: Learning Structured Latent Variables from Unpaired Data for Semi-supervised Clustering and Paired Sample Generation [16.737784124258898]
  Quantifying variability in a target population relative to a reference population is central to many scientific and clinical problems.<n>We propose textitCASL-VAE, a deep contrastive latent variable model that learns structured latent generative factors from unpaired data.
  arXiv  Detail & Related papers  (2026-07-09T08:58:44Z)
• Relational Structural Causal Models [52.818153111470394]
  We develop relational structural causal models, extending structural causal models to settings where objects and their relations vary.<n>We propose relational neural causal models, a provably correct approach that outperforms non-relational baselines on simulated traffic scenes.
  arXiv  Detail & Related papers  (2026-06-12T18:54:06Z)
• Group Interventions on Deep Networks for Causal Discovery in Subsystems [9.239779358333182]
  Causal discovery uncovers complex relationships between variables, enhancing predictions, decision-making, and insights into real-world systems.<n>We introduce gCDMI, a novel multi-group causal discovery method that leverages group-level interventions on trained deep neural networks.<n>We evaluate our method on simulated datasets, demonstrating its superior performance compared to existing methods.
  arXiv  Detail & Related papers  (2025-10-27T22:26:20Z)
• How Compositional Generalization and Creativity Improve as Diffusion Models are Trained [82.08869888944324]
  How many samples do generative models need in order to learn composition rules?<n>What signal in the data is exploited to learn those rules?<n>We discuss connections between the hierarchical clustering mechanism we introduce here and the renormalization group in physics.
  arXiv  Detail & Related papers  (2025-02-17T18:06:33Z)
• On the Joint Interaction of Models, Data, and Features [82.60073661644435]
  We introduce a new tool, the interaction tensor, for empirically analyzing the interaction between data and model through features. Based on these observations, we propose a conceptual framework for feature learning. Under this framework, the expected accuracy for a single hypothesis and agreement for a pair of hypotheses can both be derived in closed-form.
  arXiv  Detail & Related papers  (2023-06-07T21:35:26Z)
• Bayesian Additive Main Effects and Multiplicative Interaction Models using Tensor Regression for Multi-environmental Trials [0.0]
  We propose a Bayesian tensor regression model to accommodate the effect of multiple factors on phenotype prediction.<n>We adopt a set of prior distributions that resolve identifiability issues that may arise between the parameters in the model.<n>We also incorporate a spike-and-slab structure that identifies which interactions are relevant for inclusion in the linear predictor.
  arXiv  Detail & Related papers  (2023-01-09T19:54:50Z)
• Estimation of Bivariate Structural Causal Models by Variational Gaussian Process Regression Under Likelihoods Parametrised by Normalising Flows [74.85071867225533]
  Causal mechanisms can be described by structural causal models. One major drawback of state-of-the-art artificial intelligence is its lack of explainability.
  arXiv  Detail & Related papers  (2021-09-06T14:52:58Z)
• Learning Neural Causal Models with Active Interventions [83.44636110899742]
  We introduce an active intervention-targeting mechanism which enables a quick identification of the underlying causal structure of the data-generating process. Our method significantly reduces the required number of interactions compared with random intervention targeting. We demonstrate superior performance on multiple benchmarks from simulated to real-world data.
  arXiv  Detail & Related papers  (2021-09-06T13:10:37Z)
• A Twin Neural Model for Uplift [59.38563723706796]
  Uplift is a particular case of conditional treatment effect modeling. We propose a new loss function defined by leveraging a connection with the Bayesian interpretation of the relative risk. We show our proposed method is competitive with the state-of-the-art in simulation setting and on real data from large scale randomized experiments.
  arXiv  Detail & Related papers  (2021-05-11T16:02:39Z)
• Modelling Heterogeneity Using Bayesian Structured Sparsity [0.0]
  How to estimate the effect of some variable differing across observations is a key question in political science. This paper allows a common way of simplifying complex phenomenon (placing observations with similar effects into discrete groups) to be integrated into regression analysis.
  arXiv  Detail & Related papers  (2021-03-29T19:54:25Z)
• Structural Causal Models Are (Solvable by) Credal Networks [70.45873402967297]
  Causal inferences can be obtained by standard algorithms for the updating of credal nets. This contribution should be regarded as a systematic approach to represent structural causal models by credal networks. Experiments show that approximate algorithms for credal networks can immediately be used to do causal inference in real-size problems.
  arXiv  Detail & Related papers  (2020-08-02T11:19:36Z)
• Blocked Clusterwise Regression [0.0]
  We generalize previous approaches to discrete unobserved heterogeneity by allowing each unit to have multiple latent variables. We contribute to the theory of clustering with an over-specified number of clusters and derive new convergence rates for this setting.
  arXiv  Detail & Related papers  (2020-01-29T23:29:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.