Nonparametric Factor Analysis and Beyond

• URL: http://arxiv.org/abs/2503.16865v1
• Date: Fri, 21 Mar 2025 05:45:03 GMT
• Title: Nonparametric Factor Analysis and Beyond
• Authors: Yujia Zheng, Yang Liu, Jiaxiong Yao, Yingyao Hu, Kun Zhang,
• Abstract summary: We propose a general framework for identifying latent variables in the non-negligible settings.<n>We show that the generative model is identifiable up to certain submanifold indeterminacies even in the presence of non-negligible noise.<n>We have also developed corresponding estimation methods and validated them in various synthetic and real-world settings.
• Score: 14.232694150264628
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Nearly all identifiability results in unsupervised representation learning inspired by, e.g., independent component analysis, factor analysis, and causal representation learning, rely on assumptions of additive independent noise or noiseless regimes. In contrast, we study the more general case where noise can take arbitrary forms, depend on latent variables, and be non-invertibly entangled within a nonlinear function. We propose a general framework for identifying latent variables in the nonparametric noisy settings. We first show that, under suitable conditions, the generative model is identifiable up to certain submanifold indeterminacies even in the presence of non-negligible noise. Furthermore, under the structural or distributional variability conditions, we prove that latent variables of the general nonlinear models are identifiable up to trivial indeterminacies. Based on the proposed theoretical framework, we have also developed corresponding estimation methods and validated them in various synthetic and real-world settings. Interestingly, our estimate of the true GDP growth from alternative measurements suggests more insightful information on the economies than official reports. We expect our framework to provide new insight into how both researchers and practitioners deal with latent variables in real-world scenarios.

Related papers

• Identifiable Multi-View Causal Discovery Without Non-Gaussianity [63.217175519436125]
  We propose a novel approach to linear causal discovery in the framework of multi-view Structural Equation Models (SEM)<n>We prove the identifiability of all the parameters of the model without any further assumptions on the structure of the SEM other than it being acyclic.<n>The proposed methodology is validated through simulations and application on real data, where it enables the estimation of causal graphs between brain regions.
  arXiv  Detail & Related papers  (2025-02-27T14:06:14Z)
• On the Parameter Identifiability of Partially Observed Linear Causal Models [23.08796869216895]
  We investigate whether the edge coefficients can be recovered given the causal structure and partially observed data.<n>We identify three types of indeterminacy for the parameters in partially observed linear causal models.<n>We propose a novel likelihood-based parameter estimation method that addresses the variance indeterminacy of latent variables in a specific way.
  arXiv  Detail & Related papers  (2024-07-24T03:43:55Z)
• Generalizing Nonlinear ICA Beyond Structural Sparsity [15.450470872782082]
  identifiability of nonlinear ICA is known to be impossible without additional assumptions. Recent advances have proposed conditions on the connective structure from sources to observed variables, known as Structural Sparsity. We show that even in cases with flexible grouping structures, appropriate identifiability results can be established.
  arXiv  Detail & Related papers  (2023-11-01T21:36:15Z)
• Assessing the overall and partial causal well-specification of nonlinear additive noise models [4.13592995550836]
  We aim to identify predictor variables for which we can infer the causal effect even in cases of such misspecifications. We propose an algorithm for finite sample data, discuss its properties, and illustrate its performance on simulated and real data.
  arXiv  Detail & Related papers  (2023-10-25T09:44:16Z)
• Identifiable Latent Polynomial Causal Models Through the Lens of Change [82.14087963690561]
  Causal representation learning aims to unveil latent high-level causal representations from observed low-level data.<n>One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as identifiability.
  arXiv  Detail & Related papers  (2023-10-24T07:46:10Z)
• Nonparametric Identifiability of Causal Representations from Unknown Interventions [63.1354734978244]
  We study causal representation learning, the task of inferring latent causal variables and their causal relations from mixtures of the variables. Our goal is to identify both the ground truth latents and their causal graph up to a set of ambiguities which we show to be irresolvable from interventional data.
  arXiv  Detail & Related papers  (2023-06-01T10:51:58Z)
• Learning Invariant Representations under General Interventions on the Response [2.725698729450241]
  We focus on linear structural causal models (SCMs) and introduce invariant matching property (IMP) We analyze the generalization errors of our method under both the discrete and continuous environment settings.
  arXiv  Detail & Related papers  (2022-08-22T03:09:17Z)
• Non-Linear Spectral Dimensionality Reduction Under Uncertainty [107.01839211235583]
  We propose a new dimensionality reduction framework, called NGEU, which leverages uncertainty information and directly extends several traditional approaches. We show that the proposed NGEU formulation exhibits a global closed-form solution, and we analyze, based on the Rademacher complexity, how the underlying uncertainties theoretically affect the generalization ability of the framework.
  arXiv  Detail & Related papers  (2022-02-09T19:01:33Z)
• Variational Causal Networks: Approximate Bayesian Inference over Causal Structures [132.74509389517203]
  We introduce a parametric variational family modelled by an autoregressive distribution over the space of discrete DAGs. In experiments, we demonstrate that the proposed variational posterior is able to provide a good approximation of the true posterior.
  arXiv  Detail & Related papers  (2021-06-14T17:52:49Z)
• Nonlinear ISA with Auxiliary Variables for Learning Speech Representations [51.9516685516144]
  We introduce a theoretical framework for nonlinear Independent Subspace Analysis (ISA) in the presence of auxiliary variables. We propose an algorithm that learns unsupervised speech representations whose subspaces are independent.
  arXiv  Detail & Related papers  (2020-07-25T14:53:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.