D-CDLF: Decomposition of Common and Distinctive Latent Factors for Multi-view High-dimensional Data

• URL: http://arxiv.org/abs/2407.00730v2
• Date: Thu, 1 Aug 2024 21:39:05 GMT
• Title: D-CDLF: Decomposition of Common and Distinctive Latent Factors for Multi-view High-dimensional Data
• Authors: Hai Shu,
• Abstract summary: A typical approach to the joint analysis of multiple high-dimensional data views is to decompose each view's data matrix into three parts. We propose a novel decomposition method, called Decomposition of Common and Distinctive Latent Factors (D-CDLF), to effectively achieve both types of uncorrelatedness for two-view data.
• Score: 2.2481284426718533
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A typical approach to the joint analysis of multiple high-dimensional data views is to decompose each view's data matrix into three parts: a low-rank common-source matrix generated by common latent factors of all data views, a low-rank distinctive-source matrix generated by distinctive latent factors of the corresponding data view, and an additive noise matrix. Existing decomposition methods often focus on the uncorrelatedness between the common latent factors and distinctive latent factors, but inadequately address the equally necessary uncorrelatedness between distinctive latent factors from different data views. We propose a novel decomposition method, called Decomposition of Common and Distinctive Latent Factors (D-CDLF), to effectively achieve both types of uncorrelatedness for two-view data. We also discuss the estimation of the D-CDLF under high-dimensional settings.

Related papers

• DiHuR: Diffusion-Guided Generalizable Human Reconstruction [51.31232435994026]
  We introduce DiHuR, a Diffusion-guided model for generalizable Human 3D Reconstruction and view synthesis from sparse, minimally overlapping images. Our method integrates two key priors in a coherent manner: the prior from generalizable feed-forward models and the 2D diffusion prior, and it requires only multi-view image training, without 3D supervision.
  arXiv  Detail & Related papers  (2024-11-16T03:52:23Z)
• Learning Divergence Fields for Shift-Robust Graph Representations [73.11818515795761]
  In this work, we propose a geometric diffusion model with learnable divergence fields for the challenging problem with interdependent data. We derive a new learning objective through causal inference, which can guide the model to learn generalizable patterns of interdependence that are insensitive across domains.
  arXiv  Detail & Related papers  (2024-06-07T14:29:21Z)
• ARC: A Generalist Graph Anomaly Detector with In-Context Learning [62.202323209244]
  ARC is a generalist GAD approach that enables a one-for-all'' GAD model to detect anomalies across various graph datasets on-the-fly. equipped with in-context learning, ARC can directly extract dataset-specific patterns from the target dataset. Extensive experiments on multiple benchmark datasets from various domains demonstrate the superior anomaly detection performance, efficiency, and generalizability of ARC.
  arXiv  Detail & Related papers  (2024-05-27T02:42:33Z)
• Multi-View Independent Component Analysis with Shared and Individual Sources [0.0]
  Independent component analysis (ICA) is a blind source separation method for linear disentanglement of independent latent sources from observed data. We prove that the corresponding linear structure is identifiable, and the shared sources can be recovered, provided that sufficiently many diverse views and data points are available. We show empirically that our objective recovers the sources in high dimensional settings, also in the case when the measurements are corrupted by noise.
  arXiv  Detail & Related papers  (2022-10-05T08:23:05Z)
• CCP: Correlated Clustering and Projection for Dimensionality Reduction [5.992724190105578]
  Correlated Clustering and Projection offers a novel data domain strategy that does not need to solve any matrix. CCP partitions high-dimensional features into correlated clusters and then projects correlated features in each cluster into a one-dimensional representation. Proposed methods are validated with benchmark datasets associated with various machine learning algorithms.
  arXiv  Detail & Related papers  (2022-06-08T23:14:44Z)
• GMC -- Geometric Multimodal Contrastive Representation Learning [26.437843775786856]
  We present a novel representation learning method comprised of two main components. We experimentally demonstrate that GMC representations are semantically rich and achieve state-of-the-art performance.
  arXiv  Detail & Related papers  (2022-02-07T18:26:32Z)
• Multi-way Clustering and Discordance Analysis through Deep Collective Matrix Tri-Factorization [9.283501363468728]
  We advance the state-of-the-art in neural unsupervised learning to analyze Heterogeneous multi-typed, multimodal relational data. We design the first neural method for collective matrix tri-factorization of arbitrary collections of matrices to perform spectral clustering of all constituent entities and learn cluster associations. We illustrate its utility in quality assessment of knowledge bases and in improving representation learning.
  arXiv  Detail & Related papers  (2021-09-27T16:24:23Z)
• Rethinking Content and Style: Exploring Bias for Unsupervised Disentanglement [59.033559925639075]
  We propose a formulation for unsupervised C-S disentanglement based on our assumption that different factors are of different importance and popularity for image reconstruction. The corresponding model inductive bias is introduced by our proposed C-S disentanglement Module (C-S DisMo) Experiments on several popular datasets demonstrate that our method achieves the state-of-the-art unsupervised C-S disentanglement.
  arXiv  Detail & Related papers  (2021-02-21T08:04:33Z)
• Accounting for Unobserved Confounding in Domain Generalization [107.0464488046289]
  This paper investigates the problem of learning robust, generalizable prediction models from a combination of datasets. Part of the challenge of learning robust models lies in the influence of unobserved confounders. We demonstrate the empirical performance of our approach on healthcare data from different modalities.
  arXiv  Detail & Related papers  (2020-07-21T08:18:06Z)
• Bayesian Sparse Factor Analysis with Kernelized Observations [67.60224656603823]
  Multi-view problems can be faced with latent variable models. High-dimensionality and non-linear issues are traditionally handled by kernel methods. We propose merging both approaches into single model.
  arXiv  Detail & Related papers  (2020-06-01T14:25:38Z)
• D-GCCA: Decomposition-based Generalized Canonical Correlation Analysis for Multi-view High-dimensional Data [11.184915338554422]
  A popular model in high-dimensional multi-view data analysis decomposes each view's data matrix into a low-rank common-source matrix generated by latent factors common across all data views. We propose a novel decomposition method for this model, called decomposition-based generalized canonical correlation analysis (D-GCCA) Our D-GCCA takes one step further than generalized canonical correlation analysis by separating common and distinctive components among canonical variables.
  arXiv  Detail & Related papers  (2020-01-09T06:35:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.