Variational Inference for Deep Probabilistic Canonical Correlation Analysis

• URL: http://arxiv.org/abs/2003.04292v1
• Date: Mon, 9 Mar 2020 17:51:15 GMT
• Title: Variational Inference for Deep Probabilistic Canonical Correlation Analysis
• Authors: Mahdi Karami, Dale Schuurmans
• Abstract summary: We propose a deep probabilistic multi-view model that is composed of a linear multi-view layer and deep generative networks as observation models. An efficient variational inference procedure is developed that approximates the posterior distributions of the latent probabilistic multi-view layer. A generalization to models with arbitrary number of views is also proposed.
• Score: 49.36636239154184
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we propose a deep probabilistic multi-view model that is composed of a linear multi-view layer based on probabilistic canonical correlation analysis (CCA) description in the latent space together with deep generative networks as observation models. The network is designed to decompose the variations of all views into a shared latent representation and a set of view-specific components where the shared latent representation is intended to describe the common underlying sources of variation among the views. An efficient variational inference procedure is developed that approximates the posterior distributions of the latent probabilistic multi-view layer while taking into account the solution of probabilistic CCA. A generalization to models with arbitrary number of views is also proposed. The empirical studies confirm that the proposed deep generative multi-view model can successfully extend deep variational inference to multi-view learning while it efficiently integrates the relationship between multiple views to alleviate the difficulty of learning.

Related papers

• Revealing Multimodal Contrastive Representation Learning through Latent Partial Causal Models [85.67870425656368]
  We introduce a unified causal model specifically designed for multimodal data. We show that multimodal contrastive representation learning excels at identifying latent coupled variables. Experiments demonstrate the robustness of our findings, even when the assumptions are violated.
  arXiv  Detail & Related papers  (2024-02-09T07:18:06Z)
• Trusted Multi-View Classification with Dynamic Evidential Fusion [73.35990456162745]
  We propose a novel multi-view classification algorithm, termed trusted multi-view classification (TMC) TMC provides a new paradigm for multi-view learning by dynamically integrating different views at an evidence level. Both theoretical and experimental results validate the effectiveness of the proposed model in accuracy, robustness and trustworthiness.
  arXiv  Detail & Related papers  (2022-04-25T03:48:49Z)
• Variational Interpretable Learning from Multi-view Data [2.687817337319978]
  DICCA is designed to disentangle both the shared and view-specific variations for multi-view data. Empirical results on real-world datasets show that our methods are competitive across domains.
  arXiv  Detail & Related papers  (2022-02-28T01:56:44Z)
• Trusted Multi-View Classification [76.73585034192894]
  We propose a novel multi-view classification method, termed trusted multi-view classification. It provides a new paradigm for multi-view learning by dynamically integrating different views at an evidence level. The proposed algorithm jointly utilizes multiple views to promote both classification reliability and robustness.
  arXiv  Detail & Related papers  (2021-02-03T13:30:26Z)
• Deep Partial Multi-View Learning [94.39367390062831]
  We propose a novel framework termed Cross Partial Multi-View Networks (CPM-Nets) We fifirst provide a formal defifinition of completeness and versatility for multi-view representation. We then theoretically prove the versatility of the learned latent representations.
  arXiv  Detail & Related papers  (2020-11-12T02:29:29Z)
• Orthogonal Multi-view Analysis by Successive Approximations via Eigenvectors [7.870955752916424]
  The framework integrates the correlations within multiple views, supervised discriminant capacity, and distance preservation. It not only includes several existing models as special cases, but also inspires new novel models. Experiments are conducted on various real-world datasets for multi-view discriminant analysis and multi-view multi-label classification.
  arXiv  Detail & Related papers  (2020-10-04T17:16:15Z)
• Multi-view Alignment and Generation in CCA via Consistent Latent Encoding [34.57297855115903]
  Multi-view alignment is critical in many real-world multi-view applications. This paper studies multi-view alignment from the Bayesian perspective. We present Adversarial CCA (ACCA) which achieves consistent latent encodings.
  arXiv  Detail & Related papers  (2020-05-24T10:50:15Z)
• Agglomerative Neural Networks for Multi-view Clustering [109.55325971050154]
  We propose the agglomerative analysis to approximate the optimal consensus view. We present Agglomerative Neural Network (ANN) based on Constrained Laplacian Rank to cluster multi-view data directly. Our evaluations against several state-of-the-art multi-view clustering approaches on four popular datasets show the promising view-consensus analysis ability of ANN.
  arXiv  Detail & Related papers  (2020-05-12T05:39:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.