Hierarchical Consensus Network for Multiview Feature Learning

• URL: http://arxiv.org/abs/2502.01961v1
• Date: Tue, 04 Feb 2025 03:19:28 GMT
• Title: Hierarchical Consensus Network for Multiview Feature Learning
• Authors: Chengwei Xia, Chaoxi Niu, Kun Zhan,
• Abstract summary: Motivated by the theories of CCA and contrastive learning, we propose the hierarchical consensus network (HCN) in this paper.<n>The proposed method significantly outperforms several state-of-the-art methods.
• Score: 1.33134751838052
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multiview feature learning aims to learn discriminative features by integrating the distinct information in each view. However, most existing methods still face significant challenges in learning view-consistency features, which are crucial for effective multiview learning. Motivated by the theories of CCA and contrastive learning in multiview feature learning, we propose the hierarchical consensus network (HCN) in this paper. The HCN derives three consensus indices for capturing the hierarchical consensus across views, which are classifying consensus, coding consensus, and global consensus, respectively. Specifically, classifying consensus reinforces class-level correspondence between views from a CCA perspective, while coding consensus closely resembles contrastive learning and reflects contrastive comparison of individual instances. Global consensus aims to extract consensus information from two perspectives simultaneously. By enforcing the hierarchical consensus, the information within each view is better integrated to obtain more comprehensive and discriminative features. The extensive experimental results obtained on four multiview datasets demonstrate that the proposed method significantly outperforms several state-of-the-art methods.

Related papers

• Dual Consistent Constraint via Disentangled Consistency and Complementarity for Multi-view Clustering [5.52726833446215]
  Multi-view clustering can explore common semantics from multiple views. Current methods focus on learning consistency in representation, neglecting the contribution of each view's complementarity. This paper proposes a novel multi-view clustering framework that separates multi-view into shared and private information.
  arXiv  Detail & Related papers  (2025-04-07T02:00:16Z)
• Towards the Generalization of Multi-view Learning: An Information-theoretical Analysis [28.009990407017618]
  We develop information-theoretic generalization bounds for multi-view learning.<n>We derive novel data-dependent bounds under both leave-one-out and supersample settings.<n>In the interpolating regime, we further establish the fast-rate bound for multi-view learning.
  arXiv  Detail & Related papers  (2025-01-28T07:47:19Z)
• Incomplete Multi-view Multi-label Classification via a Dual-level Contrastive Learning Framework [1.224954637705144]
  In this paper, we propose our dual-level contrastive learning framework to solve the issue of double missing multi-view multi-label classification.<n>Experiments on several widely used benchmark datasets demonstrate that the proposed method has more stable and superior classification performance.
  arXiv  Detail & Related papers  (2024-11-27T12:04:04Z)
• Enhancing Graph Contrastive Learning with Reliable and Informative Augmentation for Recommendation [84.45144851024257]
  We propose a novel framework that aims to enhance graph contrastive learning by constructing contrastive views with stronger collaborative information via discrete codes. The core idea is to map users and items into discrete codes rich in collaborative information for reliable and informative contrastive view generation.
  arXiv  Detail & Related papers  (2024-09-09T14:04:17Z)
• TCGF: A unified tensorized consensus graph framework for multi-view representation learning [27.23929515170454]
  This paper proposes a universal multi-view representation learning framework named Consensus Graph Framework (TCGF) It first provides a unified framework for existing multi-view works to exploit the representations for individual view. Then, stacks them into a tensor under alignment basics as a high-order representation, allowing for the smooth propagation of consistency.
  arXiv  Detail & Related papers  (2023-09-14T19:29:14Z)
• Cross-view Graph Contrastive Representation Learning on Partially Aligned Multi-view Data [52.491074276133325]
  Multi-view representation learning has developed rapidly over the past decades and has been applied in many fields. We propose a new cross-view graph contrastive learning framework, which integrates multi-view information to align data and learn latent representations. Experiments conducted on several real datasets demonstrate the effectiveness of the proposed method on the clustering and classification tasks.
  arXiv  Detail & Related papers  (2022-11-08T09:19:32Z)
• Modeling Multiple Views via Implicitly Preserving Global Consistency and Local Complementarity [61.05259660910437]
  We propose a global consistency and complementarity network (CoCoNet) to learn representations from multiple views. On the global stage, we reckon that the crucial knowledge is implicitly shared among views, and enhancing the encoder to capture such knowledge can improve the discriminability of the learned representations. Lastly on the local stage, we propose a complementarity-factor, which joints cross-view discriminative knowledge, and it guides the encoders to learn not only view-wise discriminability but also cross-view complementary information.
  arXiv  Detail & Related papers  (2022-09-16T09:24:00Z)
• Dual Representation Learning for One-Step Clustering of Multi-View Data [30.131568561100817]
  We propose a novel one-step multi-view clustering method by exploiting the dual representation of both the common and specific information of different views. With this framework, the representation learning and clustering partition mutually benefit each other, which effectively improve the clustering performance.
  arXiv  Detail & Related papers  (2022-08-30T14:20:26Z)
• Deep Partial Multi-View Learning [94.39367390062831]
  We propose a novel framework termed Cross Partial Multi-View Networks (CPM-Nets) We fifirst provide a formal defifinition of completeness and versatility for multi-view representation. We then theoretically prove the versatility of the learned latent representations.
  arXiv  Detail & Related papers  (2020-11-12T02:29:29Z)
• Agglomerative Neural Networks for Multi-view Clustering [109.55325971050154]
  We propose the agglomerative analysis to approximate the optimal consensus view. We present Agglomerative Neural Network (ANN) based on Constrained Laplacian Rank to cluster multi-view data directly. Our evaluations against several state-of-the-art multi-view clustering approaches on four popular datasets show the promising view-consensus analysis ability of ANN.
  arXiv  Detail & Related papers  (2020-05-12T05:39:10Z)
• Generative Partial Multi-View Clustering [133.36721417531734]
  We propose a generative partial multi-view clustering model, named as GP-MVC, to address the incomplete multi-view problem. First, multi-view encoder networks are trained to learn common low-dimensional representations, followed by a clustering layer to capture the consistent cluster structure across multiple views. Second, view-specific generative adversarial networks are developed to generate the missing data of one view conditioning on the shared representation given by other views.
  arXiv  Detail & Related papers  (2020-03-29T17:48:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.