Multi-view MERA Subspace Clustering
- URL: http://arxiv.org/abs/2305.09095v1
- Date: Tue, 16 May 2023 01:41:10 GMT
- Title: Multi-view MERA Subspace Clustering
- Authors: Zhen Long, Ce Zhu, Jie Chen, Zihan Li, Yazhou Ren, Yipeng Liu
- Abstract summary: Multi-view subspace clustering (MSC) can capture high-order correlation in the self-representation tensor.
We propose a low-rank MERA based MSC (MERA-MSC) algorithm, where MERA factorizes a tensor into contractions of one top core factor and the rest orthogonal/semi-orthogonal factors.
We extend MERA-MSC by incorporating anchor learning to develop a scalable low-rank MERA based multi-view clustering method (sMREA-MVC)
- Score: 42.33688860165733
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Tensor-based multi-view subspace clustering (MSC) can capture high-order
correlation in the self-representation tensor. Current tensor decompositions
for MSC suffer from highly unbalanced unfolding matrices or rotation
sensitivity, failing to fully explore inter/intra-view information. Using the
advanced tensor network, namely, multi-scale entanglement renormalization
ansatz (MERA), we propose a low-rank MERA based MSC (MERA-MSC) algorithm, where
MERA factorizes a tensor into contractions of one top core factor and the rest
orthogonal/semi-orthogonal factors. Benefiting from multiple interactions among
orthogonal/semi-orthogonal (low-rank) factors, the low-rank MERA has a strong
representation power to capture the complex inter/intra-view information in the
self-representation tensor. The alternating direction method of multipliers is
adopted to solve the optimization model. Experimental results on five
multi-view datasets demonstrate MERA-MSC has superiority against the compared
algorithms on six evaluation metrics. Furthermore, we extend MERA-MSC by
incorporating anchor learning to develop a scalable low-rank MERA based
multi-view clustering method (sMREA-MVC). The effectiveness and efficiency of
sMERA-MVC have been validated on three large-scale multi-view datasets. To our
knowledge, this is the first work to introduce MERA to the multi-view
clustering topic. The codes of MERA-MSC and sMERA-MVC are publicly available at
https://github.com/longzhen520/MERA-MSC.
Related papers
- S^2MVTC: a Simple yet Efficient Scalable Multi-View Tensor Clustering [38.35594663863098]
Experimental results on six large-scale multi-view datasets demonstrate that S2MVTC significantly outperforms state-of-the-art algorithms in terms of clustering performance and CPU execution time.
arXiv Detail & Related papers (2024-03-14T05:00:29Z) - Efficient and Effective Deep Multi-view Subspace Clustering [9.6753782215283]
We propose a novel deep framework, termed Efficient and Effective deep Multi-View Subspace Clustering (E$2$MVSC)
Instead of a parameterized FC layer, we design a Relation-Metric Net that decouples network parameter scale from sample numbers for greater computational efficiency.
E$2$MVSC yields comparable results to existing methods and achieves state-of-the-art performance in various types of multi-view datasets.
arXiv Detail & Related papers (2023-10-15T03:08:25Z) - DealMVC: Dual Contrastive Calibration for Multi-view Clustering [78.54355167448614]
We propose a novel Dual contrastive calibration network for Multi-View Clustering (DealMVC)
We first design a fusion mechanism to obtain a global cross-view feature. Then, a global contrastive calibration loss is proposed by aligning the view feature similarity graph and the high-confidence pseudo-label graph.
During the training procedure, the interacted cross-view feature is jointly optimized at both local and global levels.
arXiv Detail & Related papers (2023-08-17T14:14:28Z) - Multi-View Clustering via Semi-non-negative Tensor Factorization [120.87318230985653]
We develop a novel multi-view clustering based on semi-non-negative tensor factorization (Semi-NTF)
Our model directly considers the between-view relationship and exploits the between-view complementary information.
In addition, we provide an optimization algorithm for the proposed method and prove mathematically that the algorithm always converges to the stationary KKT point.
arXiv Detail & Related papers (2023-03-29T14:54:19Z) - Tucker-O-Minus Decomposition for Multi-view Tensor Subspace Clustering [36.790637575875635]
We propose a new tensor decomposition called Tucker-O-Minus Decomposition (TOMD) for multi-view clustering.
Numerical experiments on six benchmark data sets demonstrate the superiority of our proposed method in terms of F-score, precision, recall, normalized mutual information, adjusted rand index, and accuracy.
arXiv Detail & Related papers (2022-10-23T07:20:22Z) - Adaptively-weighted Integral Space for Fast Multiview Clustering [54.177846260063966]
We propose an Adaptively-weighted Integral Space for Fast Multiview Clustering (AIMC) with nearly linear complexity.
Specifically, view generation models are designed to reconstruct the view observations from the latent integral space.
Experiments conducted on several realworld datasets confirm the superiority of the proposed AIMC method.
arXiv Detail & Related papers (2022-08-25T05:47:39Z) - Late Fusion Multi-view Clustering via Global and Local Alignment
Maximization [61.89218392703043]
Multi-view clustering (MVC) optimally integrates complementary information from different views to improve clustering performance.
Most of existing approaches directly fuse multiple pre-specified similarities to learn an optimal similarity matrix for clustering.
We propose late fusion MVC via alignment to address these issues.
arXiv Detail & Related papers (2022-08-02T01:49:31Z) - Tensor-based Intrinsic Subspace Representation Learning for Multi-view
Clustering [18.0093330816895]
We propose a novel-based Intrinsic Subspace Representation (TISRL) for multi-view clustering in this paper.
It can be seen that specific information contained in different views is fully investigated by the rank preserving decomposition.
Experimental results on nine common used real-world multi-view datasets illustrate the superiority of TISRL.
arXiv Detail & Related papers (2020-10-19T03:36:18Z) - Generative Partial Multi-View Clustering [133.36721417531734]
We propose a generative partial multi-view clustering model, named as GP-MVC, to address the incomplete multi-view problem.
First, multi-view encoder networks are trained to learn common low-dimensional representations, followed by a clustering layer to capture the consistent cluster structure across multiple views.
Second, view-specific generative adversarial networks are developed to generate the missing data of one view conditioning on the shared representation given by other views.
arXiv Detail & Related papers (2020-03-29T17:48:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.