Uncorrelated Semi-paired Subspace Learning
- URL: http://arxiv.org/abs/2011.11124v1
- Date: Sun, 22 Nov 2020 22:14:20 GMT
- Title: Uncorrelated Semi-paired Subspace Learning
- Authors: Li Wang, Lei-Hong Zhang, Chungen Shen, and Ren-Cang Li
- Abstract summary: We propose a generalized uncorrelated multi-view subspace learning framework.
To showcase the flexibility of the framework, we instantiate five new semi-paired models for both unsupervised and semi-supervised learning.
Our proposed models perform competitively to or better than the baselines.
- Score: 7.20500993803316
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Multi-view datasets are increasingly collected in many real-world
applications, and we have seen better learning performance by existing
multi-view learning methods than by conventional single-view learning methods
applied to each view individually. But, most of these multi-view learning
methods are built on the assumption that at each instance no view is missing
and all data points from all views must be perfectly paired. Hence they cannot
handle unpaired data but ignore them completely from their learning process.
However, unpaired data can be more abundant in reality than paired ones and
simply ignoring all unpaired data incur tremendous waste in resources. In this
paper, we focus on learning uncorrelated features by semi-paired subspace
learning, motivated by many existing works that show great successes of
learning uncorrelated features. Specifically, we propose a generalized
uncorrelated multi-view subspace learning framework, which can naturally
integrate many proven learning criteria on the semi-paired data. To showcase
the flexibility of the framework, we instantiate five new semi-paired models
for both unsupervised and semi-supervised learning. We also design a successive
alternating approximation (SAA) method to solve the resulting optimization
problem and the method can be combined with the powerful Krylov subspace
projection technique if needed. Extensive experimental results on multi-view
feature extraction and multi-modality classification show that our proposed
models perform competitively to or better than the baselines.
Related papers
- Partial Multi-View Clustering via Meta-Learning and Contrastive Feature Alignment [13.511433241138702]
Partial multi-view clustering (PVC) presents significant challenges practical research problem for data analysis in real-world applications.
Existing clustering methods struggle to handle incomplete views effectively, leading to suboptimal clustering performance.
We propose a novel dual optimization framework based on contrastive learning, which aims to maximize the consistency of latent features in incomplete multi-view data.
arXiv Detail & Related papers (2024-11-14T19:16:01Z) - Incomplete Contrastive Multi-View Clustering with High-Confidence
Guiding [7.305817202715752]
We propose a novel Incomplete Contrastive Multi-View Clustering method with high-confidence guiding (ICMVC)
Firstly, we proposed a multi-view consistency relation transfer plus graph convolutional network to tackle missing values problem.
Secondly, instance-level attention fusion and high-confidence guiding are proposed to exploit the complementary information.
arXiv Detail & Related papers (2023-12-14T07:28:41Z) - Multi-View Class Incremental Learning [57.14644913531313]
Multi-view learning (MVL) has gained great success in integrating information from multiple perspectives of a dataset to improve downstream task performance.
This paper investigates a novel paradigm called multi-view class incremental learning (MVCIL), where a single model incrementally classifies new classes from a continual stream of views.
arXiv Detail & Related papers (2023-06-16T08:13:41Z) - Reliable Representations Learning for Incomplete Multi-View Partial Multi-Label Classification [78.15629210659516]
In this paper, we propose an incomplete multi-view partial multi-label classification network named RANK.
We break through the view-level weights inherent in existing methods and propose a quality-aware sub-network to dynamically assign quality scores to each view of each sample.
Our model is not only able to handle complete multi-view multi-label datasets, but also works on datasets with missing instances and labels.
arXiv Detail & Related papers (2023-03-30T03:09:25Z) - Cross-view Graph Contrastive Representation Learning on Partially
Aligned Multi-view Data [52.491074276133325]
Multi-view representation learning has developed rapidly over the past decades and has been applied in many fields.
We propose a new cross-view graph contrastive learning framework, which integrates multi-view information to align data and learn latent representations.
Experiments conducted on several real datasets demonstrate the effectiveness of the proposed method on the clustering and classification tasks.
arXiv Detail & Related papers (2022-11-08T09:19:32Z) - Latent Heterogeneous Graph Network for Incomplete Multi-View Learning [57.49776938934186]
We propose a novel Latent Heterogeneous Graph Network (LHGN) for incomplete multi-view learning.
By learning a unified latent representation, a trade-off between consistency and complementarity among different views is implicitly realized.
To avoid any inconsistencies between training and test phase, a transductive learning technique is applied based on graph learning for classification tasks.
arXiv Detail & Related papers (2022-08-29T15:14:21Z) - TSK Fuzzy System Towards Few Labeled Incomplete Multi-View Data
Classification [24.01191516774655]
A transductive semi-supervised incomplete multi-view TSK fuzzy system modeling method (SSIMV_TSK) is proposed to address these challenges.
The proposed method integrates missing view imputation, pseudo label learning of unlabeled data, and fuzzy system modeling into a single process to yield a model with interpretable fuzzy rules.
Experimental results on real datasets show that the proposed method significantly outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2021-10-08T11:41:06Z) - Error-Robust Multi-View Clustering: Progress, Challenges and
Opportunities [67.54503077766171]
Since label information is often expensive to acquire, multi-view clustering has gained growing interest.
Error-robust multi-view clustering approaches with explicit error removal formulation can be structured into five broad research categories.
This survey summarizes and reviews recent advances in error-robust clustering for multi-view data.
arXiv Detail & Related papers (2021-05-07T04:03:02Z) - Multimodal Clustering Networks for Self-supervised Learning from
Unlabeled Videos [69.61522804742427]
This paper proposes a self-supervised training framework that learns a common multimodal embedding space.
We extend the concept of instance-level contrastive learning with a multimodal clustering step to capture semantic similarities across modalities.
The resulting embedding space enables retrieval of samples across all modalities, even from unseen datasets and different domains.
arXiv Detail & Related papers (2021-04-26T15:55:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.