Trusted Multi-View Classification
- URL: http://arxiv.org/abs/2102.02051v1
- Date: Wed, 3 Feb 2021 13:30:26 GMT
- Title: Trusted Multi-View Classification
- Authors: Zongbo Han, Changqing Zhang, Huazhu Fu, Joey Tianyi Zhou
- Abstract summary: We propose a novel multi-view classification method, termed trusted multi-view classification.
It provides a new paradigm for multi-view learning by dynamically integrating different views at an evidence level.
The proposed algorithm jointly utilizes multiple views to promote both classification reliability and robustness.
- Score: 76.73585034192894
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Multi-view classification (MVC) generally focuses on improving classification
accuracy by using information from different views, typically integrating them
into a unified comprehensive representation for downstream tasks. However, it
is also crucial to dynamically assess the quality of a view for different
samples in order to provide reliable uncertainty estimations, which indicate
whether predictions can be trusted. To this end, we propose a novel multi-view
classification method, termed trusted multi-view classification, which provides
a new paradigm for multi-view learning by dynamically integrating different
views at an evidence level. The algorithm jointly utilizes multiple views to
promote both classification reliability and robustness by integrating evidence
from each view. To achieve this, the Dirichlet distribution is used to model
the distribution of the class probabilities, parameterized with evidence from
different views and integrated with the Dempster-Shafer theory. The unified
learning framework induces accurate uncertainty and accordingly endows the
model with both reliability and robustness for out-of-distribution samples.
Extensive experimental results validate the effectiveness of the proposed model
in accuracy, reliability and robustness.
Related papers
- Dynamic Evidence Decoupling for Trusted Multi-view Learning [17.029245880233816]
We propose a Consistent and Complementary-aware trusted Multi-view Learning (CCML) method to solve this problem.
We first construct view opinions using evidential deep neural networks, which consist of belief mass vectors and uncertainty estimates.
The results validate the effectiveness of the dynamic evidence decoupling strategy and show that CCML significantly outperforms baselines on accuracy and reliability.
arXiv Detail & Related papers (2024-10-04T03:27:51Z) - Confidence-aware multi-modality learning for eye disease screening [58.861421804458395]
We propose a novel multi-modality evidential fusion pipeline for eye disease screening.
It provides a measure of confidence for each modality and elegantly integrates the multi-modality information.
Experimental results on both public and internal datasets demonstrate that our model excels in robustness.
arXiv Detail & Related papers (2024-05-28T13:27:30Z) - DealMVC: Dual Contrastive Calibration for Multi-view Clustering [78.54355167448614]
We propose a novel Dual contrastive calibration network for Multi-View Clustering (DealMVC)
We first design a fusion mechanism to obtain a global cross-view feature. Then, a global contrastive calibration loss is proposed by aligning the view feature similarity graph and the high-confidence pseudo-label graph.
During the training procedure, the interacted cross-view feature is jointly optimized at both local and global levels.
arXiv Detail & Related papers (2023-08-17T14:14:28Z) - ELFNet: Evidential Local-global Fusion for Stereo Matching [17.675146012208124]
We introduce the textbfEvidential textbfLocal-global textbfFusion (ELF) framework for stereo matching.
It endows both uncertainty estimation and confidence-aware fusion with trustworthy heads.
arXiv Detail & Related papers (2023-08-01T15:51:04Z) - Deep Incomplete Multi-view Clustering with Cross-view Partial Sample and
Prototype Alignment [50.82982601256481]
We propose a Cross-view Partial Sample and Prototype Alignment Network (CPSPAN) for Deep Incomplete Multi-view Clustering.
Unlike existing contrastive-based methods, we adopt pair-observed data alignment as 'proxy supervised signals' to guide instance-to-instance correspondence construction.
arXiv Detail & Related papers (2023-03-28T02:31:57Z) - Uncertainty Estimation for Multi-view Data: The Power of Seeing the
Whole Picture [5.868139834982011]
Uncertainty estimation is essential to make neural networks trustworthy in real-world applications.
We propose a new multi-view classification framework for better uncertainty estimation and out-of-domain sample detection.
arXiv Detail & Related papers (2022-10-06T04:47:51Z) - Trusted Multi-View Classification with Dynamic Evidential Fusion [73.35990456162745]
We propose a novel multi-view classification algorithm, termed trusted multi-view classification (TMC)
TMC provides a new paradigm for multi-view learning by dynamically integrating different views at an evidence level.
Both theoretical and experimental results validate the effectiveness of the proposed model in accuracy, robustness and trustworthiness.
arXiv Detail & Related papers (2022-04-25T03:48:49Z) - Variational Inference for Deep Probabilistic Canonical Correlation
Analysis [49.36636239154184]
We propose a deep probabilistic multi-view model that is composed of a linear multi-view layer and deep generative networks as observation models.
An efficient variational inference procedure is developed that approximates the posterior distributions of the latent probabilistic multi-view layer.
A generalization to models with arbitrary number of views is also proposed.
arXiv Detail & Related papers (2020-03-09T17:51:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.