When Semantically Consistent Encoding Meets View-Label Heterogeneity Modeling: A Unified Framework for Incomplete Multi-View Multi-Label Learning

• URL: http://arxiv.org/abs/2609.07525v1
• Date: Mon, 07 Sep 2026 14:07:10 GMT
• Title: When Semantically Consistent Encoding Meets View-Label Heterogeneity Modeling: A Unified Framework for Incomplete Multi-View Multi-Label Learning
• Abstract summary: This paper presents V2L, a unified representation-decision framework for incomplete multi-view multi-label classification.<n>On the representation side, V2L constructs semantically consistent variational posteriors from incomplete views.<n>On the decision side, V2L introduces an active view-label relevance modeling strategy.
• Score: 35.935368500144975
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Incomplete multi-view multi-label learning requires not only robust semantic aggregation from partially observed views, but also label-aware exploitation of view-specific evidence. Existing approaches usually emphasize either shared representation learning or decision-level fusion. The former improves robustness against missing views, yet tends to compress label-discriminative view-specific cues into a single latent representation. The latter preserves individual view predictions, but often relies on fixed or globally learned fusion weights, ignoring that different labels of different instances may require different views. To address these limitations, this paper presents V2L, a unified representation-decision framework for incomplete multi-view multi-label classification. On the representation side, V2L constructs semantically consistent variational posteriors from incomplete views through a perturbation-aware encoding mechanism, which provides a stable shared semantic basis. On the decision side, V2L introduces an active view-label relevance modeling strategy that estimates instance-wise and label-wise view contributions, allowing each label prediction to adaptively select useful view-specific evidence. From the perspective of model architecture, these two important strategies are integrated into a unified framework through a hybrid fusion architecture, simultaneously meeting the requirements of cross-view semantic consistency and representational complementarity. Extensive experiments under both incomplete and complete settings show that V2L achieves leading performance on five benchmarks. Code is available at: https://github.com/justsmart/V2L.

Related papers

• Adapting Vision-Language Models from Iconic to Inclusive for Multi-Label Recognition Without Labels [14.373553090930612]
  Vision-language models (VLMs) enable zero-shot recognition without labeled data.<n>These models often prioritize the most iconic object and omit other contextual positives.<n>We propose an unsupervised framework that adapts VLMs from iconic recognition toward inclusive understanding.
  arXiv  Detail & Related papers  (2026-06-10T03:41:50Z)
• Towards Generalized Multi-Image Editing for Unified Multimodal Models [56.620038824933566]
  Unified Multimodal Models (UMMs) integrate multimodal understanding and generation.<n>UMMs are limited to maintaining visual consistency and disambiguating visual cues when referencing details across multiple input images.<n>We propose a scalable multi-image editing framework for UMMs that explicitly distinguishes image identities and generalizes to variable input counts.
  arXiv  Detail & Related papers  (2026-01-09T06:42:49Z)
• Wasserstein-Aligned Hyperbolic Multi-View Clustering [58.29261653100388]
  This paper proposes a novel Wasserstein-Aligned Hyperbolic (WAH) framework for multi-view clustering.<n>Our method exploits a view-specific hyperbolic encoder for each view to embed features into the Lorentz manifold for hierarchical semantic modeling.
  arXiv  Detail & Related papers  (2025-12-10T07:56:19Z)
• Imputation-free and Alignment-free: Incomplete Multi-view Clustering Driven by Consensus Semantic Learning [65.75756724642932]
  In incomplete multi-view clustering, missing data induce prototype shifts within views and semantic inconsistencies across views.<n>We propose an IMVC framework, imputation- and alignment-free for consensus semantics learning (FreeCSL)<n>FreeCSL achieves more confident and robust assignments on IMVC task, compared to state-of-the-art competitors.
  arXiv  Detail & Related papers  (2025-05-16T12:37:10Z)
• Semantic-Aligned Learning with Collaborative Refinement for Unsupervised VI-ReID [82.12123628480371]
  Unsupervised person re-identification (USL-VI-ReID) seeks to match pedestrian images of the same individual across different modalities without human annotations for model learning.<n>Previous methods unify pseudo-labels of cross-modality images through label association algorithms and then design contrastive learning framework for global feature learning.<n>We propose a Semantic-Aligned Learning with Collaborative Refinement (SALCR) framework, which builds up objective for specific fine-grained patterns emphasized by each modality.
  arXiv  Detail & Related papers  (2025-04-27T13:58:12Z)
• Multi-View Factorizing and Disentangling: A Novel Framework for Incomplete Multi-View Multi-Label Classification [9.905528765058541]
  We propose a novel framework for incomplete multi-view multi-label classification (iMvMLC)<n>Our method factorizes multi-view representations into two independent sets of factors: view-consistent and view-specific.<n>Our framework innovatively decomposes consistent representation learning into three key sub-objectives.
  arXiv  Detail & Related papers  (2025-01-11T12:19:20Z)
• Incomplete Multi-view Multi-label Classification via a Dual-level Contrastive Learning Framework [3.9108639455354592]
  In this paper, we propose our dual-level contrastive learning framework to solve the issue of double missing multi-view multi-label classification.<n>Experiments on several widely used benchmark datasets demonstrate that the proposed method has more stable and superior classification performance.
  arXiv  Detail & Related papers  (2024-11-27T12:04:04Z)
• M$^3$Net: Multi-view Encoding, Matching, and Fusion for Few-shot Fine-grained Action Recognition [80.21796574234287]
  M$3$Net is a matching-based framework for few-shot fine-grained (FS-FG) action recognition. It incorporates textitmulti-view encoding, textitmulti-view matching, and textitmulti-view fusion to facilitate embedding encoding, similarity matching, and decision making. Explainable visualizations and experimental results demonstrate the superiority of M$3$Net in capturing fine-grained action details.
  arXiv  Detail & Related papers  (2023-08-06T09:15:14Z)
• Reliable Representation Learning for Incomplete Multi-View Missing Multi-Label Classification [78.15629210659516]
  In this paper, we propose an incomplete multi-view missing multi-label classification network named RANK.<n>We break through the view-level weights inherent in existing methods and propose a quality-aware sub-network to dynamically assign quality scores to each view of each sample.<n>Our model is not only able to handle complete multi-view multi-label data, but also works on datasets with missing instances and labels.
  arXiv  Detail & Related papers  (2023-03-30T03:09:25Z)
• DICNet: Deep Instance-Level Contrastive Network for Double Incomplete Multi-View Multi-Label Classification [20.892833511657166]
  Multi-view multi-label data in the real world is commonly incomplete due to the uncertain factors of data collection and manual annotation. We propose a deep instance-level contrastive network, namely DICNet, to deal with the double incomplete multi-view multi-label classification problem. Our DICNet is adept in capturing consistent discriminative representations of multi-view multi-label data and avoiding the negative effects of missing views and missing labels.
  arXiv  Detail & Related papers  (2023-03-15T04:24:01Z)
• Incomplete Multi-View Multi-Label Learning via Label-Guided Masked View- and Category-Aware Transformers [19.720564730308993]
  We propose a general multi-view multi-label learning framework named label-guided masked view- and category-aware transformers. Considering the imbalance of expressive power among views, an adaptively weighted view fusion module is proposed to obtain view-consistent embedding features.
  arXiv  Detail & Related papers  (2023-03-13T15:22:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.