Pixel-Superpixel Contrastive Learning and Pseudo-Label Correction for Hyperspectral Image Clustering

• URL: http://arxiv.org/abs/2312.09630v1
• Date: Fri, 15 Dec 2023 09:19:00 GMT
• Title: Pixel-Superpixel Contrastive Learning and Pseudo-Label Correction for Hyperspectral Image Clustering
• Authors: Renxiang Guan and Zihao Li and Xianju Li and Chang Tang
• Abstract summary: Contrastive learning methods excel at existing pixel level and super pixel level HSI clustering tasks. The super pixel-level contrastive learning method utilizes the homogeneity of HSI and reduces computing resources. This paper proposes a pseudo-label correction module that aligns the clustering pseudo-labels of pixels and super-pixels.
• Score: 15.366312862496226
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Hyperspectral image (HSI) clustering is gaining considerable attention owing to recent methods that overcome the inefficiency and misleading results from the absence of supervised information. Contrastive learning methods excel at existing pixel level and super pixel level HSI clustering tasks. The pixel-level contrastive learning method can effectively improve the ability of the model to capture fine features of HSI but requires a large time overhead. The super pixel-level contrastive learning method utilizes the homogeneity of HSI and reduces computing resources; however, it yields rough classification results. To exploit the strengths of both methods, we present a pixel super pixel contrastive learning and pseudo-label correction (PSCPC) method for the HSI clustering. PSCPC can reasonably capture domain-specific and fine-grained features through super pixels and the comparative learning of a small number of pixels within the super pixels. To improve the clustering performance of super pixels, this paper proposes a pseudo-label correction module that aligns the clustering pseudo-labels of pixels and super-pixels. In addition, pixel-level clustering results are used to supervise super pixel-level clustering, improving the generalization ability of the model. Extensive experiments demonstrate the effectiveness and efficiency of PSCPC.

Related papers

• Graph-Weighted Contrastive Learning for Semi-Supervised Hyperspectral Image Classification [9.640130509216629]
  We propose a graph-weighted contrastive learning approach that avoids the use of superpixel partitioning and directly employs neural networks to learn hyperspectral image representation. Our approach supports mini-batch training by processing only a subset of nodes at a time, reducing computational complexity and improving generalization to unseen nodes.
  arXiv  Detail & Related papers  (2025-03-19T22:55:52Z)
• A consensus-constrained parsimonious Gaussian mixture model for clustering hyperspectral images [0.0]
  Food engineers use hyperspectral images to classify the type and quality of a food sample. In order to train these methods, every pixel in each training image needs to be labelled. A consensus-constrained parsimonious Gaussian mixture model (ccPGMM) is proposed to label pixels in hyperspectral images.
  arXiv  Detail & Related papers  (2024-03-05T22:23:43Z)
• Superpixel Graph Contrastive Clustering with Semantic-Invariant Augmentations for Hyperspectral Images [64.72242126879503]
  Hyperspectral images (HSI) clustering is an important but challenging task. We first use 3-D and 2-D hybrid convolutional neural networks to extract the high-order spatial and spectral features of HSI. We then design a superpixel graph contrastive clustering model to learn discriminative superpixel representations.
  arXiv  Detail & Related papers  (2024-03-04T07:40:55Z)
• Superpixel-based and Spatially-regularized Diffusion Learning for Unsupervised Hyperspectral Image Clustering [4.643572021927615]
  This paper introduces a novel unsupervised HSI clustering algorithm, Superpixel-based and Spatially-regularized Diffusion Learning (S2DL) S2DL incorporates rich spatial information encoded in HSIs into diffusion geometry-based clustering. S2DL's performance is illustrated with extensive experiments on three publicly available, real-world HSIs.
  arXiv  Detail & Related papers  (2023-12-24T09:54:40Z)
• Pixel-Inconsistency Modeling for Image Manipulation Localization [59.968362815126326]
  Digital image forensics plays a crucial role in image authentication and manipulation localization. This paper presents a generalized and robust manipulation localization model through the analysis of pixel inconsistency artifacts. Experiments show that our method successfully extracts inherent pixel-inconsistency forgery fingerprints.
  arXiv  Detail & Related papers  (2023-09-30T02:54:51Z)
• Probabilistic Deep Metric Learning for Hyperspectral Image Classification [91.5747859691553]
  This paper proposes a probabilistic deep metric learning framework for hyperspectral image classification. It aims to predict the category of each pixel for an image captured by hyperspectral sensors. Our framework can be readily applied to existing hyperspectral image classification methods.
  arXiv  Detail & Related papers  (2022-11-15T17:57:12Z)
• Information-guided pixel augmentation for pixel-wise contrastive learning [22.00687816406677]
  pixel-wise contrastive learning helps with pixel-wise tasks such as medical landmark detection. We propose a pixel augmentation method with a pixel granularity for enhancing unsupervised pixel-wise contrastive learning.
  arXiv  Detail & Related papers  (2022-11-14T05:12:23Z)
• Superpixel-guided Discriminative Low-rank Representation of Hyperspectral Images for Classification [49.32130776974202]
  SP-DLRR is composed of two modules, i.e., the classification-guided superpixel segmentation and the discriminative low-rank representation. Experimental results on three benchmark datasets demonstrate the significant superiority of SP-DLRR over state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-08-25T10:47:26Z)
• Mixed Supervision Learning for Whole Slide Image Classification [88.31842052998319]
  We propose a mixed supervision learning framework for super high-resolution images. During the patch training stage, this framework can make use of coarse image-level labels to refine self-supervised learning. A comprehensive strategy is proposed to suppress pixel-level false positives and false negatives.
  arXiv  Detail & Related papers  (2021-07-02T09:46:06Z)
• Superpixel Segmentation Based on Spatially Constrained Subspace Clustering [57.76302397774641]
  We consider each representative region with independent semantic information as a subspace, and formulate superpixel segmentation as a subspace clustering problem. We show that a simple integration of superpixel segmentation with the conventional subspace clustering does not effectively work due to the spatial correlation of the pixels. We propose a novel convex locality-constrained subspace clustering model that is able to constrain the spatial adjacent pixels with similar attributes to be clustered into a superpixel.
  arXiv  Detail & Related papers  (2020-12-11T06:18:36Z)
• Texture Superpixel Clustering from Patch-based Nearest Neighbor Matching [2.84279467589473]
  We propose a new Nearest Neighbor-based Superpixel Clustering (NNSC) method to generate texture-aware superpixels in a limited computational time.
  arXiv  Detail & Related papers  (2020-03-09T21:11:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.