Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation

• URL: http://arxiv.org/abs/2108.09025v1
• Date: Fri, 20 Aug 2021 07:04:33 GMT
• Title: Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation
• Authors: Yuanyi Zhong, Bodi Yuan, Hong Wu, Zhiqiang Yuan, Jian Peng, Yu-Xiong Wang
• Abstract summary: We present a novel semi-supervised semantic segmentation method which jointly achieves two desiderata of segmentation model regularities. We leverage the pixel-level L2 loss and the pixel contrastive loss for the two purposes respectively.
• Score: 22.920856071095915
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a novel semi-supervised semantic segmentation method which jointly achieves two desiderata of segmentation model regularities: the label-space consistency property between image augmentations and the feature-space contrastive property among different pixels. We leverage the pixel-level L2 loss and the pixel contrastive loss for the two purposes respectively. To address the computational efficiency issue and the false negative noise issue involved in the pixel contrastive loss, we further introduce and investigate several negative sampling techniques. Extensive experiments demonstrate the state-of-the-art performance of our method (PC2Seg) with the DeepLab-v3+ architecture, in several challenging semi-supervised settings derived from the VOC, Cityscapes, and COCO datasets.

Related papers

• Learning Invariant Inter-pixel Correlations for Superpixel Generation [12.605604620139497]
  Learnable features exhibit constrained discriminative capability, resulting in unsatisfactory pixel grouping performance. We propose the Content Disentangle Superpixel algorithm to selectively separate the invariant inter-pixel correlations and statistical properties. The experimental results on four benchmark datasets demonstrate the superiority of our approach to existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-02-28T09:46:56Z)
• Pixel-Level Clustering Network for Unsupervised Image Segmentation [3.69853388955692]
  We present a pixel-level clustering framework for segmenting images into regions without using ground truth annotations. We also propose a training strategy that utilizes intra-consistency within each superpixel, inter-similarity/dissimilarity between neighboring superpixels, and structural similarity between images.
  arXiv  Detail & Related papers  (2023-10-24T23:06:29Z)
• Pixel-Inconsistency Modeling for Image Manipulation Localization [63.54342601757723]
  Digital image forensics plays a crucial role in image authentication and manipulation localization. This paper presents a generalized and robust manipulation localization model through the analysis of pixel inconsistency artifacts. Experiments show that our method successfully extracts inherent pixel-inconsistency forgery fingerprints.
  arXiv  Detail & Related papers  (2023-09-30T02:54:51Z)
• Deep Semantic Statistics Matching (D2SM) Denoising Network [70.01091467628068]
  We introduce the Deep Semantic Statistics Matching (D2SM) Denoising Network. It exploits semantic features of pretrained classification networks, then it implicitly matches the probabilistic distribution of clear images at the semantic feature space. By learning to preserve the semantic distribution of denoised images, we empirically find our method significantly improves the denoising capabilities of networks.
  arXiv  Detail & Related papers  (2022-07-19T14:35:42Z)
• Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrast [43.40192909920495]
  Cross-view feature semantic consistency and intra(inter)-class compactness(dispersion) are explored. We propose two novel pixel-to-prototype contrast regularization terms that are conducted cross different views and within per single view of an image. Our method can be seamlessly incorporated into existing WSSS models without any changes to the base network.
  arXiv  Detail & Related papers  (2021-10-14T01:44:57Z)
• Superpixel-guided Discriminative Low-rank Representation of Hyperspectral Images for Classification [49.32130776974202]
  SP-DLRR is composed of two modules, i.e., the classification-guided superpixel segmentation and the discriminative low-rank representation. Experimental results on three benchmark datasets demonstrate the significant superiority of SP-DLRR over state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-08-25T10:47:26Z)
• Semi-supervised Semantic Segmentation with Directional Context-aware Consistency [66.49995436833667]
  We focus on the semi-supervised segmentation problem where only a small set of labeled data is provided with a much larger collection of totally unlabeled images. A preferred high-level representation should capture the contextual information while not losing self-awareness. We present the Directional Contrastive Loss (DC Loss) to accomplish the consistency in a pixel-to-pixel manner.
  arXiv  Detail & Related papers  (2021-06-27T03:42:40Z)
• Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentation [16.560870740946275]
  Explicit Pseudo-pixel Supervision (EPS) learns from pixel-level feedback by combining two weak supervisions. We devise a joint training strategy to fully utilize the complementary relationship between both information. Our method can obtain accurate object boundaries and discard co-occurring pixels, thereby significantly improving the quality of pseudo-masks.
  arXiv  Detail & Related papers  (2021-05-19T07:31:11Z)
• InverseForm: A Loss Function for Structured Boundary-Aware Segmentation [80.39674800972182]
  We present a novel boundary-aware loss term for semantic segmentation using an inverse-transformation network. This plug-in loss term complements the cross-entropy loss in capturing boundary transformations. We analyze the quantitative and qualitative effects of our loss function on three indoor and outdoor segmentation benchmarks.
  arXiv  Detail & Related papers  (2021-04-06T18:52:45Z)
• Improving Image co-segmentation via Deep Metric Learning [1.5076964620370268]
  We propose a novel Triplet loss for Image, called IS-Triplet loss for short, and combine it with traditional image segmentation loss. We apply the proposed approach to image co-segmentation and test it on the SBCoseg dataset and the Internet dataset.
  arXiv  Detail & Related papers  (2021-03-19T07:30:42Z)
• Superpixel Segmentation Based on Spatially Constrained Subspace Clustering [57.76302397774641]
  We consider each representative region with independent semantic information as a subspace, and formulate superpixel segmentation as a subspace clustering problem. We show that a simple integration of superpixel segmentation with the conventional subspace clustering does not effectively work due to the spatial correlation of the pixels. We propose a novel convex locality-constrained subspace clustering model that is able to constrain the spatial adjacent pixels with similar attributes to be clustered into a superpixel.
  arXiv  Detail & Related papers  (2020-12-11T06:18:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.