Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels
- URL: http://arxiv.org/abs/2203.03884v1
- Date: Tue, 8 Mar 2022 07:16:23 GMT
- Title: Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels
- Authors: Yuchao Wang, Haochen Wang, Yujun Shen, Jingjing Fei, Wei Li, Guoqiang
Jin, Liwei Wu, Rui Zhao, Xinyi Le
- Abstract summary: We argue that every pixel matters to the model training, even its prediction is ambiguous.
We separate reliable and unreliable pixels via the entropy of predictions, push each unreliable pixel to a category-wise queue that consists of negative samples, and manage to train the model with all candidate pixels.
- Score: 29.32275289325213
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The crux of semi-supervised semantic segmentation is to assign adequate
pseudo-labels to the pixels of unlabeled images. A common practice is to select
the highly confident predictions as the pseudo ground-truth, but it leads to a
problem that most pixels may be left unused due to their unreliability. We
argue that every pixel matters to the model training, even its prediction is
ambiguous. Intuitively, an unreliable prediction may get confused among the top
classes (i.e., those with the highest probabilities), however, it should be
confident about the pixel not belonging to the remaining classes. Hence, such a
pixel can be convincingly treated as a negative sample to those most unlikely
categories. Based on this insight, we develop an effective pipeline to make
sufficient use of unlabeled data. Concretely, we separate reliable and
unreliable pixels via the entropy of predictions, push each unreliable pixel to
a category-wise queue that consists of negative samples, and manage to train
the model with all candidate pixels. Considering the training evolution, where
the prediction becomes more and more accurate, we adaptively adjust the
threshold for the reliable-unreliable partition. Experimental results on
various benchmarks and training settings demonstrate the superiority of our
approach over the state-of-the-art alternatives.
Related papers
- Weighting Pseudo-Labels via High-Activation Feature Index Similarity and Object Detection for Semi-Supervised Segmentation [33.384621509857524]
Semi-supervised semantic segmentation methods leverage unlabeled data by pseudo-labeling them.
Existing methods mostly choose high-confidence pixels in an effort to avoid erroneous pseudo-labels.
We propose a novel approach to reliably learn from pseudo-labels.
arXiv Detail & Related papers (2024-07-17T14:58:04Z) - Semi-supervised Counting via Pixel-by-pixel Density Distribution
Modelling [135.66138766927716]
This paper focuses on semi-supervised crowd counting, where only a small portion of the training data are labeled.
We formulate the pixel-wise density value to regress as a probability distribution, instead of a single deterministic value.
Our method clearly outperforms the competitors by a large margin under various labeled ratio settings.
arXiv Detail & Related papers (2024-02-23T12:48:02Z) - NP-SemiSeg: When Neural Processes meet Semi-Supervised Semantic
Segmentation [87.50830107535533]
Semi-supervised semantic segmentation involves assigning pixel-wise labels to unlabeled images at training time.
Current approaches to semi-supervised semantic segmentation work by predicting pseudo-labels for each pixel from a class-wise probability distribution output by a model.
In this work, we move one step forward by adapting NPs to semi-supervised semantic segmentation, resulting in a new model called NP-SemiSeg.
arXiv Detail & Related papers (2023-08-05T12:42:15Z) - Using Unreliable Pseudo-Labels for Label-Efficient Semantic Segmentation [78.56076985502291]
We argue that every pixel matters to the model training, even those unreliable and ambiguous pixels.
We separate reliable and unreliable pixels via the entropy of predictions, push each unreliable pixel to a category-wise queue that consists of negative keys.
Considering the training evolution, we adaptively adjust the threshold for the reliable-unreliable partition.
arXiv Detail & Related papers (2023-06-04T09:40:25Z) - SePiCo: Semantic-Guided Pixel Contrast for Domain Adaptive Semantic
Segmentation [52.62441404064957]
Domain adaptive semantic segmentation attempts to make satisfactory dense predictions on an unlabeled target domain by utilizing the model trained on a labeled source domain.
Many methods tend to alleviate noisy pseudo labels, however, they ignore intrinsic connections among cross-domain pixels with similar semantic concepts.
We propose Semantic-Guided Pixel Contrast (SePiCo), a novel one-stage adaptation framework that highlights the semantic concepts of individual pixel.
arXiv Detail & Related papers (2022-04-19T11:16:29Z) - Uncertainty-Aware Semi-Supervised Few Shot Segmentation [9.098329723771116]
Few shot segmentation (FSS) aims to learn pixel-level classification of a target object in a query image using only a few annotated support samples.
This is challenging as it requires modeling appearance variations of target objects and the diverse visual cues between query and support images with limited information.
We propose a semi-supervised FSS strategy that leverages additional prototypes from unlabeled images with uncertainty guided pseudo label refinement.
arXiv Detail & Related papers (2021-10-18T00:37:46Z) - Mixed Supervision Learning for Whole Slide Image Classification [88.31842052998319]
We propose a mixed supervision learning framework for super high-resolution images.
During the patch training stage, this framework can make use of coarse image-level labels to refine self-supervised learning.
A comprehensive strategy is proposed to suppress pixel-level false positives and false negatives.
arXiv Detail & Related papers (2021-07-02T09:46:06Z) - An Empirical Study of the Collapsing Problem in Semi-Supervised 2D Human
Pose Estimation [80.02124918255059]
Semi-supervised learning aims to boost the accuracy of a model by exploring unlabeled images.
We learn two networks to mutually teach each other.
The more reliable predictions on easy images in each network are used to teach the other network to learn about the corresponding hard images.
arXiv Detail & Related papers (2020-11-25T03:29:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.