Semantic segmentation with coarse annotations

• URL: http://arxiv.org/abs/2510.15756v1
• Date: Fri, 17 Oct 2025 15:41:27 GMT
• Title: Semantic segmentation with coarse annotations
• Authors: Jort de Jong, Mike Holenderski,
• Abstract summary: This paper proposes a regularization method for models with an encoder-decoder architecture with superpixel based upsampling.<n>It is shown that the boundary recall improves significantly compared to state-of-the-art models when trained on coarse annotations.
• Score: 0.42970700836450487
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Semantic segmentation is the task of classifying each pixel in an image. Training a segmentation model achieves best results using annotated images, where each pixel is annotated with the corresponding class. When obtaining fine annotations is difficult or expensive, it may be possible to acquire coarse annotations, e.g. by roughly annotating pixels in an images leaving some pixels around the boundaries between classes unlabeled. Segmentation with coarse annotations is difficult, in particular when the objective is to optimize the alignment of boundaries between classes. This paper proposes a regularization method for models with an encoder-decoder architecture with superpixel based upsampling. It encourages the segmented pixels in the decoded image to be SLIC-superpixels, which are based on pixel color and position, independent of the segmentation annotation. The method is applied to FCN-16 fully convolutional network architecture and evaluated on the SUIM, Cityscapes, and PanNuke data sets. It is shown that the boundary recall improves significantly compared to state-of-the-art models when trained on coarse annotations.

Related papers

• Learning Semantic Segmentation with Query Points Supervision on Aerial Images [57.09251327650334]
  We present a weakly supervised learning algorithm to train semantic segmentation algorithms. Our proposed approach performs accurate semantic segmentation and improves efficiency by significantly reducing the cost and time required for manual annotation.
  arXiv  Detail & Related papers  (2023-09-11T14:32:04Z)
• Language-driven Semantic Segmentation [88.21498323896475]
  We present LSeg, a novel model for language-driven semantic image segmentation. We use a text encoder to compute embeddings of descriptive input labels. The encoder is trained with a contrastive objective to align pixel embeddings to the text embedding of the corresponding semantic class.
  arXiv  Detail & Related papers  (2022-01-10T18:59:10Z)
• Segmenter: Transformer for Semantic Segmentation [79.9887988699159]
  We introduce Segmenter, a transformer model for semantic segmentation. We build on the recent Vision Transformer (ViT) and extend it to semantic segmentation. It outperforms the state of the art on the challenging ADE20K dataset and performs on-par on Pascal Context and Cityscapes.
  arXiv  Detail & Related papers  (2021-05-12T13:01:44Z)
• Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learning [28.498782661888775]
  We formulate weakly supervised segmentation as a semi-supervised metric learning problem. We propose 4 types of contrastive relationships between pixels and segments in the feature space. We deliver a universal weakly supervised segmenter with significant gains on Pascal VOC and DensePose.
  arXiv  Detail & Related papers  (2021-05-03T15:49:01Z)
• Exploring Cross-Image Pixel Contrast for Semantic Segmentation [130.22216825377618]
  We propose a pixel-wise contrastive framework for semantic segmentation in the fully supervised setting. The core idea is to enforce pixel embeddings belonging to a same semantic class to be more similar than embeddings from different classes. Our method can be effortlessly incorporated into existing segmentation frameworks without extra overhead during testing.
  arXiv  Detail & Related papers  (2021-01-28T11:35:32Z)
• Rethinking Interactive Image Segmentation: Feature Space Annotation [68.8204255655161]
  We propose interactive and simultaneous segment annotation from multiple images guided by feature space projection. We show that our approach can surpass the accuracy of state-of-the-art methods in foreground segmentation datasets.
  arXiv  Detail & Related papers  (2021-01-12T10:13:35Z)
• From Pixel to Patch: Synthesize Context-aware Features for Zero-shot Semantic Segmentation [22.88452754438478]
  We focus on zero-shot semantic segmentation, which aims to segment unseen objects with only category-level semantic representations. We propose a novel Context-aware feature Generation Network (CaGNet), which can synthesize context-aware pixel-wise visual features for unseen categories. Experimental results on Pascal-VOC, Pascal-Context, and COCO-stuff show that our method significantly outperforms the existing zero-shot semantic segmentation methods.
  arXiv  Detail & Related papers  (2020-09-25T13:26:30Z)
• Context-aware Feature Generation for Zero-shot Semantic Segmentation [18.37777970377439]
  We propose a novel context-aware feature generation method for zero-shot segmentation named CaGNet. Our method achieves state-of-the-art results on three benchmark datasets for zero-shot segmentation.
  arXiv  Detail & Related papers  (2020-08-16T12:20:49Z)
• SegFix: Model-Agnostic Boundary Refinement for Segmentation [75.58050758615316]
  We present a model-agnostic post-processing scheme to improve the boundary quality for the segmentation result that is generated by any existing segmentation model. Motivated by the empirical observation that the label predictions of interior pixels are more reliable, we propose to replace the originally unreliable predictions of boundary pixels by the predictions of interior pixels.
  arXiv  Detail & Related papers  (2020-07-08T17:08:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.