Learning to Detect Semantic Boundaries with Image-level Class Labels

• URL: http://arxiv.org/abs/2212.07579v1
• Date: Thu, 15 Dec 2022 01:56:22 GMT
• Title: Learning to Detect Semantic Boundaries with Image-level Class Labels
• Authors: Namyup Kim, Sehyun Hwang, Suha Kwak
• Abstract summary: This paper presents the first attempt to learn semantic boundary detection using image-level class labels as supervision. Our method starts by estimating coarse areas of object classes through attentions drawn by an image classification network. We design a new neural network architecture that can learn to estimate semantic boundaries reliably even with uncertain supervision.
• Score: 14.932318540666548
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: This paper presents the first attempt to learn semantic boundary detection using image-level class labels as supervision. Our method starts by estimating coarse areas of object classes through attentions drawn by an image classification network. Since boundaries will locate somewhere between such areas of different classes, our task is formulated as a multiple instance learning (MIL) problem, where pixels on a line segment connecting areas of two different classes are regarded as a bag of boundary candidates. Moreover, we design a new neural network architecture that can learn to estimate semantic boundaries reliably even with uncertain supervision given by the MIL strategy. Our network is used to generate pseudo semantic boundary labels of training images, which are in turn used to train fully supervised models. The final model trained with our pseudo labels achieves an outstanding performance on the SBD dataset, where it is as competitive as some of previous arts trained with stronger supervision.

Related papers

• Co-Segmentation without any Pixel-level Supervision with Application to Large-Scale Sketch Classification [3.3104978705632777]
  We propose a novel method for object co-segmentation, i.e. pixel-level localization of a common object in a set of images. The method achieves state-of-the-art performance among methods trained with the same level of supervision. The benefits of the proposed co-segmentation method are further demonstrated in the task of large-scale sketch recognition.
  arXiv  Detail & Related papers  (2024-10-17T14:16:45Z)
• Few-shot Class-Incremental Semantic Segmentation via Pseudo-Labeling and Knowledge Distillation [3.4436201325139737]
  We address the problem of learning new classes for semantic segmentation models from few examples. For learning from limited data, we propose a pseudo-labeling strategy to augment the few-shot training annotations. We integrate the above steps into a single convolutional neural network with a unified learning objective.
  arXiv  Detail & Related papers  (2023-08-05T05:05:37Z)
• ReFit: A Framework for Refinement of Weakly Supervised Semantic Segmentation using Object Border Fitting for Medical Images [4.945138408504987]
  Weakly Supervised Semantic (WSSS) relying only on image-level supervision is a promising approach to deal with the need for networks. We propose our novel ReFit framework, which deploys state-of-the-art class activation maps combined with various post-processing techniques. By applying our method to WSSS predictions, we achieved up to 10% improvement over the current state-of-the-art WSSS methods for medical imaging.
  arXiv  Detail & Related papers  (2023-03-14T12:46:52Z)
• Simpler Does It: Generating Semantic Labels with Objectness Guidance [32.81128493853064]
  We present a novel framework that generates pseudo-labels for training images, which are then used to train a segmentation model. To generate pseudo-labels, we combine information from: (i) a class agnostic objectness network that learns to recognize object-like regions, and (ii) either image-level or bounding box annotations. We show the efficacy of our approach by demonstrating how the objectness network can naturally be leveraged to generate object-like regions for unseen categories.
  arXiv  Detail & Related papers  (2021-10-20T01:52:05Z)
• Visual Boundary Knowledge Translation for Foreground Segmentation [57.32522585756404]
  We make an attempt towards building models that explicitly account for visual boundary knowledge, in hope to reduce the training effort on segmenting unseen categories. With only tens of labeled samples as guidance, Trans-Net achieves close results on par with fully supervised methods.
  arXiv  Detail & Related papers  (2021-08-01T07:10:25Z)
• KRADA: Known-region-aware Domain Alignment for Open World Semantic Segmentation [64.03817806316903]
  In semantic segmentation, we aim to train a pixel-level classifier to assign category labels to all pixels in an image. In an open world, the unlabeled test images probably contain unknown categories and have different distributions from the labeled images. We propose an end-to-end learning framework, known-region-aware domain alignment (KRADA), to distinguish unknown classes while aligning distributions of known classes in labeled and unlabeled open-world images.
  arXiv  Detail & Related papers  (2021-06-11T08:43:59Z)
• Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalization [112.68171734288237]
  We propose a novel framework for discriminative pixel-level tasks using a generative model of both images and labels. We learn a generative adversarial network that captures the joint image-label distribution and is trained efficiently using a large set of unlabeled images. We demonstrate strong in-domain performance compared to several baselines, and are the first to showcase extreme out-of-domain generalization.
  arXiv  Detail & Related papers  (2021-04-12T21:41:25Z)
• Instance Localization for Self-supervised Detection Pretraining [68.24102560821623]
  We propose a new self-supervised pretext task, called instance localization. We show that integration of bounding boxes into pretraining promotes better task alignment and architecture alignment for transfer learning. Experimental results demonstrate that our approach yields state-of-the-art transfer learning results for object detection.
  arXiv  Detail & Related papers  (2021-02-16T17:58:57Z)
• Contrastive Rendering for Ultrasound Image Segmentation [59.23915581079123]
  The lack of sharp boundaries in US images remains an inherent challenge for segmentation. We propose a novel and effective framework to improve boundary estimation in US images. Our proposed method outperforms state-of-the-art methods and has the potential to be used in clinical practice.
  arXiv  Detail & Related papers  (2020-10-10T07:14:03Z)
• Mining Cross-Image Semantics for Weakly Supervised Semantic Segmentation [128.03739769844736]
  Two neural co-attentions are incorporated into the classifier to capture cross-image semantic similarities and differences. In addition to boosting object pattern learning, the co-attention can leverage context from other related images to improve localization map inference. Our algorithm sets new state-of-the-arts on all these settings, demonstrating well its efficacy and generalizability.
  arXiv  Detail & Related papers  (2020-07-03T21:53:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.