CobNet: Cross Attention on Object and Background for Few-Shot Segmentation

• URL: http://arxiv.org/abs/2210.11968v1
• Date: Fri, 21 Oct 2022 13:49:46 GMT
• Title: CobNet: Cross Attention on Object and Background for Few-Shot Segmentation
• Authors: Haoyan Guan, Spratling Michae
• Abstract summary: Few-shot segmentation aims to segment images containing objects from previously unseen classes using only a few annotated samples. Background information can also be useful to distinguish objects from their surroundings. We propose CobNet which utilises information about the background that is extracted from the query images without annotations of those images.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Few-shot segmentation aims to segment images containing objects from previously unseen classes using only a few annotated samples. Most current methods focus on using object information extracted, with the aid of human annotations, from support images to identify the same objects in new query images. However, background information can also be useful to distinguish objects from their surroundings. Hence, some previous methods also extract background information from the support images. In this paper, we argue that such information is of limited utility, as the background in different images can vary widely. To overcome this issue, we propose CobNet which utilises information about the background that is extracted from the query images without annotations of those images. Experiments show that our method achieves a mean Intersection-over-Union score of 61.4% and 37.8% for 1-shot segmentation on PASCAL-5i and COCO-20i respectively, outperforming previous methods. It is also shown to produce state-of-the-art performances of 53.7% for weakly-supervised few-shot segmentation, where no annotations are provided for the support images.

Related papers

• EOPose : Exemplar-based object reposing using Generalized Pose Correspondences [16.104124493724274]
  We propose an end-to-end framework for generic object reposing.<n>Our method, EOPose, takes a target pose-guidance image as input and uses its keypoint correspondence with the source object image to warp and re-render the latter into the target pose.<n>Unlike generative approaches, our method also preserves the fine-grained details of the object such as its exact colors, textures and brand marks.
  arXiv  Detail & Related papers  (2025-05-06T10:17:32Z)
• Iterative Few-shot Semantic Segmentation from Image Label Text [36.53926941601841]
  Few-shot semantic segmentation aims to learn to segment unseen class objects with the guidance of only a few support images. We propose a general framework to generate coarse masks with the help of the powerful vision-language model CLIP. Our method owns an excellent generalization ability for the images in the wild and uncommon classes.
  arXiv  Detail & Related papers  (2023-03-10T01:48:14Z)
• Query Semantic Reconstruction for Background in Few-Shot Segmentation [0.0]
  Few-shot segmentation (FSS) aims to segment unseen classes using a few annotated samples. Some FSS methods try to address this issue by using the background in the support image(s) to help identify the background in the query image. This article proposes a method, QSR, that extracts the background from the query image itself.
  arXiv  Detail & Related papers  (2022-10-21T15:49:16Z)
• VizWiz-FewShot: Locating Objects in Images Taken by People With Visual Impairments [74.72656607288185]
  We introduce a few-shot localization dataset originating from photographers who authentically were trying to learn about the visual content in the images they took. It includes nearly 10,000 segmentations of 100 categories in over 4,500 images that were taken by people with visual impairments. Compared to existing few-shot object detection and instance segmentation datasets, our dataset is the first to locate holes in objects.
  arXiv  Detail & Related papers  (2022-07-24T20:44:51Z)
• Few-Shot Segmentation with Global and Local Contrastive Learning [51.677179037590356]
  We propose a prior extractor to learn the query information from the unlabeled images with our proposed global-local contrastive learning. We generate the prior region maps for query images, which locate the objects, as guidance to perform cross interaction with support features. Without bells and whistles, the proposed approach achieves new state-of-the-art performance for the few-shot segmentation task.
  arXiv  Detail & Related papers  (2021-08-11T15:52:22Z)
• Learning Meta-class Memory for Few-Shot Semantic Segmentation [90.28474742651422]
  We introduce the concept of meta-class, which is the meta information shareable among all classes. We propose a novel Meta-class Memory based few-shot segmentation method (MM-Net), where we introduce a set of learnable memory embeddings. Our proposed MM-Net achieves 37.5% mIoU on the COCO dataset in 1-shot setting, which is 5.1% higher than the previous state-of-the-art.
  arXiv  Detail & Related papers  (2021-08-06T06:29:59Z)
• Rectifying the Shortcut Learning of Background: Shared Object Concentration for Few-Shot Image Recognition [101.59989523028264]
  Few-Shot image classification aims to utilize pretrained knowledge learned from a large-scale dataset to tackle a series of downstream classification tasks. We propose COSOC, a novel Few-Shot Learning framework, to automatically figure out foreground objects at both pretraining and evaluation stage.
  arXiv  Detail & Related papers  (2021-07-16T07:46:41Z)
• SCNet: Enhancing Few-Shot Semantic Segmentation by Self-Contrastive Background Prototypes [56.387647750094466]
  Few-shot semantic segmentation aims to segment novel-class objects in a query image with only a few annotated examples. Most of advanced solutions exploit a metric learning framework that performs segmentation through matching each pixel to a learned foreground prototype. This framework suffers from biased classification due to incomplete construction of sample pairs with the foreground prototype only.
  arXiv  Detail & Related papers  (2021-04-19T11:21:47Z)
• A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection [56.82077636126353]
  We take advantage of object-centric images to improve object detection in scene-centric images. We present a simple yet surprisingly effective framework to do so. Our approach can improve the object detection (and instance segmentation) accuracy of rare objects by 50% (and 33%) relatively.
  arXiv  Detail & Related papers  (2021-02-17T17:27:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.