MSI: Maximize Support-Set Information for Few-Shot Segmentation

• URL: http://arxiv.org/abs/2212.04673v3
• Date: Fri, 10 Nov 2023 22:32:40 GMT
• Title: MSI: Maximize Support-Set Information for Few-Shot Segmentation
• Authors: Seonghyeon Moon, Samuel S. Sohn, Honglu Zhou, Sejong Yoon, Vladimir Pavlovic, Muhammad Haris Khan, Mubbasir Kapadia
• Abstract summary: We present a novel method(MSI) which maximizes the support-set information by exploiting two complementary sources of features to generate super correlation maps. Experimental results on several publicly available FSS benchmarks show that our proposed method consistently improves performance by visible margins and leads to faster convergence.
• Score: 27.459485560344262
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: FSS(Few-shot segmentation) aims to segment a target class using a small number of labeled images(support set). To extract information relevant to the target class, a dominant approach in best-performing FSS methods removes background features using a support mask. We observe that this feature excision through a limiting support mask introduces an information bottleneck in several challenging FSS cases, e.g., for small targets and/or inaccurate target boundaries. To this end, we present a novel method(MSI), which maximizes the support-set information by exploiting two complementary sources of features to generate super correlation maps. We validate the effectiveness of our approach by instantiating it into three recent and strong FSS methods. Experimental results on several publicly available FSS benchmarks show that our proposed method consistently improves performance by visible margins and leads to faster convergence. Our code and trained models are available at: https://github.com/moonsh/MSI-Maximize-Support-Set-Information

Related papers

• Exploring Few-Shot Defect Segmentation in General Industrial Scenarios with Metric Learning and Vision Foundation Models [8.96299670050608]
  This paper aims to explore few-shot semantic segmentation (FSS) in broader industrial products with various defect types. We thoroughly investigate metric learning-based FSS methods, including those based on meta-learning and those based on Vision Foundation Models (VFMs) We propose a novel efficient FDS method based on feature matching.
  arXiv  Detail & Related papers  (2025-02-03T10:13:34Z)
• Overcoming Support Dilution for Robust Few-shot Semantic Segmentation [97.87058176900179]
  Few-shot Semantic (FSS) is a challenging task that utilizes limited support images to segment associated unseen objects in query images. Recent FSS methods are observed to perform worse, when enlarging the number of shots. In this work, we study this challenging issue, called support dilution, our goal is to recognize, select, preserve, and enhance those high-contributed supports in the raw support pool.
  arXiv  Detail & Related papers  (2025-01-23T10:26:48Z)
• Multimodality Helps Few-Shot 3D Point Cloud Semantic Segmentation [61.91492500828508]
  Few-shot 3D point cloud segmentation (FS-PCS) aims at generalizing models to segment novel categories with minimal support samples. We introduce a cost-free multimodal FS-PCS setup, utilizing textual labels and the potentially available 2D image modality. We propose a simple yet effective Test-time Adaptive Cross-modal Seg (TACC) technique to mitigate training bias.
  arXiv  Detail & Related papers  (2024-10-29T19:28:41Z)
• Bridge the Points: Graph-based Few-shot Segment Anything Semantically [79.1519244940518]
  Recent advancements in pre-training techniques have enhanced the capabilities of vision foundation models. Recent studies extend the SAM to Few-shot Semantic segmentation (FSS) We propose a simple yet effective approach based on graph analysis.
  arXiv  Detail & Related papers  (2024-10-09T15:02:28Z)
• SMILe: Leveraging Submodular Mutual Information For Robust Few-Shot Object Detection [2.0755366440393743]
  Confusion and forgetting of object classes have been challenges of prime interest in Few-Shot Object Detection (FSOD) We introduce a novel Submodular Mutual Information Learning framework which adopts mutual information functions. Our proposed approach generalizes to several existing approaches in FSOD, agnostic of the backbone architecture.
  arXiv  Detail & Related papers  (2024-07-02T20:53:43Z)
• Adaptive FSS: A Novel Few-Shot Segmentation Framework via Prototype Enhancement [6.197356908000006]
  The Few-Shot (FSS) aims to accomplish the novel class segmentation task with a few annotated images. We propose a novel framework based on the adapter mechanism, namely Adaptive FSS, which can efficiently adapt the existing FSS model to the novel classes. Our approach is compatible with diverse FSS methods with different backbones by simply inserting PAM between the layers of the encoder.
  arXiv  Detail & Related papers  (2023-12-25T14:03:38Z)
• Dense Affinity Matching for Few-Shot Segmentation [83.65203917246745]
  Few-Shot (FSS) aims to segment the novel class images with a few samples. We propose a dense affinity matching framework to exploit the support-query interaction. We show that our framework performs very competitively under different settings with only 0.68M parameters.
  arXiv  Detail & Related papers  (2023-07-17T12:27:15Z)
• Mining Relations among Cross-Frame Affinities for Video Semantic Segmentation [87.4854250338374]
  We explore relations among affinities in two aspects: single-scale intrinsic correlations and multi-scale relations. Our experiments demonstrate that the proposed method performs favorably against state-of-the-art VSS methods.
  arXiv  Detail & Related papers  (2022-07-21T12:12:36Z)
• PFENet++: Boosting Few-shot Semantic Segmentation with the Noise-filtered Context-aware Prior Mask [62.37727055343632]
  We revisit the prior mask guidance proposed in Guided Feature Enrichment Network for Few-Shot'' We propose the Context-aware Prior Mask (CAPM) that leverages additional nearby semantic cues for better locating the objects in query images. We take one step further by incorporating a lightweight Noise Suppression Module (NSM) to screen out the unnecessary responses.
  arXiv  Detail & Related papers  (2021-09-28T15:07:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.