Few-Shot Semantic Segmentation Meets SAM3

• URL: http://arxiv.org/abs/2604.05433v1
• Date: Tue, 07 Apr 2026 04:59:50 GMT
• Title: Few-Shot Semantic Segmentation Meets SAM3
• Abstract summary: Few-Shot Semantic (FSS) focuses on segmenting novel object categories from only a handful of annotated examples.<n>We revisit FSS from the perspective of modern vision foundation models and explore the potential of Segment Anything Model 3 (SAM3) as a training-free solution.<n>By repurposing its Promptable Concept (PCS) capability, we adopt a simple spatial concatenation strategy that places support and query images into a shared canvas.
• Score: 23.28277367328234
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Few-Shot Semantic Segmentation (FSS) focuses on segmenting novel object categories from only a handful of annotated examples. Most existing approaches rely on extensive episodic training to learn transferable representations, which is both computationally demanding and sensitive to distribution shifts. In this work, we revisit FSS from the perspective of modern vision foundation models and explore the potential of Segment Anything Model 3 (SAM3) as a training-free solution. By repurposing its Promptable Concept Segmentation (PCS) capability, we adopt a simple spatial concatenation strategy that places support and query images into a shared canvas, allowing a fully frozen SAM3 to perform segmentation without any fine-tuning or architectural changes. Experiments on PASCAL-$5^i$ and COCO-$20^i$ show that this minimal design already achieves state-of-the-art performance, outperforming many heavily engineered methods. Beyond empirical gains, we uncover that negative prompts can be counterproductive in few-shot settings, where they often weaken target representations and lead to prediction collapse despite their intended role in suppressing distractors. These findings suggest that strong cross-image reasoning can emerge from simple spatial formulations, while also highlighting limitations in how current foundation models handle conflicting prompt signals. Code at: https://github.com/WongKinYiu/FSS-SAM3

Related papers

• GFR-SAM: Training-Free Referring Camouflaged Object Segmentation via Cross-Image Prompting [40.66340261994875]
  Referring Camouflaged Object Detection (Ref-COD) requires segmenting hidden targets guided by reference cues.<n>We propose GFR-SAM, a robust three-stage training-free framework.<n>First, we introduce In-Context Exemplar-guided exemplars, empowering SAM3 with cross-image inference to generate candidate masks.<n>Second, a Region-Global Contrastive Filtering module ranks candidates through DINOv3-based prototypical alignment.<n>Third, a Geometric-Semantic Refinement module synergizes bounding box and text prompts to recover fine-grained boundaries and enhance instance recall.
  arXiv  Detail & Related papers  (2026-07-13T15:55:45Z)
• Promptable Concept Segmentation from Above: Evaluating SAM 3's Zero-Shot and One-Shot Capabilities in Remote Sensing [0.42970700836450487]
  We present a comprehensive, multi-task empirical evaluation across remote sensing scene classification, object detection, and instance segmentation.<n>Our results demonstrate that SAM 3 avoids the overfitting commonly seen in legacy domain-adapted models.<n>It remains fundamentally constrained by sub-pixel resolution limits and overhead semantic blind spots.
  arXiv  Detail & Related papers  (2026-07-10T16:33:05Z)
• Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matching [8.277992670183004]
  Cross-domain Few-shot (CD-FSS) aims to transfer knowledge learned from source domain to distinct target domains.<n>We propose a training-free framework to avoid both training overhead and overfitting.
  arXiv  Detail & Related papers  (2026-06-23T08:19:30Z)
• Prompting Diffusion Models for Zero-Shot Instance Segmentation [74.37083707535778]
  We present Prompt2Seg, a spatial conditioning framework for diffusion-based segmentation.<n>Our approach takes spatial prompts, represented as 2D Gaussians or confidence maps, as explicit input signals, training the model to respond directly to user intent.<n>We evaluate on seven datasets ranging from standard benchmarks to more challenging domains, including paintings, egocentric views, and X-ray data.
  arXiv  Detail & Related papers  (2026-06-21T20:30:41Z)
• INSID3: Training-Free In-Context Segmentation with DINOv3 [63.961377087673476]
  INSID3 is a training-free approach that segments concepts at varying granularities only from frozen DINOv3 features.<n>It achieves state-of-the-art results across one-shot semantic, part, and personalized segmentation, outperforming previous work by +7.5 % mIoU.
  arXiv  Detail & Related papers  (2026-03-30T14:16:37Z)
• Taming SAM3 in the Wild: A Concept Bank for Open-Vocabulary Segmentation [57.427604620940734]
  We present textscConceptBank, a framework to restore alignment between visual evidence and prompts on the fly.<n>Our approach anchors target-domain evidence via class-wise visual prototypes, (textitii) mines representative supports to suppress outliers under data drift, and (textitiii) fuses candidate concepts to rectify concept drift.
  arXiv  Detail & Related papers  (2026-02-06T02:59:11Z)
• SegEarth-OV3: Exploring SAM 3 for Open-Vocabulary Semantic Segmentation in Remote Sensing Images [51.42466259821335]
  We present a preliminary exploration of applying SAM 3 to the remote sensing OVSS task without any training.<n>First, we implement a mask fusion strategy that combines the outputs from SAM 3's semantic segmentation head and the Transformer decoder.<n>Second, we utilize the presence score from the presence head to filter out categories that do not exist in the scene.
  arXiv  Detail & Related papers  (2025-12-09T15:42:28Z)
• No time to train! Training-Free Reference-Based Instance Segmentation [15.061599989448867]
  This work investigates the task of object segmentation when provided with only a small set of reference images.<n>Our key insight is to leverage strong semantic priors, as learned by foundation models, to identify corresponding regions between a reference and a target image.<n>We find that correspondences enable automatic generation of instance-level segmentation masks for downstream tasks and instantiate our ideas via a multi-stage, training-free method.
  arXiv  Detail & Related papers  (2025-07-03T16:59:01Z)
• S4M: Segment Anything with 4 Extreme Points [2.052287962818431]
  Segment Anything Model (SAM) primarily relies on sparse prompts such as point or bounding box.<n>S4M augments SAM by leveraging extreme points -- the top-, bottom-, left-, and right-most points of an instance -- prompts.<n>S4M outperforms other SAM-based approaches on three endoscopic surgical datasets.
  arXiv  Detail & Related papers  (2025-03-07T16:02:11Z)
• TinySAM: Pushing the Envelope for Efficient Segment Anything Model [73.06322749886483]
  We propose a framework to obtain a tiny segment anything model (TinySAM) while maintaining the strong zero-shot performance.<n>With all these proposed methods, our TinySAM leads to orders of magnitude computational reduction and pushes the envelope for efficient segment anything task.
  arXiv  Detail & Related papers  (2023-12-21T12:26:11Z)
• Reflection Invariance Learning for Few-shot Semantic Segmentation [53.20466630330429]
  Few-shot semantic segmentation (FSS) aims to segment objects of unseen classes in query images with only a few annotated support images. This paper proposes a fresh few-shot segmentation framework to mine the reflection invariance in a multi-view matching manner. Experiments on both PASCAL-$5textiti$ and COCO-$20textiti$ datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-06-01T15:14:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.