Remote SAMsing: From Segment Anything to Segment Everything

• URL: http://arxiv.org/abs/2605.00256v1
• Date: Thu, 30 Apr 2026 21:44:03 GMT
• Title: Remote SAMsing: From Segment Anything to Segment Everything
• Abstract summary: SAM2 produces high-quality zero-shot segmentation on natural images.<n>Applying it to large remote sensing scenes exposes two problems.<n>We propose Remote SAMsing, an open-source pipeline that solves both problems without modifying SAM2 or requiring training data.
• Score: 0.1749935196721634
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: SAM2 produces high-quality zero-shot segmentation on natural images, but applying it to large remote sensing scenes exposes two problems: (1) its mask generator faces an inherent quality-coverage trade-off: strict thresholds yield precise masks but leave most of the image unsegmented, while relaxed thresholds increase coverage at the cost of mask quality; and (2) large images must be tiled, fragmenting objects across tile boundaries. We propose Remote SAMsing, an open-source pipeline that solves both problems without modifying SAM2 or requiring training data. For coverage, a multi-pass algorithm runs SAM2 repeatedly on each tile, painting accepted masks black between passes to simplify the scene for the next iteration, and relaxing quality thresholds only when coverage gains stagnate, ensuring that the most precise masks are always captured first. For spatial consistency, contextual padding and a parameter-free best-match merge reconstruct objects fragmented across tile boundaries. Evaluated on seven scenes (5~cm to 4.78~m GSD), the pipeline raises coverage from 30--68\% (single-pass SAM2) to 91--98\%. Ablation experiments quantify the contribution of each component to coverage and detection quality. Per-class evaluation shows that SAM2 transfers well to discrete RS objects (buildings 95\%, cars 82--93\% Det@0.5) with segment boundaries 3--8$\times$ more precise than SLIC and Felzenszwalb baselines. Tile size functions as an implicit scale parameter: reducing it from $1{,}000$ to 250 raises Det@0.5 from 56\% to 85\%, outperforming SAM2's built-in multi-scale mechanism. The pipeline generalizes to MNF false-color imagery without retraining (99.5\% ASA) and scales to production-sized images: a 1.94 billion pixel Potsdam mosaic achieved 97\% coverage without quality degradation.

Related papers

• Malicious Image Analysis via Vision-Language Segmentation Fusion: Detection, Element, and Location in One-shot [18.80045630689047]
  We introduce a zero-shot pipeline that simultaneously detects if an image contains harmful content.<n>It identifies each critical element involved, and it localizes those elements with pixel-accurate masks.<n>The system processes an image in seconds, plugs seamlessly into existing VLM, and constitutes the first practical tool for fine-grained, explainable malicious-image moderation.
  arXiv  Detail & Related papers  (2025-12-04T09:18:14Z)
• UnSAMv2: Self-Supervised Learning Enables Segment Anything at Any Granularity [54.41309926099154]
  We introduce UnSAMv2, which enables segment anything at any granularity without human annotations.<n>UnSAMv2 extends the divide-and-conquer strategy of UnSAM by discovering abundant mask-granularity pairs.<n>We show that small amounts of unlabeled data with a granularity-aware self-supervised learning method can unlock the potential of vision foundation models.
  arXiv  Detail & Related papers  (2025-11-17T18:58:34Z)
• Pro2SAM: Mask Prompt to SAM with Grid Points for Weakly Supervised Object Localization [54.91271106816616]
  We propose an innovative mask prompt to SAM (Pro2SAM) network with grid points for WSOL task.<n>First, we devise a Global Token Transformer (GTFormer) to generate a coarse-grained foreground map as a flexible mask prompt.<n> Secondly, we deliver grid points as dense prompts into SAM to maximize the probability of foreground mask.
  arXiv  Detail & Related papers  (2025-05-08T02:44:53Z)
• OmniSAM: Omnidirectional Segment Anything Model for UDA in Panoramic Semantic Segmentation [38.730173012619304]
  Segment Anything Model 2 (SAM2) has emerged as a strong base model in various pinhole imaging segmentation tasks.<n>Applying it to $360circ$ domain, the significant field-of-view gap between pinhole ($70circ times 70circ$) and panoramic images ($180circ times 360circ$) poses unique challenges.<n>We propose a novel OmniSAM framework, which makes the first attempt to apply SAM2 for panoramic semantic segmentation.
  arXiv  Detail & Related papers  (2025-03-10T09:21:08Z)
• Segment Anything without Supervision [65.93211374889196]
  We present Unsupervised SAM (UnSAM) for promptable and automatic whole-image segmentation. UnSAM utilizes a divide-and-conquer strategy to "discover" the hierarchical structure of visual scenes. We show that supervised SAM can also benefit from our self-supervised labels.
  arXiv  Detail & Related papers  (2024-06-28T17:47:32Z)
• BA-SAM: Scalable Bias-Mode Attention Mask for Segment Anything Model [65.92173280096588]
  We address the challenge of image resolution variation for the Segment Anything Model (SAM) SAM, known for its zero-shot generalizability, exhibits a performance degradation when faced with datasets with varying image sizes. We present a bias-mode attention mask that allows each token to prioritize neighboring information.
  arXiv  Detail & Related papers  (2024-01-04T15:34:44Z)
• MobileSAMv2: Faster Segment Anything to Everything [32.36889746918654]
  Segment anything model (SAM) addresses two practical yet challenging segmentation tasks. SegAny predicts the masks for all objects on the image and SegEvery predicts masks for all objects on the image. We propose to improve SegEvery's efficiency by directly generating the final masks with only valid prompts.
  arXiv  Detail & Related papers  (2023-12-15T07:21:12Z)
• SAM-Deblur: Let Segment Anything Boost Image Deblurring [21.964258084389243]
  We propose a framework SAM-Deblur, integrating prior knowledge from the Segment Anything Model (SAM) into the deblurring task. Experimental results on the RealBlurJ, ReloBlur, and REDS datasets reveal that incorporating our methods improves GoPro-trained NAFNet's PSNR by 0.05, 0.96, and 7.03, respectively.
  arXiv  Detail & Related papers  (2023-09-05T14:33:56Z)
• Segment Anything in High Quality [116.39405160133315]
  We propose HQ-SAM, equipping SAM with the ability to accurately segment any object, while maintaining SAM's original promptable design, efficiency, and zero-shot generalizability. Our careful design reuses and preserves the pre-trained model weights of SAM, while only introducing minimal additional parameters and computation. We show the efficacy of HQ-SAM in a suite of 10 diverse segmentation datasets across different downstream tasks, where 8 out of them are evaluated in a zero-shot transfer protocol.
  arXiv  Detail & Related papers  (2023-06-02T14:23:59Z)
• Mask Transfiner for High-Quality Instance Segmentation [95.74244714914052]
  We present Mask Transfiner for high-quality and efficient instance segmentation. Our approach only processes detected error-prone tree nodes and self-corrects their errors in parallel. Our code and trained models will be available at http://vis.xyz/pub/transfiner.
  arXiv  Detail & Related papers  (2021-11-26T18:58:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.