SLIP: Segmentation with Low-latency Interactive Prompting for 3D Medical Images

• URL: http://arxiv.org/abs/2607.22332v1
• Date: Fri, 24 Jul 2026 14:12:02 GMT
• Title: SLIP: Segmentation with Low-latency Interactive Prompting for 3D Medical Images
• Abstract summary: We present SLIP, an end-to-end trainable framework for interactive 3D medical image segmentation.<n>By separating image representation from interactive reasoning, SLIP substantially reduces interaction latency.<n>SLIP achieves SOTA interactive segmentation performance across 13 public datasets.
• Score: 58.57521567704563
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Interactive deep image segmentation enables efficient medical image annotation by iteratively refining predictions from user prompts, such as positive and negative clicks. Recent patch-based methods, including nnInteractive, achieve strong segmentation performance but remain limited in annotation workflows by high interaction latency, limited responsiveness to successive interactions, and the lack of support for reversible prompting. Furthermore, evaluation relies predominantly on simulated rather than controlled real-user interaction studies. We present SLIP, an end-to-end trainable framework for interactive 3D medical image segmentation that decouples image encoding from prompt-guided refinement. Image features are computed once and reused, while a lightweight patch memory bank maintains an interaction-aware segmentation state shared across patches. This representation enables prediction updates by propagating interaction context throughout the image, supports reversible prompting without recomputing image features, and substantially reduces interaction latency. By separating image representation from interactive reasoning, SLIP remains compatible with a wide range of image encoders. We train a single SLIP model for general interactive segmentation across diverse anatomical structures and imaging modalities. Beyond standard simulated evaluation, we conduct a controlled prospective user study comparing manual segmentation, nnInteractive, and SLIP across three clinical annotation tasks, six expert participants, and subjective usability measures, addressing the limited human validation of interactive segmentation methods. SLIP achieves SOTA interactive segmentation performance across 13 public datasets while providing lower interaction latency, greater responsiveness, support for reversible prompting, and higher user preference than existing approaches.

Related papers

• Towards Voxel Spacing Consistency for Medical Image Segmentation [56.992050146446495]
  We study the correlation between image resampling and segmentation, and propose Consispace, a semantic-aware resampling framework.<n> Consispace achieves consistent voxel spacing in the axial direction while preserving anatomical and semantic consistency.
  arXiv  Detail & Related papers  (2026-06-30T15:42:23Z)
• MAIS: Memory-Attention for Interactive Segmentation [0.8678845273264675]
  Vision Transformer (ViT)-based models achieve state-of-the-art performance using user clicks and prior masks as prompts.<n>Existing methods treat interactions as independent events, leading to redundant corrections and limited refinement gains.<n>We address this by introducing Memory-Attention mechanism for Interactive that stores past user inputs and segmentation states, enabling temporal context integration.
  arXiv  Detail & Related papers  (2025-05-12T12:48:27Z)
• Refining Segmentation On-the-Fly: An Interactive Framework for Point Cloud Semantic Segmentation [9.832150567595718]
  We present the first interactive framework for point cloud semantic segmentation, named InterPCSeg. We develop an interaction simulation scheme tailored for the interactive point cloud semantic segmentation task. We evaluate our framework on the S3DIS and ScanNet datasets with off-the-shelf segmentation networks.
  arXiv  Detail & Related papers  (2024-03-11T03:24:58Z)
• Scribble-based fast weak-supervision and interactive corrections for segmenting whole slide images [5.276054618115727]
  This paper proposes a dynamic interactive and weakly supervised segmentation method with minimal user interactions to address two major challenges in the segmentation of whole slide histopathology images.
  arXiv  Detail & Related papers  (2024-02-13T09:57:35Z)
• Disentangled Interaction Representation for One-Stage Human-Object Interaction Detection [70.96299509159981]
  Human-Object Interaction (HOI) detection is a core task for human-centric image understanding. Recent one-stage methods adopt a transformer decoder to collect image-wide cues that are useful for interaction prediction. Traditional two-stage methods benefit significantly from their ability to compose interaction features in a disentangled and explainable manner.
  arXiv  Detail & Related papers  (2023-12-04T08:02:59Z)
• PE-MED: Prompt Enhancement for Interactive Medical Image Segmentation [9.744164910887223]
  We introduce a novel framework equipped with prompt enhancement, called PE-MED, for interactive medical image segmentation. First, we introduce a Self-Loop strategy to generate warm initial segmentation results based on the first prompt. Second, we propose a novel Prompt Attention Learning Module (PALM) to mine useful prompt information in one interaction.
  arXiv  Detail & Related papers  (2023-08-26T03:11:48Z)
• Feature Decoupling-Recycling Network for Fast Interactive Segmentation [79.22497777645806]
  Recent interactive segmentation methods iteratively take source image, user guidance and previously predicted mask as the input. We propose the Feature Decoupling-Recycling Network (FDRN), which decouples the modeling components based on their intrinsic discrepancies.
  arXiv  Detail & Related papers  (2023-08-07T12:26:34Z)
• InterFormer: Real-time Interactive Image Segmentation [80.45763765116175]
  Interactive image segmentation enables annotators to efficiently perform pixel-level annotation for segmentation tasks. The existing interactive segmentation pipeline suffers from inefficient computations of interactive models. We propose a method named InterFormer that follows a new pipeline to address these issues.
  arXiv  Detail & Related papers  (2023-04-06T08:57:00Z)
• FILIP: Fine-grained Interactive Language-Image Pre-Training [106.19474076935363]
  Fine-grained Interactive Language-Image Pre-training achieves finer-level alignment through a cross-modal late interaction mechanism. We construct a new large-scale image-text pair dataset called FILIP300M for pre-training. Experiments show that FILIP achieves state-of-the-art performance on multiple downstream vision-language tasks.
  arXiv  Detail & Related papers  (2021-11-09T17:15:38Z)
• Multi-Stage Fusion for One-Click Segmentation [20.00726292545008]
  We propose a new multi-stage guidance framework for interactive segmentation. Our proposed framework has a negligible increase in parameter count compared to early-fusion frameworks.
  arXiv  Detail & Related papers  (2020-10-19T17:07:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.