SCOPE: Scene-Contextualized Incremental Few-Shot 3D Segmentation

• URL: http://arxiv.org/abs/2603.06572v2
• Date: Mon, 09 Mar 2026 11:24:46 GMT
• Title: SCOPE: Scene-Contextualized Incremental Few-Shot 3D Segmentation
• Abstract summary: SCOPE (Scene-COnised Prototype Enrichment) is a plug-and-play background-guided prototype enrichment framework.<n>It integrates with any prototype-based 3D segmentation method.<n>It achieves SOTA performance, improving novel-class IoU by up to 6.98% and 3.61%, and mean IoU by 2.25% and 1.70%, respectively.
• Score: 51.48871964840347
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Incremental Few-Shot (IFS) segmentation aims to learn new categories over time from only a few annotations. Although widely studied in 2D, it remains underexplored for 3D point clouds. Existing methods suffer from catastrophic forgetting or fail to learn discriminative prototypes under sparse supervision, and often overlook a key cue: novel categories frequently appear as unlabelled background in base-training scenes. We introduce SCOPE (Scene-COntextualised Prototype Enrichment), a plug-and-play background-guided prototype enrichment framework that integrates with any prototype-based 3D segmentation method. After base training, a class-agnostic segmentation model extracts high-confidence pseudo-instances from background regions to build a prototype pool. When novel classes arrive with few labelled samples, relevant background prototypes are retrieved and fused with few-shot prototypes to form enriched representations without retraining the backbone or adding parameters. Experiments on ScanNet and S3DIS show that SCOPE achieves SOTA performance, improving novel-class IoU by up to 6.98% and 3.61%, and mean IoU by 2.25% and 1.70%, respectively, while maintaining low forgetting. Code is available https://github.com/Surrey-UP-Lab/SCOPE.

Related papers

• Proto-FG3D: Prototype-based Interpretable Fine-Grained 3D Shape Classification [59.68055837500357]
  We propose the first prototype-based framework named Proto-FG3D for fine-grained 3D shape classification.<n>Proto-FG3D establishes joint multi-view and multi-category representation learning via Prototype Association.<n>Proto-FG3D surpasses state-of-the-art methods in accuracy, transparent predictions, and ad-hoc interpretability with visualizations.
  arXiv  Detail & Related papers  (2025-05-23T09:31:02Z)
• ProtoGuard-guided PROPEL: Class-Aware Prototype Enhancement and Progressive Labeling for Incremental 3D Point Cloud Segmentation [9.578322021478426]
  offline-trained segmentation models may lead to catastrophic forgetting of previously seen classes.<n>ProtoGuard and PROPEL are proposed to address the problem of catastrophic forgetting.<n>Our approach achieves remarkable results on both the S3DIS and ScanNet datasets.
  arXiv  Detail & Related papers  (2025-04-02T11:58:04Z)
• Rethinking Few-shot 3D Point Cloud Semantic Segmentation [62.80639841429669]
  This paper revisits few-shot 3D point cloud semantic segmentation (FS-PCS) We focus on two significant issues in the state-of-the-art: foreground leakage and sparse point distribution. To address these issues, we introduce a standardized FS-PCS setting, upon which a new benchmark is built.
  arXiv  Detail & Related papers  (2024-03-01T15:14:47Z)
• Prototype Adaption and Projection for Few- and Zero-shot 3D Point Cloud Semantic Segmentation [30.18333233940194]
  We address the challenging task of few-shot and zero-shot 3D point cloud semantic segmentation. Our proposed method surpasses state-of-the-art algorithms by a considerable 7.90% and 14.82% under the 2-way 1-shot setting on S3DIS and ScanNet benchmarks, respectively.
  arXiv  Detail & Related papers  (2023-05-23T17:58:05Z)
• You Only Need One Thing One Click: Self-Training for Weakly Supervised 3D Scene Understanding [107.06117227661204]
  We propose One Thing One Click'', meaning that the annotator only needs to label one point per object. We iteratively conduct the training and label propagation, facilitated by a graph propagation module. Our model can be compatible to 3D instance segmentation equipped with a point-clustering strategy.
  arXiv  Detail & Related papers  (2023-03-26T13:57:00Z)
• PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Models [56.324516906160234]
  Generalizable 3D part segmentation is important but challenging in vision and robotics. This paper explores an alternative way for low-shot part segmentation of 3D point clouds by leveraging a pretrained image-language model, GLIP. We transfer the rich knowledge from 2D to 3D through GLIP-based part detection on point cloud rendering and a novel 2D-to-3D label lifting algorithm.
  arXiv  Detail & Related papers  (2022-12-03T06:59:01Z)
• Prototypical VoteNet for Few-Shot 3D Point Cloud Object Detection [37.48935478836176]
  Prototypical VoteNet is a few-shot 3D point cloud object detection approach. It incorporates two new modules: Prototypical Vote Module (PVM) and Prototypical Head Module (PHM)
  arXiv  Detail & Related papers  (2022-10-11T16:25:38Z)
• COARSE3D: Class-Prototypes for Contrastive Learning in Weakly-Supervised 3D Point Cloud Segmentation [16.072116380353393]
  COARSE3D is a novel architecture-agnostic contrastive learning strategy for 3D segmentation. We leverage a prototype memory bank capturing class-wise global dataset information efficiently into a small number of prototypes acting as keys. Experiments show we outperform baselines on three challenging real-world outdoor datasets, working with as low as 0.001% annotations.
  arXiv  Detail & Related papers  (2022-10-04T17:54:53Z)
• Rethinking Semantic Segmentation: A Prototype View [126.59244185849838]
  We present a nonparametric semantic segmentation model based on non-learnable prototypes. Our framework yields compelling results over several datasets. We expect this work will provoke a rethink of the current de facto semantic segmentation model design.
  arXiv  Detail & Related papers  (2022-03-28T21:15:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.