SELECT: SELEctive Context Transfer for Class-Incremental Semantic Segmentation

• URL: http://arxiv.org/abs/2608.30281v1
• Date: Mon, 31 Aug 2026 05:50:10 GMT
• Title: SELECT: SELEctive Context Transfer for Class-Incremental Semantic Segmentation
• Abstract summary: Class-Incremental Semantic (CISS) is fundamentally challenged by catastrophic forgetting and background shift.<n>We propose SELECT, which grounds each new class in a small set of semantically similar past classes.<n>Experiments on Pascal VOC and ADE20K show that SELECT consistently outperforms prior work.
• Score: 4.171845508984375
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Class-Incremental Semantic Segmentation (CISS) is fundamentally challenged by catastrophic forgetting and background shift, where learning new concepts degrades performance on previously seen classes. While existing methods attempt to balance stability (retaining old knowledge) and plasticity (learning new knowledge), they often fail to leverage prior knowledge effectively. These approaches typically rely on indiscriminate knowledge transfer or ambiguous initializations, which can dilute crucial semantic information. To overcome this limitation, we propose SELECT, a novel approach for Selective Context Transfer, which instead grounds each new class in a small set of semantically similar past classes. Its core is a Context Transfer Attention mechanism that aggregates the learned tokens from similar classes into a structured initialization for the new class. To ensure this transfer does not corrupt the borrowed representations, we add a controlled noise perturbation and a margin-based context-transfer loss that enforces separation between the new class token and its source tokens. Extensive experiments on Pascal VOC and ADE20K show that SELECT consistently outperforms prior work, achieving mIoU of 2.2% on VOC and 2.8% on ADE, providing an effective handle on the stability-plasticity dilemma. Code is available at https://github.com/avigupta2798/SELECT.

Related papers

• CoMBO: Conflict Mitigation via Branched Optimization for Class Incremental Segmentation [75.35841972192684]
  Effective Class Incremental (CIS) requires simultaneously mitigating catastrophic forgetting and ensuring sufficient plasticity to integrate new classes.<n>We introduce a novel approach, Conflict Mitigation via Branched Optimization(CoMBO)<n>Within this approach, we present the Query Conflict Reduction module, designed to explicitly refine queries for new classes.
  arXiv  Detail & Related papers  (2025-04-05T12:34:51Z)
• Early Preparation Pays Off: New Classifier Pre-tuning for Class Incremental Semantic Segmentation [13.62129805799111]
  Class incremental semantic segmentation aims to preserve old knowledge while learning new tasks. It is impeded by catastrophic forgetting and background shift issues. We propose a new classifier pre-tuning(NeST) method applied before the formal training process.
  arXiv  Detail & Related papers  (2024-07-19T09:19:29Z)
• Mitigating Background Shift in Class-Incremental Semantic Segmentation [18.604420743751643]
  Class-Incremental Semantic(CISS) aims to learn new classes without forgetting the old ones. We propose a background-class separation framework for CISS.
  arXiv  Detail & Related papers  (2024-07-16T15:44:37Z)
• Tendency-driven Mutual Exclusivity for Weakly Supervised Incremental Semantic Segmentation [56.1776710527814]
  Weakly Incremental Learning for Semantic (WILSS) leverages a pre-trained segmentation model to segment new classes using cost-effective and readily available image-level labels. A prevailing way to solve WILSS is the generation of seed areas for each new class, serving as a form of pixel-level supervision. We propose an innovative, tendency-driven relationship of mutual exclusivity, meticulously tailored to govern the behavior of the seed areas.
  arXiv  Detail & Related papers  (2024-04-18T08:23:24Z)
• Enhancing Visual Continual Learning with Language-Guided Supervision [76.38481740848434]
  Continual learning aims to empower models to learn new tasks without forgetting previously acquired knowledge. We argue that the scarce semantic information conveyed by the one-hot labels hampers the effective knowledge transfer across tasks. Specifically, we use PLMs to generate semantic targets for each class, which are frozen and serve as supervision signals.
  arXiv  Detail & Related papers  (2024-03-24T12:41:58Z)
• Activating the Discriminability of Novel Classes for Few-shot Segmentation [48.542627940781095]
  We propose to activate the discriminability of novel classes explicitly in both the feature encoding stage and the prediction stage for segmentation. In the prediction stage for segmentation, we learn an Self-Refined Online Foreground-Background classifier (SROFB), which is able to refine itself using the high-confidence pixels of query image.
  arXiv  Detail & Related papers  (2022-12-02T12:22:36Z)
• Decomposed Knowledge Distillation for Class-Incremental Semantic Segmentation [34.460973847554364]
  Class-incremental semantic segmentation (CISS) labels each pixel of an image with a corresponding object/stuff class continually. It is crucial to learn novel classes incrementally without forgetting previously learned knowledge. We introduce a CISS framework that alleviates the forgetting problem and facilitates learning novel classes effectively.
  arXiv  Detail & Related papers  (2022-10-12T06:15:51Z)
• Novel Class Discovery in Semantic Segmentation [104.30729847367104]
  We introduce a new setting of Novel Class Discovery in Semantic (NCDSS) It aims at segmenting unlabeled images containing new classes given prior knowledge from a labeled set of disjoint classes. In NCDSS, we need to distinguish the objects and background, and to handle the existence of multiple classes within an image. We propose the Entropy-based Uncertainty Modeling and Self-training (EUMS) framework to overcome noisy pseudo-labels.
  arXiv  Detail & Related papers  (2021-12-03T13:31:59Z)
• SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental Learning [19.152041362805985]
  We consider a class-incremental semantic segmentation (CISS) problem. We propose a new method, dubbed as SSUL-M (Semantic with Unknown Label with Memory), by carefully combining several techniques tailored for semantic segmentation. We show our method achieves significantly better performance than the recent state-of-the-art baselines on the standard benchmark datasets.
  arXiv  Detail & Related papers  (2021-06-22T06:40:26Z)
• Efficient Conditional GAN Transfer with Knowledge Propagation across Classes [85.38369543858516]
  CGANs provide new opportunities for knowledge transfer compared to unconditional setup. New classes may borrow knowledge from the related old classes, or share knowledge among themselves to improve the training. New GAN transfer method explicitly propagates the knowledge from the old classes to the new classes.
  arXiv  Detail & Related papers  (2021-02-12T18:55:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.