Learning What Not to Segment: A New Perspective on Few-Shot Segmentation
- URL: http://arxiv.org/abs/2203.07615v1
- Date: Tue, 15 Mar 2022 03:08:27 GMT
- Title: Learning What Not to Segment: A New Perspective on Few-Shot Segmentation
- Authors: Chunbo Lang, Gong Cheng, Binfei Tu, Junwei Han
- Abstract summary: Recently few-shot segmentation (FSS) has been extensively developed.
This paper proposes a fresh and straightforward insight to alleviate the problem.
In light of the unique nature of the proposed approach, we also extend it to a more realistic but challenging setting.
- Score: 63.910211095033596
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Recently few-shot segmentation (FSS) has been extensively developed. Most
previous works strive to achieve generalization through the meta-learning
framework derived from classification tasks; however, the trained models are
biased towards the seen classes instead of being ideally class-agnostic, thus
hindering the recognition of new concepts. This paper proposes a fresh and
straightforward insight to alleviate the problem. Specifically, we apply an
additional branch (base learner) to the conventional FSS model (meta learner)
to explicitly identify the targets of base classes, i.e., the regions that do
not need to be segmented. Then, the coarse results output by these two learners
in parallel are adaptively integrated to yield precise segmentation prediction.
Considering the sensitivity of meta learner, we further introduce an adjustment
factor to estimate the scene differences between the input image pairs for
facilitating the model ensemble forecasting. The substantial performance gains
on PASCAL-5i and COCO-20i verify the effectiveness, and surprisingly, our
versatile scheme sets a new state-of-the-art even with two plain learners.
Moreover, in light of the unique nature of the proposed approach, we also
extend it to a more realistic but challenging setting, i.e., generalized FSS,
where the pixels of both base and novel classes are required to be determined.
The source code is available at github.com/chunbolang/BAM.
Related papers
- Prototypical Kernel Learning and Open-set Foreground Perception for
Generalized Few-shot Semantic Segmentation [7.707161030443157]
Generalized Few-shot Semantic (GFSS) extends Few-shot Semantic aggregation to segment unseen classes and seen classes during evaluation.
We address the aforementioned problems by jointing the prototypical kernel learning and open-set perception.
In addition, a foreground contextual perception module cooperating with conditional bias based inference is adopted to perform class-agnostic as well as open-set foreground detection.
arXiv Detail & Related papers (2023-08-09T13:38:52Z) - Few-shot Image Classification based on Gradual Machine Learning [6.935034849731568]
Few-shot image classification aims to accurately classify unlabeled images using only a few labeled samples.
We propose a novel approach based on the non-i.i.d paradigm of gradual machine learning (GML)
We show that the proposed approach can improve the SOTA performance by 1-5% in terms of accuracy.
arXiv Detail & Related papers (2023-07-28T12:30:41Z) - DiGeo: Discriminative Geometry-Aware Learning for Generalized Few-Shot
Object Detection [39.937724871284665]
Generalized few-shot object detection aims to achieve precise detection on both base classes with abundant annotations and novel classes with limited training data.
Existing approaches enhance few-shot generalization with the sacrifice of base-class performance.
We propose a new training framework, DiGeo, to learn Geometry-aware features of inter-class separation and intra-class compactness.
arXiv Detail & Related papers (2023-03-16T22:37:09Z) - Activating the Discriminability of Novel Classes for Few-shot
Segmentation [48.542627940781095]
We propose to activate the discriminability of novel classes explicitly in both the feature encoding stage and the prediction stage for segmentation.
In the prediction stage for segmentation, we learn an Self-Refined Online Foreground-Background classifier (SROFB), which is able to refine itself using the high-confidence pixels of query image.
arXiv Detail & Related papers (2022-12-02T12:22:36Z) - Adaptive Fine-Grained Sketch-Based Image Retrieval [100.90633284767205]
Recent focus on Fine-Grained Sketch-Based Image Retrieval has shifted towards generalising a model to new categories.
In real-world applications, a trained FG-SBIR model is often applied to both new categories and different human sketchers.
We introduce a novel model-agnostic meta-learning (MAML) based framework with several key modifications.
arXiv Detail & Related papers (2022-07-04T21:07:20Z) - Class-Incremental Learning with Strong Pre-trained Models [97.84755144148535]
Class-incremental learning (CIL) has been widely studied under the setting of starting from a small number of classes (base classes)
We explore an understudied real-world setting of CIL that starts with a strong model pre-trained on a large number of base classes.
Our proposed method is robust and generalizes to all analyzed CIL settings.
arXiv Detail & Related papers (2022-04-07T17:58:07Z) - CAD: Co-Adapting Discriminative Features for Improved Few-Shot
Classification [11.894289991529496]
Few-shot classification is a challenging problem that aims to learn a model that can adapt to unseen classes given a few labeled samples.
Recent approaches pre-train a feature extractor, and then fine-tune for episodic meta-learning.
We propose a strategy to cross-attend and re-weight discriminative features for few-shot classification.
arXiv Detail & Related papers (2022-03-25T06:14:51Z) - Fine-grained Angular Contrastive Learning with Coarse Labels [72.80126601230447]
We introduce a novel 'Angular normalization' module that allows to effectively combine supervised and self-supervised contrastive pre-training.
This work will help to pave the way for future research on this new, challenging, and very practical topic of C2FS classification.
arXiv Detail & Related papers (2020-12-07T08:09:02Z) - Prior Guided Feature Enrichment Network for Few-Shot Segmentation [64.91560451900125]
State-of-the-art semantic segmentation methods require sufficient labeled data to achieve good results.
Few-shot segmentation is proposed to tackle this problem by learning a model that quickly adapts to new classes with a few labeled support samples.
Theses frameworks still face the challenge of generalization ability reduction on unseen classes due to inappropriate use of high-level semantic information.
arXiv Detail & Related papers (2020-08-04T10:41:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.