Few-Shot Object Detection with Proposal Balance Refinement
- URL: http://arxiv.org/abs/2204.10527v1
- Date: Fri, 22 Apr 2022 06:44:15 GMT
- Title: Few-Shot Object Detection with Proposal Balance Refinement
- Authors: Sueyeon Kim, Woo-Jeoung Nam, Seong-Whan Lee
- Abstract summary: Few-shot object detection has gained significant attention in recent years.
In this paper, we analyze the lack of intersection-over-union variations induced by a biased distribution of novel samples.
We present a few-shot object detection model with proposal balance refinement, a simple yet effective approach in learning object proposals.
- Score: 21.89786914625517
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Few-shot object detection has gained significant attention in recent years as
it has the potential to greatly reduce the reliance on large amounts of
manually annotated bounding boxes. While most existing few-shot object
detection literature primarily focuses on bounding box classification by
obtaining as discriminative feature embeddings as possible, we emphasize the
necessity of handling the lack of intersection-over-union (IoU) variations
induced by a biased distribution of novel samples. In this paper, we analyze
the IoU imbalance that is caused by the relatively high number of low-quality
region proposals, and reveal that it plays a critical role in improving
few-shot learning capabilities. The well-known two stage fine-tuning technique
causes insufficient quality and quantity of the novel positive samples, which
hinders the effective object detection of unseen novel classes. To alleviate
this issue, we present a few-shot object detection model with proposal balance
refinement, a simple yet effective approach in learning object proposals using
an auxiliary sequential bounding box refinement process. This process enables
the detector to be optimized on the various IoU scores through additional novel
class samples. To fully exploit our sequential stage architecture, we revise
the fine-tuning strategy and expose the Region Proposal Network to the novel
classes in order to provide increased learning opportunities for the
region-of-interest (RoI) classifiers and regressors. Our extensive assessments
on PASCAL VOC and COCO demonstrate that our framework substantially outperforms
other existing few-shot object detection approaches.
Related papers
- Training-free Boost for Open-Vocabulary Object Detection with Confidence Aggregation [3.0899016152680754]
Open-vocabulary object detection (OVOD) aims at localizing and recognizing visual objects from novel classes unseen at the training time.
This paper systematically investigates this problem with the commonly-adopted two-stage OVOD paradigm.
To alleviate this problem, this paper introduces two advanced measures to adjust confidence scores and conserve erroneously dismissed objects.
arXiv Detail & Related papers (2024-04-12T17:02:56Z) - Small Object Detection via Coarse-to-fine Proposal Generation and
Imitation Learning [52.06176253457522]
We propose a two-stage framework tailored for small object detection based on the Coarse-to-fine pipeline and Feature Imitation learning.
CFINet achieves state-of-the-art performance on the large-scale small object detection benchmarks, SODA-D and SODA-A.
arXiv Detail & Related papers (2023-08-18T13:13:09Z) - Incremental-DETR: Incremental Few-Shot Object Detection via
Self-Supervised Learning [60.64535309016623]
We propose the Incremental-DETR that does incremental few-shot object detection via fine-tuning and self-supervised learning on the DETR object detector.
To alleviate severe over-fitting with few novel class data, we first fine-tune the class-specific components of DETR with self-supervision.
We further introduce a incremental few-shot fine-tuning strategy with knowledge distillation on the class-specific components of DETR to encourage the network in detecting novel classes without catastrophic forgetting.
arXiv Detail & Related papers (2022-05-09T05:08:08Z) - Towards Generalized and Incremental Few-Shot Object Detection [9.033533653482529]
A novel Incremental Few-Shot Object Detection (iFSOD) method is proposed to enable the effective continual learning from few-shot samples.
Specifically, a Double-Branch Framework (DBF) is proposed to decouple the feature representation of base and novel (few-shot) class.
We conduct experiments on both Pascal VOC and MS-COCO, which demonstrate that our method can effectively solve the problem of incremental few-shot detection.
arXiv Detail & Related papers (2021-09-23T12:38:09Z) - Hallucination Improves Few-Shot Object Detection [15.932703834032456]
A critical factor in improving few-shot detection is to address the lack of variation in training data.
We propose to build a better model of variation for novel classes by transferring the shared within-class variation from base classes.
Our approach yields significant performance improvements on two state-of-the-art few-shot detectors with different proposal generation procedures.
arXiv Detail & Related papers (2021-05-04T05:19:53Z) - One-Shot Object Detection without Fine-Tuning [62.39210447209698]
We introduce a two-stage model consisting of a first stage Matching-FCOS network and a second stage Structure-Aware Relation Module.
We also propose novel training strategies that effectively improve detection performance.
Our method exceeds the state-of-the-art one-shot performance consistently on multiple datasets.
arXiv Detail & Related papers (2020-05-08T01:59:23Z) - Exploring Bottom-up and Top-down Cues with Attentive Learning for Webly
Supervised Object Detection [76.9756607002489]
We propose a novel webly supervised object detection (WebSOD) method for novel classes.
Our proposed method combines bottom-up and top-down cues for novel class detection.
We demonstrate our proposed method on PASCAL VOC dataset with three different novel/base splits.
arXiv Detail & Related papers (2020-03-22T03:11:24Z) - Any-Shot Object Detection [81.88153407655334]
'Any-shot detection' is where totally unseen and few-shot categories can simultaneously co-occur during inference.
We propose a unified any-shot detection model, that can concurrently learn to detect both zero-shot and few-shot object classes.
Our framework can also be used solely for Zero-shot detection and Few-shot detection tasks.
arXiv Detail & Related papers (2020-03-16T03:43:15Z) - Incremental Few-Shot Object Detection [96.02543873402813]
OpeN-ended Centre nEt is a detector for incrementally learning to detect class objects with few examples.
ONCE fully respects the incremental learning paradigm, with novel class registration requiring only a single forward pass of few-shot training samples.
arXiv Detail & Related papers (2020-03-10T12:56:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.