Frustratingly Simple Few-Shot Object Detection
- URL: http://arxiv.org/abs/2003.06957v1
- Date: Mon, 16 Mar 2020 00:29:14 GMT
- Title: Frustratingly Simple Few-Shot Object Detection
- Authors: Xin Wang, Thomas E. Huang, Trevor Darrell, Joseph E. Gonzalez, Fisher
Yu
- Abstract summary: We find that fine-tuning only the last layer of existing detectors on rare classes is crucial to the few-shot object detection task.
Such a simple approach outperforms the meta-learning methods by roughly 220 points on current benchmarks.
- Score: 98.42824677627581
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Detecting rare objects from a few examples is an emerging problem. Prior
works show meta-learning is a promising approach. But, fine-tuning techniques
have drawn scant attention. We find that fine-tuning only the last layer of
existing detectors on rare classes is crucial to the few-shot object detection
task. Such a simple approach outperforms the meta-learning methods by roughly
2~20 points on current benchmarks and sometimes even doubles the accuracy of
the prior methods. However, the high variance in the few samples often leads to
the unreliability of existing benchmarks. We revise the evaluation protocols by
sampling multiple groups of training examples to obtain stable comparisons and
build new benchmarks based on three datasets: PASCAL VOC, COCO and LVIS. Again,
our fine-tuning approach establishes a new state of the art on the revised
benchmarks. The code as well as the pretrained models are available at
https://github.com/ucbdrive/few-shot-object-detection.
Related papers
- Fast Hierarchical Learning for Few-Shot Object Detection [57.024072600597464]
Transfer learning approaches have recently achieved promising results on the few-shot detection task.
These approaches suffer from catastrophic forgetting'' issue due to finetuning of base detector.
We tackle the aforementioned issues in this work.
arXiv Detail & Related papers (2022-10-10T20:31:19Z) - Label, Verify, Correct: A Simple Few Shot Object Detection Method [93.84801062680786]
We introduce a simple pseudo-labelling method to source high-quality pseudo-annotations from a training set.
We present two novel methods to improve the precision of the pseudo-labelling process.
Our method achieves state-of-the-art or second-best performance compared to existing approaches.
arXiv Detail & Related papers (2021-12-10T18:59:06Z) - Plug-and-Play Few-shot Object Detection with Meta Strategy and Explicit
Localization Inference [78.41932738265345]
This paper proposes a plug detector that can accurately detect the objects of novel categories without fine-tuning process.
We introduce two explicit inferences into the localization process to reduce its dependence on annotated data.
It shows a significant lead in both efficiency, precision, and recall under varied evaluation protocols.
arXiv Detail & Related papers (2021-10-26T03:09:57Z) - A Closer Look at Few-Shot Video Classification: A New Baseline and
Benchmark [33.86872697028233]
We present an in-depth study on few-shot video classification by making three contributions.
First, we perform a consistent comparative study on the existing metric-based methods to figure out their limitations in representation learning.
Second, we discover that there is a high correlation between the novel action class and the ImageNet object class, which is problematic in the few-shot recognition setting.
Third, we present a new benchmark with more base data to facilitate future few-shot video classification without pre-training.
arXiv Detail & Related papers (2021-10-24T06:01:46Z) - Generalized Few-Shot Object Detection without Forgetting [17.719042946397487]
We propose a simple yet effective few-shot detector, Retentive R-CNN.
It consists of Bias-Balanced RPN to debias the pretrained RPN and Re-detector to find few-shot class objects without forgetting previous knowledge.
Our approach has demonstrated that the long desired never-forgetting learner is available in object detection.
arXiv Detail & Related papers (2021-05-20T03:25:29Z) - Few-shot Action Recognition with Prototype-centered Attentive Learning [88.10852114988829]
Prototype-centered Attentive Learning (PAL) model composed of two novel components.
First, a prototype-centered contrastive learning loss is introduced to complement the conventional query-centered learning objective.
Second, PAL integrates a attentive hybrid learning mechanism that can minimize the negative impacts of outliers.
arXiv Detail & Related papers (2021-01-20T11:48:12Z) - Any-Shot Object Detection [81.88153407655334]
'Any-shot detection' is where totally unseen and few-shot categories can simultaneously co-occur during inference.
We propose a unified any-shot detection model, that can concurrently learn to detect both zero-shot and few-shot object classes.
Our framework can also be used solely for Zero-shot detection and Few-shot detection tasks.
arXiv Detail & Related papers (2020-03-16T03:43:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.