Frustratingly Simple but Effective Zero-shot Detection and Segmentation: Analysis and a Strong Baseline

• URL: http://arxiv.org/abs/2302.07319v1
• Date: Tue, 14 Feb 2023 20:00:30 GMT
• Title: Frustratingly Simple but Effective Zero-shot Detection and Segmentation: Analysis and a Strong Baseline
• Authors: Siddhesh Khandelwal, Anirudth Nambirajan, Behjat Siddiquie, Jayan Eledath, Leonid Sigal
• Abstract summary: Methods for object detection and segmentation often require abundant instance-level annotations for training, which are time-consuming and expensive to collect. To address this, the task of zero-shot object detection (or segmentation) aims at learning effective methods for identifying and localizing object instances for the categories that have no supervision available. In this work, we extensively study these design choices, and carefully construct a simple yet extremely effective zero-shot recognition method.
• Score: 45.03824571286718
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Methods for object detection and segmentation often require abundant instance-level annotations for training, which are time-consuming and expensive to collect. To address this, the task of zero-shot object detection (or segmentation) aims at learning effective methods for identifying and localizing object instances for the categories that have no supervision available. Constructing architectures for these tasks requires choosing from a myriad of design options, ranging from the form of the class encoding used to transfer information from seen to unseen categories, to the nature of the function being optimized for learning. In this work, we extensively study these design choices, and carefully construct a simple yet extremely effective zero-shot recognition method. Through extensive experiments on the MSCOCO dataset on object detection and segmentation, we highlight that our proposed method outperforms existing, considerably more complex, architectures. Our findings and method, which we propose as a competitive future baseline, point towards the need to revisit some of the recent design trends in zero-shot detection / segmentation.

Related papers

• ISAR: A Benchmark for Single- and Few-Shot Object Instance Segmentation and Re-Identification [24.709695178222862]
  We propose ISAR, a benchmark and baseline method for single- and few-shot object identification. We provide a semi-synthetic dataset of video sequences with ground-truth semantic annotations. Our benchmark aligns with the emerging research trend of unifying Multi-Object Tracking, Video Object, and Re-identification.
  arXiv  Detail & Related papers  (2023-11-05T18:51:33Z)
• Proposal-Contrastive Pretraining for Object Detection from Fewer Data [11.416621957617334]
  We present Proposal Selection Contrast (ProSeCo), a novel unsupervised overall pretraining approach. ProSeCo uses the large number of object proposals generated by the detector for contrastive learning. We show that our method outperforms state of the art in unsupervised pretraining for object detection on standard and novel benchmarks.
  arXiv  Detail & Related papers  (2023-10-25T17:59:26Z)
• Few-Shot Object Detection: A Survey [4.266990593059534]
  Few-shot object detection aims to learn from few object instances of new categories in the target domain. We categorize approaches according to their training scheme and architectural layout. We introduce commonly used datasets and their evaluation protocols and analyze reported benchmark results.
  arXiv  Detail & Related papers  (2021-12-22T07:08:53Z)
• Discovery-and-Selection: Towards Optimal Multiple Instance Learning for Weakly Supervised Object Detection [86.86602297364826]
  We propose a discoveryand-selection approach fused with multiple instance learning (DS-MIL) Our proposed DS-MIL approach can consistently improve the baselines, reporting state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-10-18T07:06:57Z)
• Learning Open-World Object Proposals without Learning to Classify [110.30191531975804]
  We propose a classification-free Object Localization Network (OLN) which estimates the objectness of each region purely by how well the location and shape of a region overlaps with any ground-truth object. This simple strategy learns generalizable objectness and outperforms existing proposals on cross-category generalization.
  arXiv  Detail & Related papers  (2021-08-15T14:36:02Z)
• Meta Faster R-CNN: Towards Accurate Few-Shot Object Detection with Attentive Feature Alignment [33.446875089255876]
  Few-shot object detection (FSOD) aims to detect objects using only few examples. We propose a meta-learning based few-shot object detection method by transferring meta-knowledge learned from data-abundant base classes to data-scarce novel classes.
  arXiv  Detail & Related papers  (2021-04-15T19:01:27Z)
• Target-Aware Object Discovery and Association for Unsupervised Video Multi-Object Segmentation [79.6596425920849]
  This paper addresses the task of unsupervised video multi-object segmentation. We introduce a novel approach for more accurate and efficient unseen-temporal segmentation. We evaluate the proposed approach on DAVIS$_17$ and YouTube-VIS, and the results demonstrate that it outperforms state-of-the-art methods both in segmentation accuracy and inference speed.
  arXiv  Detail & Related papers  (2021-04-10T14:39:44Z)
• Slender Object Detection: Diagnoses and Improvements [74.40792217534]
  In this paper, we are concerned with the detection of a particular type of objects with extreme aspect ratios, namely textbfslender objects. For a classical object detection method, a drastic drop of $18.9%$ mAP on COCO is observed, if solely evaluated on slender objects.
  arXiv  Detail & Related papers  (2020-11-17T09:39:42Z)
• Weakly-Supervised Semantic Segmentation via Sub-category Exploration [73.03956876752868]
  We propose a simple yet effective approach to enforce the network to pay attention to other parts of an object. Specifically, we perform clustering on image features to generate pseudo sub-categories labels within each annotated parent class. We conduct extensive analysis to validate the proposed method and show that our approach performs favorably against the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-08-03T20:48:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.