UFO$^2$: A Unified Framework towards Omni-supervised Object Detection

• URL: http://arxiv.org/abs/2010.10804v1
• Date: Wed, 21 Oct 2020 07:46:30 GMT
• Title: UFO$^2$: A Unified Framework towards Omni-supervised Object Detection
• Abstract summary: We present UFO$2$, a unified object detection framework that can handle different forms of supervision simultaneously. Specifically, UFO$2$ incorporates strong supervision (e.g., boxes), various forms of partial supervision (e.g., class tags, points, and scribbles) and unlabeled data.
• Score: 175.9693271392461
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Existing work on object detection often relies on a single form of annotation: the model is trained using either accurate yet costly bounding boxes or cheaper but less expressive image-level tags. However, real-world annotations are often diverse in form, which challenges these existing works. In this paper, we present UFO$^2$, a unified object detection framework that can handle different forms of supervision simultaneously. Specifically, UFO$^2$ incorporates strong supervision (e.g., boxes), various forms of partial supervision (e.g., class tags, points, and scribbles), and unlabeled data. Through rigorous evaluations, we demonstrate that each form of label can be utilized to either train a model from scratch or to further improve a pre-trained model. We also use UFO$^2$ to investigate budget-aware omni-supervised learning, i.e., various annotation policies are studied under a fixed annotation budget: we show that competitive performance needs no strong labels for all data. Finally, we demonstrate the generalization of UFO$^2$, detecting more than 1,000 different objects without bounding box annotations.

Related papers

• Embodied Active Learning under Limited Annotation and Navigation Budget for Object Detection [15.789452723204867]
  This paper studies how to adapt a computer vision object detector to an unknown environment under both a robot navigation time and annotation budget constraint.<n>We leverage spatial consistency to identify images with inconsistent labels, which are likely to provide the greatest improvement to the vision model.
  arXiv  Detail & Related papers  (2026-07-17T14:07:46Z)
• VK-Det: Visual Knowledge Guided Prototype Learning for Open-Vocabulary Aerial Object Detection [6.72903082348742]
  We propose a text-guided open-vocabulary object $textbfDet$ection framework.<n>We discover and leverage vision encoder's inherent informative region perception to attain fine-grained localization and adaptive distillation.<n>Experiments show state-of-the-art performance, achieving 30.1 $mathrmmAPN$ on DIOR and 23.3 $mathrmmAPN$ on DOTA, outperforming even extra supervised methods.
  arXiv  Detail & Related papers  (2025-11-22T14:19:59Z)
• Exploiting Unlabeled Data with Multiple Expert Teachers for Open Vocabulary Aerial Object Detection and Its Orientation Adaptation [58.37525311718006]
  We put forth a novel formulation of the aerial object detection problem, namely open-vocabulary aerial object detection (OVAD) We propose CastDet, a CLIP-activated student-teacher detection framework that serves as the first OVAD detector specifically designed for the challenging aerial scenario. Our framework integrates a robust localization teacher along with several box selection strategies to generate high-quality proposals for novel objects.
  arXiv  Detail & Related papers  (2024-11-04T12:59:13Z)
• Robot Instance Segmentation with Few Annotations for Grasping [10.005879464111915]
  We propose a novel framework that combines Semi-Supervised Learning (SSL) with Learning Through Interaction (LTI) Our approach exploits partially annotated data through self-supervision and incorporates temporal context using pseudo-sequences generated from unlabeled still images. We validate our method on two common benchmarks, ARMBench mix-object-tote and OCID, where it achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-07-01T13:58:32Z)
• GlanceVAD: Exploring Glance Supervision for Label-efficient Video Anomaly Detection [36.73022075416943]
  We present a novel labeling paradigm, termed "glance annotation", to achieve a better balance between anomaly detection accuracy and annotation cost. To assess its effectiveness, we manually annotate the glance annotations for two standard video anomaly detection datasets: UCF-Crime and XD-Violence. We also propose a customized GlanceVAD method, that leverages ssian kernels as the basic unit to compose the temporal anomaly distribution.
  arXiv  Detail & Related papers  (2024-03-10T09:57:10Z)
• Weakly Supervised Knowledge Transfer with Probabilistic Logical Reasoning for Object Detection [6.88204255655161]
  Training object detection models usually requires instance-level annotations, such as the positions and labels of all objects present in each image. Such supervision is unfortunately not always available and, more often, only image-level information is provided, also known as weak supervision. We propose ProbKT, a framework that allows to train object detection models with arbitrary types of weak supervision.
  arXiv  Detail & Related papers  (2023-03-09T10:03:02Z)
• Open World DETR: Transformer based Open World Object Detection [60.64535309016623]
  We propose a two-stage training approach named Open World DETR for open world object detection based on Deformable DETR. We fine-tune the class-specific components of the model with a multi-view self-labeling strategy and a consistency constraint. Our proposed method outperforms other state-of-the-art open world object detection methods by a large margin.
  arXiv  Detail & Related papers  (2022-12-06T13:39:30Z)
• Exploiting Unlabeled Data with Vision and Language Models for Object Detection [64.94365501586118]
  Building robust and generic object detection frameworks requires scaling to larger label spaces and bigger training datasets. We propose a novel method that leverages the rich semantics available in recent vision and language models to localize and classify objects in unlabeled images. We demonstrate the value of the generated pseudo labels in two specific tasks, open-vocabulary detection and semi-supervised object detection.
  arXiv  Detail & Related papers  (2022-07-18T21:47:15Z)
• Omni-DETR: Omni-Supervised Object Detection with Transformers [165.4190908259015]
  We consider the problem of omni-supervised object detection, which can use unlabeled, fully labeled and weakly labeled annotations. Under this unified architecture, different types of weak labels can be leveraged to generate accurate pseudo labels. We have found that weak annotations can help to improve detection performance and a mixture of them can achieve a better trade-off between annotation cost and accuracy.
  arXiv  Detail & Related papers  (2022-03-30T06:36:09Z)
• Explicitly Modeling the Discriminability for Instance-Aware Visual Object Tracking [13.311777431243296]
  We propose a novel Instance-Aware Tracker (IAT) to excavate the discriminability of feature representations. We implement two variants of the proposed IAT, including a video-level one and an object-level one. Both versions achieve leading results against state-of-the-art methods while running at 30FPS.
  arXiv  Detail & Related papers  (2021-10-28T11:24:01Z)
• UniT: Unified Knowledge Transfer for Any-shot Object Detection and Segmentation [52.487469544343305]
  Methods for object detection and segmentation rely on large scale instance-level annotations for training. We propose an intuitive and unified semi-supervised model that is applicable to a range of supervision.
  arXiv  Detail & Related papers  (2020-06-12T22:45:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.