Weakly Supervised Knowledge Transfer with Probabilistic Logical Reasoning for Object Detection

• URL: http://arxiv.org/abs/2303.05148v1
• Date: Thu, 9 Mar 2023 10:03:02 GMT
• Title: Weakly Supervised Knowledge Transfer with Probabilistic Logical Reasoning for Object Detection
• Abstract summary: Training object detection models usually requires instance-level annotations, such as the positions and labels of all objects present in each image. Such supervision is unfortunately not always available and, more often, only image-level information is provided, also known as weak supervision. We propose ProbKT, a framework that allows to train object detection models with arbitrary types of weak supervision.
• Score: 6.88204255655161
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Training object detection models usually requires instance-level annotations, such as the positions and labels of all objects present in each image. Such supervision is unfortunately not always available and, more often, only image-level information is provided, also known as weak supervision. Recent works have addressed this limitation by leveraging knowledge from a richly annotated domain. However, the scope of weak supervision supported by these approaches has been very restrictive, preventing them to use all available information. In this work, we propose ProbKT, a framework based on probabilistic logical reasoning that allows to train object detection models with arbitrary types of weak supervision. We empirically show on different datasets that using all available information is beneficial as our ProbKT leads to significant improvement on target domain and better generalization compared to existing baselines. We also showcase the ability of our approach to handle complex logic statements as supervision signal.

Related papers

• SPWOOD: Sparse Partial Weakly-Supervised Oriented Object Detection [19.35154888756369]
  A consistent trend throughout the research of oriented object detection has been the pursuit of maintaining comparable performance with fewer and weaker annotations.<n>This is particularly crucial in the remote sensing domain, where the dense object distribution and a wide variety of categories contribute to prohibitively high costs.<n>We introduce the first Sparse Partial Weakly-Supervised Oriented Object Detection framework, designed to efficiently leverage only a few weakly-labeled data and plenty of unlabeled data.
  arXiv  Detail & Related papers  (2026-02-03T15:21:01Z)
• From Objects to Events: Unlocking Complex Visual Understanding in Object Detectors via LLM-guided Symbolic Reasoning [71.41062111470414]
  Current object detectors excel at entity localization and classification, yet exhibit inherent limitations in event recognition capabilities.<n>We present a novel framework that expands the capability of standard object detectors beyond mere object recognition to complex event understanding.<n>Our key innovation lies in bridging the semantic gap between object detection and event understanding without requiring expensive task-specific training.
  arXiv  Detail & Related papers  (2025-02-09T10:30:54Z)
• Finding Dino: A plug-and-play framework for unsupervised detection of out-of-distribution objects using prototypes [12.82756672393553]
  PRototype-based zero-shot OOD detection Without Labels (PROWL) We present PRototype-based zero-shot OOD detection Without Labels (PROWL) It is an inference-based method that does not require training on the domain dataset. We also demonstrate its suitability for other domains such as rail and maritime scenes.
  arXiv  Detail & Related papers  (2024-04-11T11:55:42Z)
• Towards End-to-End Unsupervised Saliency Detection with Self-Supervised Top-Down Context [25.85453873366275]
  We propose a self-supervised end-to-end salient object detection framework via top-down context. We exploit the self-localization from the deepest feature to construct the location maps which are then leveraged to learn the most instructive segmentation guidance. Our method achieves leading performance among the recent end-to-end methods and most of the multi-stage solutions.
  arXiv  Detail & Related papers  (2023-10-14T08:43:22Z)
• Comparing AutoML and Deep Learning Methods for Condition Monitoring using Realistic Validation Scenarios [0.0]
  This study extensively compares conventional machine learning methods and deep learning for condition monitoring tasks using an AutoML toolbox. Experiments reveal consistent high accuracy in random K-fold cross-validation scenarios across all tested models. No clear winner emerges, indicating the presence of domain shift in real-world scenarios.
  arXiv  Detail & Related papers  (2023-08-28T14:57:29Z)
• Weakly-supervised Contrastive Learning for Unsupervised Object Discovery [52.696041556640516]
  Unsupervised object discovery is promising due to its ability to discover objects in a generic manner. We design a semantic-guided self-supervised learning model to extract high-level semantic features from images. We introduce Principal Component Analysis (PCA) to localize object regions.
  arXiv  Detail & Related papers  (2023-07-07T04:03:48Z)
• Object Discovery via Contrastive Learning for Weakly Supervised Object Detection [12.822548027334328]
  Weakly Supervised Object Detection is a task that detects objects in an image using a model trained only on image-level annotations. We propose a novel multiple instance labeling method called object discovery. We achieve new state-of-the-art results on MS-COCO 2014 and 2017 as well as PASCAL VOC 2012, and competitive results on PASCAL VOC 2007.
  arXiv  Detail & Related papers  (2022-08-16T07:36:12Z)
• Robust Object Detection via Instance-Level Temporal Cycle Confusion [89.1027433760578]
  We study the effectiveness of auxiliary self-supervised tasks to improve the out-of-distribution generalization of object detectors. Inspired by the principle of maximum entropy, we introduce a novel self-supervised task, instance-level temporal cycle confusion (CycConf) For each object, the task is to find the most different object proposals in the adjacent frame in a video and then cycle back to itself for self-supervision.
  arXiv  Detail & Related papers  (2021-04-16T21:35:08Z)
• Disambiguation of weak supervision with exponential convergence rates [88.99819200562784]
  In supervised learning, data are annotated with incomplete yet discriminative information. In this paper, we focus on partial labelling, an instance of weak supervision where, from a given input, we are given a set of potential targets. We propose an empirical disambiguation algorithm to recover full supervision from weak supervision.
  arXiv  Detail & Related papers  (2021-02-04T18:14:32Z)
• Open-Vocabulary Object Detection Using Captions [42.76261152761722]
  Open-vocabulary object detection is more general, more practical, and more effective than weakly supervised and zero-shot approaches. We show that the proposed method can detect and localize objects for which no bounding box annotation is provided during training, at a significantly higher accuracy than zero-shot approaches.
  arXiv  Detail & Related papers  (2020-11-20T23:05:46Z)
• Weakly-supervised Salient Instance Detection [65.0408760733005]
  We present the first weakly-supervised approach to the salient instance detection problem. We propose a novel weakly-supervised network with three branches: a Saliency Detection Branch leveraging class consistency information to locate candidate objects; a Boundary Detection Branch exploiting class discrepancy information to delineate object boundaries; and a Centroid Detection Branch using subitizing information to detect salient instance centroids.
  arXiv  Detail & Related papers  (2020-09-29T09:47:23Z)
• UniT: Unified Knowledge Transfer for Any-shot Object Detection and Segmentation [52.487469544343305]
  Methods for object detection and segmentation rely on large scale instance-level annotations for training. We propose an intuitive and unified semi-supervised model that is applicable to a range of supervision.
  arXiv  Detail & Related papers  (2020-06-12T22:45:47Z)
• Structured Prediction with Partial Labelling through the Infimum Loss [85.4940853372503]
  The goal of weak supervision is to enable models to learn using only forms of labelling which are cheaper to collect. This is a type of incomplete annotation where, for each datapoint, supervision is cast as a set of labels containing the real one. This paper provides a unified framework based on structured prediction and on the concept of infimum loss to deal with partial labelling.
  arXiv  Detail & Related papers  (2020-03-02T13:59:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.