Looking Beyond the Known: Towards a Data Discovery Guided Open-World Object Detection

• URL: http://arxiv.org/abs/2510.00303v1
• Date: Tue, 30 Sep 2025 21:48:08 GMT
• Title: Looking Beyond the Known: Towards a Data Discovery Guided Open-World Object Detection
• Authors: Anay Majee, Amitesh Gangrade, Rishabh Iyer,
• Abstract summary: Open-World Object Detection (OWOD) enriches traditional object detectors by enabling continual discovery and integration of unknown objects via human guidance.<n>Existing OWOD approaches frequently suffer from semantic confusion between known and unknown classes, alongside catastrophic forgetting, leading to diminished unknown recall and degraded known-class accuracy.<n>We propose Combinatorial Open-World Detection (CROWD), a unified framework reformulating unknown object discovery and adaptation as an interwoven (set-based) data-discovery and representation learning task.
• Score: 3.9890357781493595
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Open-World Object Detection (OWOD) enriches traditional object detectors by enabling continual discovery and integration of unknown objects via human guidance. However, existing OWOD approaches frequently suffer from semantic confusion between known and unknown classes, alongside catastrophic forgetting, leading to diminished unknown recall and degraded known-class accuracy. To overcome these challenges, we propose Combinatorial Open-World Detection (CROWD), a unified framework reformulating unknown object discovery and adaptation as an interwoven combinatorial (set-based) data-discovery (CROWD-Discover) and representation learning (CROWD-Learn) task. CROWD-Discover strategically mines unknown instances by maximizing Submodular Conditional Gain (SCG) functions, selecting representative examples distinctly dissimilar from known objects. Subsequently, CROWD-Learn employs novel combinatorial objectives that jointly disentangle known and unknown representations while maintaining discriminative coherence among known classes, thus mitigating confusion and forgetting. Extensive evaluations on OWOD benchmarks illustrate that CROWD achieves improvements of 2.83% and 2.05% in known-class accuracy on M-OWODB and S-OWODB, respectively, and nearly 2.4x unknown recall compared to leading baselines.

Related papers

• Knowing the Unknown: Interpretable Open-World Object Detection via Concept Decomposition Model [51.81962097623522]
  Open-world object detection (OWOD) requires incrementally detecting known categories while reliably identifying unknown objects.<n>This paper aims to make the entire OWOD framework interpretable, enabling the detector to truly "knowing the unknown"
  arXiv  Detail & Related papers  (2026-02-24T07:08:47Z)
• In defense of the two-stage framework for open-set domain adaptive semantic segmentation [114.08201544572546]
  Open-Set Domain Adaptation for Semantic Training (OSDA-SS) requires both domain adaptation for known classes and the distinction of unknowns.<n>We propose SATS, a Separating-then-Adapting Training Strategy, which addresses OSDA-SS through two sequential steps: known/unknown separation and unknown-aware domain adaptation.<n>Our method ensures a balanced learning of discriminative features for both known and unknown classes, steering the model toward discovering truly unknown objects.
  arXiv  Detail & Related papers  (2026-01-04T08:58:03Z)
• Known Meets Unknown: Mitigating Overconfidence in Open Set Recognition [4.377912830814393]
  Open Set Recognition (OSR) requires models to accurately classify known classes and to effectively reject unknown samples.<n>When unknown samples are semantically similar to known classes, inter-class overlap in the feature space often causes models to assign unjustifiably high confidence to them.<n>We propose a framework that explicitly mitigates overconfidence caused by inter-class overlap.
  arXiv  Detail & Related papers  (2025-11-15T09:56:44Z)
• Open-Set Object Detection By Aligning Known Class Representations [24.708230848232432]
  Open-Set Object Detection (OSOD) has emerged as a contemporary research direction to address the detection of unknown objects.<n>We propose a new semantic clustering-based approach to facilitate a meaningful alignment of clusters in semantic space.<n>Our approach further incorporates an object focus module to predict objectness scores, which enhances the detection of unknown objects.
  arXiv  Detail & Related papers  (2024-12-30T04:26:56Z)
• UADet: A Remarkably Simple Yet Effective Uncertainty-Aware Open-Set Object Detection Framework [13.310007077914122]
  We tackle the problem of Open-Set Object Detection (OSOD), which aims to detect both known and unknown objects in unlabelled images.<n>We propose UADet, an Uncertainty-Aware Open-Set Object Detector that considers appearance and geometric uncertainty.
  arXiv  Detail & Related papers  (2024-12-12T12:38:33Z)
• Boosting Few-Shot Open-Set Object Detection via Prompt Learning and Robust Decision Boundary [10.054397736100245]
  Few-shot Open-set Object Detection (FOOD) poses a challenge in many open-world scenarios.<n>It aims to train an open-set detector to detect known objects while rejecting unknowns with scarce training samples.<n>Our method achieves superior performance over previous state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-06-26T15:48:24Z)
• Semi-supervised Open-World Object Detection [74.95267079505145]
  We introduce a more realistic formulation, named semi-supervised open-world detection (SS-OWOD) We demonstrate that the performance of the state-of-the-art OWOD detector dramatically deteriorates in the proposed SS-OWOD setting. Our experiments on 4 datasets including MS COCO, PASCAL, Objects365 and DOTA demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2024-02-25T07:12:51Z)
• Activate and Reject: Towards Safe Domain Generalization under Category Shift [71.95548187205736]
  We study a practical problem of Domain Generalization under Category Shift (DGCS) It aims to simultaneously detect unknown-class samples and classify known-class samples in the target domains. Compared to prior DG works, we face two new challenges: 1) how to learn the concept of unknown'' during training with only source known-class samples, and 2) how to adapt the source-trained model to unseen environments.
  arXiv  Detail & Related papers  (2023-10-07T07:53:12Z)
• Unsupervised Recognition of Unknown Objects for Open-World Object Detection [28.787586991713535]
  Open-World Object Detection (OWOD) extends object detection problem to a realistic and dynamic scenario. Current OWOD models, such as ORE and OW-DETR, focus on pseudo-labeling regions with high objectness scores as unknowns. This paper proposes a novel approach that learns an unsupervised discriminative model to recognize true unknown objects.
  arXiv  Detail & Related papers  (2023-08-31T08:17:29Z)
• Learning Classifiers of Prototypes and Reciprocal Points for Universal Domain Adaptation [79.62038105814658]
  Universal Domain aims to transfer the knowledge between datasets by handling two shifts: domain-shift and categoryshift. Main challenge is correctly distinguishing the unknown target samples while adapting the distribution of known class knowledge from source to target. Most existing methods approach this problem by first training the target adapted known and then relying on the single threshold to distinguish unknown target samples.
  arXiv  Detail & Related papers  (2022-12-16T09:01:57Z)
• Open World DETR: Transformer based Open World Object Detection [60.64535309016623]
  We propose a two-stage training approach named Open World DETR for open world object detection based on Deformable DETR. We fine-tune the class-specific components of the model with a multi-view self-labeling strategy and a consistency constraint. Our proposed method outperforms other state-of-the-art open world object detection methods by a large margin.
  arXiv  Detail & Related papers  (2022-12-06T13:39:30Z)
• Towards Generalized Few-Shot Open-Set Object Detection [13.671120689841736]
  Open-set object detection (OSOD) aims to detect the known categories and reject unknown objects in a dynamic world. In this paper, we seek a solution for the generalized few-shot open-set object detection (G-FOOD) We propose a new G-FOOD algorithm to tackle this issue, named underlineFew-shunderlineOt underlineOpen-set underlineDetector (FOOD)
  arXiv  Detail & Related papers  (2022-10-28T09:02:32Z)
• OW-DETR: Open-world Detection Transformer [90.56239673123804]
  We introduce a novel end-to-end transformer-based framework, OW-DETR, for open-world object detection. OW-DETR comprises three dedicated components namely, attention-driven pseudo-labeling, novelty classification and objectness scoring. Our model outperforms the recently introduced OWOD approach, ORE, with absolute gains ranging from 1.8% to 3.3% in terms of unknown recall.
  arXiv  Detail & Related papers  (2021-12-02T18:58:30Z)
• Learning Open Set Network with Discriminative Reciprocal Points [70.28322390023546]
  Open set recognition aims to simultaneously classify samples from predefined classes and identify the rest as 'unknown' In this paper, we propose a new concept, Reciprocal Point, which is the potential representation of the extra-class space corresponding to each known category. Based on the bounded space constructed by reciprocal points, the risk of unknown is reduced through multi-category interaction.
  arXiv  Detail & Related papers  (2020-10-31T03:20:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.