Knowing the Unknown: Interpretable Open-World Object Detection via Concept Decomposition Model

• URL: http://arxiv.org/abs/2602.20616v1
• Date: Tue, 24 Feb 2026 07:08:47 GMT
• Title: Knowing the Unknown: Interpretable Open-World Object Detection via Concept Decomposition Model
• Authors: Xueqiang Lv, Shizhou Zhang, Yinghui Xing, Di Xu, Peng Wang, Yanning Zhang,
• Abstract summary: Open-world object detection (OWOD) requires incrementally detecting known categories while reliably identifying unknown objects.<n>This paper aims to make the entire OWOD framework interpretable, enabling the detector to truly "knowing the unknown"
• Score: 51.81962097623522
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Open-world object detection (OWOD) requires incrementally detecting known categories while reliably identifying unknown objects. Existing methods primarily focus on improving unknown recall, yet overlook interpretability, often leading to known-unknown confusion and reduced prediction reliability. This paper aims to make the entire OWOD framework interpretable, enabling the detector to truly "knowing the unknown". To this end, we propose a concept-driven InterPretable OWOD framework(IPOW) by introducing a Concept Decomposition Model (CDM) for OWOD, which explicitly decomposes the coupled RoI features in Faster R-CNN into discriminative, shared, and background concepts. Discriminative concepts identify the most discriminative features to enlarge the distances between known categories, while shared and background concepts, due to their strong generalization ability, can be readily transferred to detect unknown categories. Leveraging the interpretable framework, we identify that known-unknown confusion arises when unknown objects fall into the discriminative space of known classes. To address this, we propose Concept-Guided Rectification (CGR) to further resolve such confusion. Extensive experiments show that IPOW significantly improves unknown recall while mitigating confusion, and provides concept-level interpretability for both known and unknown predictions.

Related papers

• Known Meets Unknown: Mitigating Overconfidence in Open Set Recognition [4.377912830814393]
  Open Set Recognition (OSR) requires models to accurately classify known classes and to effectively reject unknown samples.<n>When unknown samples are semantically similar to known classes, inter-class overlap in the feature space often causes models to assign unjustifiably high confidence to them.<n>We propose a framework that explicitly mitigates overconfidence caused by inter-class overlap.
  arXiv  Detail & Related papers  (2025-11-15T09:56:44Z)
• TARO: Toward Semantically Rich Open-World Object Detection [9.59690330728612]
  TARO is a novel detection framework that identifies unknown objects and classifies them into coarse parent categories within a semantic hierarchy.<n>We show TARO can categorize up to 29.9% of unknowns into meaningful coarse classes, significantly reduce confusion between unknown and known classes, and achieve competitive performance in both unknown recall and known mAP.
  arXiv  Detail & Related papers  (2025-10-10T09:15:26Z)
• TransFIRA: Transfer Learning for Face Image Recognizability Assessment [73.61309363885552]
  TransFIRA is a lightweight and annotation-free framework that grounds recognizability directly in embedding space.<n>New extensions beyond faces include encoder-grounded explainability that reveals how degradations and subject-specific factors affect recognizability.<n> Experiments confirm state-of-the-art results on faces, strong robustness on body recognition, and under cross-dataset shifts.
  arXiv  Detail & Related papers  (2025-10-07T18:16:21Z)
• Looking Beyond the Known: Towards a Data Discovery Guided Open-World Object Detection [3.9890357781493595]
  Open-World Object Detection (OWOD) enriches traditional object detectors by enabling continual discovery and integration of unknown objects via human guidance.<n>Existing OWOD approaches frequently suffer from semantic confusion between known and unknown classes, alongside catastrophic forgetting, leading to diminished unknown recall and degraded known-class accuracy.<n>We propose Combinatorial Open-World Detection (CROWD), a unified framework reformulating unknown object discovery and adaptation as an interwoven (set-based) data-discovery and representation learning task.
  arXiv  Detail & Related papers  (2025-09-30T21:48:08Z)
• Open-Set LiDAR Panoptic Segmentation Guided by Uncertainty-Aware Learning [17.188627352236782]
  We propose ULOPS, an uncertainty-guided open-set panoptic segmentation framework.<n>Our architecture incorporates separate decoders for semantic segmentation with uncertainty estimation.<n>During inference, we leverage uncertainty estimates to identify and segment unknown instances.
  arXiv  Detail & Related papers  (2025-06-16T09:03:51Z)
• Discover-then-Name: Task-Agnostic Concept Bottlenecks via Automated Concept Discovery [52.498055901649025]
  Concept Bottleneck Models (CBMs) have been proposed to address the 'black-box' problem of deep neural networks. We propose a novel CBM approach -- called Discover-then-Name-CBM (DN-CBM) -- that inverts the typical paradigm. Our concept extraction strategy is efficient, since it is agnostic to the downstream task, and uses concepts already known to the model.
  arXiv  Detail & Related papers  (2024-07-19T17:50:11Z)
• Principled Knowledge Extrapolation with GANs [92.62635018136476]
  We study counterfactual synthesis from a new perspective of knowledge extrapolation. We show that an adversarial game with a closed-form discriminator can be used to address the knowledge extrapolation problem. Our method enjoys both elegant theoretical guarantees and superior performance in many scenarios.
  arXiv  Detail & Related papers  (2022-05-21T08:39:42Z)
• Adversarial Reciprocal Points Learning for Open Set Recognition [21.963137599375862]
  Open set recognition (OSR) aims to simultaneously classify the seen classes and identify the unseen classes as 'unknown' We formulate the open space risk problem from the perspective of multi-class integration. A novel learning framework, termed Adrial Reciprocal Point Learning (ARPL), is proposed to minimize the overlap of known distribution and unknown distributions.
  arXiv  Detail & Related papers  (2021-03-01T12:25:45Z)
• Learning Open Set Network with Discriminative Reciprocal Points [70.28322390023546]
  Open set recognition aims to simultaneously classify samples from predefined classes and identify the rest as 'unknown' In this paper, we propose a new concept, Reciprocal Point, which is the potential representation of the extra-class space corresponding to each known category. Based on the bounded space constructed by reciprocal points, the risk of unknown is reduced through multi-category interaction.
  arXiv  Detail & Related papers  (2020-10-31T03:20:31Z)
• Open Set Recognition with Conditional Probabilistic Generative Models [51.40872765917125]
  We propose Conditional Probabilistic Generative Models (CPGM) for open set recognition. CPGM can detect unknown samples but also classify known classes by forcing different latent features to approximate conditional Gaussian distributions. Experiment results on multiple benchmark datasets reveal that the proposed method significantly outperforms the baselines.
  arXiv  Detail & Related papers  (2020-08-12T06:23:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.