GUIDED: Granular Understanding via Identification, Detection, and Discrimination for Fine-Grained Open-Vocabulary Object Detection

• URL: http://arxiv.org/abs/2603.27014v1
• Date: Fri, 27 Mar 2026 22:08:11 GMT
• Title: GUIDED: Granular Understanding via Identification, Detection, and Discrimination for Fine-Grained Open-Vocabulary Object Detection
• Abstract summary: Fine-grained open-vocabulary object detection (FG-OVD) aims to detect novel object categories described by attribute-rich texts.<n>FG-OVD achieves new state-of-the-art results, demonstrating the benefits of disentangled modeling and modular optimization.
• Score: 54.19989440021701
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fine-grained open-vocabulary object detection (FG-OVD) aims to detect novel object categories described by attribute-rich texts. While existing open-vocabulary detectors show promise at the base-category level, they underperform in fine-grained settings due to the semantic entanglement of subjects and attributes in pretrained vision-language model (VLM) embeddings -- leading to over-representation of attributes, mislocalization, and semantic drift in embedding space. We propose GUIDED, a decomposition framework specifically designed to address the semantic entanglement between subjects and attributes in fine-grained prompts. By separating object localization and fine-grained recognition into distinct pathways, HUIDED aligns each subtask with the module best suited for its respective roles. Specifically, given a fine-grained class name, we first use a language model to extract a coarse-grained subject and its descriptive attributes. Then the detector is guided solely by the subject embedding, ensuring stable localization unaffected by irrelevant or overrepresented attributes. To selectively retain helpful attributes, we introduce an attribute embedding fusion module that incorporates attribute information into detection queries in an attention-based manner. This mitigates over-representation while preserving discriminative power. Finally, a region-level attribute discrimination module compares each detected region against full fine-grained class names using a refined vision-language model with a projection head for improved alignment. Extensive experiments on FG-OVD and 3F-OVD benchmarks show that GUIDED achieves new state-of-the-art results, demonstrating the benefits of disentangled modeling and modular optimization. Our code will be released at https://github.com/lijm48/GUIDED.

Related papers

• DSAA: Dual-Stage Attribute Activation for Fine-grained Open Vocabulary Detection [10.512210722250236]
  Open-Vocabulary Object Detection (OVD) models break the limitations of closed-set detection.<n>They exhibit notable limitations in fine-grained detection tasks involving attributes like color, ma- terial, and texture.<n>We propose the Dual-Stage Attribute Activation framework, which enhances fine-grained detection capa- bilities.
  arXiv  Detail & Related papers  (2026-05-18T08:13:13Z)
• Parameter-Efficient Semantic Augmentation for Enhancing Open-Vocabulary Object Detection [33.35667602014138]
  HSA-DINO is a parameter-efficient semantic augmentation framework for enhancing open-vocabulary object detection.<n>We introduce a semantic-aware router that dynamically selects the appropriate semantic augmentation strategy during inference.<n>We evaluate HSA-DINO on OV-COCO, several vertical domain datasets, and modified benchmark settings.
  arXiv  Detail & Related papers  (2026-04-06T05:41:33Z)
• LAB-Det: Language as a Domain-Invariant Bridge for Training-Free One-Shot Domain Generalization in Object Detection [53.988759250627425]
  We introduce training-free one-shot domain generalization for object detection.<n>We project each exemplar into a descriptive text that conditions and guides a frozen detector.<n>We evaluate on UODD (underwater) and NEU-DET (industrial defects)
  arXiv  Detail & Related papers  (2026-02-06T08:03:04Z)
• Language-driven Fine-grained Retrieval [56.619978313798875]
  We introduce LaFG, a Language-driven framework for Fine-Grained Retrieval.<n>It converts class names into attribute-level supervision using large language models and vision-language models.<n>A global prompt template selects category-relevant attributes, which are aggregated into category-specific linguistic prototypes.
  arXiv  Detail & Related papers  (2025-12-06T02:56:55Z)
• What Makes You Unique? Attribute Prompt Composition for Object Re-Identification [70.67907354506278]
  Object Re-IDentification aims to recognize individuals across non-overlapping camera views.<n>Single-domain models tend to overfit to domain-specific features, whereas cross-domain models often rely on diverse normalization strategies.<n>We propose an Attribute Prompt Composition framework, which exploits textual semantics to jointly enhance discrimination and generalization.
  arXiv  Detail & Related papers  (2025-09-23T07:03:08Z)
• LIRA: Inferring Segmentation in Large Multi-modal Models with Local Interleaved Region Assistance [54.683384204063934]
  Large multi-modal models (LMMs) struggle with inaccurate segmentation and hallucinated comprehension.<n>We propose LIRA, a framework that capitalizes on the complementary relationship between visual comprehension and segmentation.<n>LIRA achieves state-of-the-art performance in both segmentation and comprehension tasks.
  arXiv  Detail & Related papers  (2025-07-08T07:46:26Z)
• LATex: Leveraging Attribute-based Text Knowledge for Aerial-Ground Person Re-Identification [78.73711446918814]
  We propose a novel framework named LATex for AG-ReID, which adopts prompt-tuning strategies to leverage attribute-based text knowledge.<n>Our framework can fully leverage attribute-based text knowledge to improve AGReID performance.
  arXiv  Detail & Related papers  (2025-03-31T04:47:05Z)
• Real Classification by Description: Extending CLIP's Limits of Part Attributes Recognition [1.2499537119440243]
  We tackle zero shot "real" classification by description, a novel task that evaluates the ability of Vision-Language Models (VLMs) to classify objects based solely on descriptive attributes, excluding object class names.<n>We release description data for six popular fine-grained benchmarks, which omit object names to encourage genuine zero-shot learning.<n>We introduce a modified CLIP architecture that leverages multiple resolutions to improve the detection of fine-grained part attributes.
  arXiv  Detail & Related papers  (2024-12-18T15:28:08Z)
• The devil is in the fine-grained details: Evaluating open-vocabulary object detectors for fine-grained understanding [8.448399308205266]
  We introduce an evaluation protocol based on dynamic vocabulary generation to test whether models detect, discern, and assign the correct fine-grained description to objects. We further enhance our investigation by evaluating several state-of-the-art open-vocabulary object detectors using the proposed protocol.
  arXiv  Detail & Related papers  (2023-11-29T10:40:52Z)
• Attribute Localization and Revision Network for Zero-Shot Learning [13.530912616208722]
  Zero-shot learning enables the model to recognize unseen categories with the aid of auxiliary semantic information such as attributes. In this paper, we find that the choice between local and global features is not a zero-sum game, global features can also contribute to the understanding of attributes.
  arXiv  Detail & Related papers  (2023-10-11T14:50:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.