Activation Matters: Test-time Activated Negative Labels for OOD Detection with Vision-Language Models

• URL: http://arxiv.org/abs/2603.25250v1
• Date: Thu, 26 Mar 2026 09:53:04 GMT
• Title: Activation Matters: Test-time Activated Negative Labels for OOD Detection with Vision-Language Models
• Abstract summary: Out-of-distribution (OOD) detection aims to identify samples that deviate from in-distribution (ID)<n>One popular pipeline addresses this by introducing negative labels distant from ID classes and detecting OOD based on their distance to these labels.<n>We propose underlineTest-time underlineActivated underlineNegative underlineLabels (TANL) by dynamically evaluating activation levels across the corpus dataset.
• Score: 22.58959194553246
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Out-of-distribution (OOD) detection aims to identify samples that deviate from in-distribution (ID). One popular pipeline addresses this by introducing negative labels distant from ID classes and detecting OOD based on their distance to these labels. However, such labels may present poor activation on OOD samples, failing to capture the OOD characteristics. To address this, we propose \underline{T}est-time \underline{A}ctivated \underline{N}egative \underline{L}abels (TANL) by dynamically evaluating activation levels across the corpus dataset and mining candidate labels with high activation responses during the testing process. Specifically, TANL identifies high-confidence test images online and accumulates their assignment probabilities over the corpus to construct a label activation metric. Such a metric leverages historical test samples to adaptively align with the test distribution, enabling the selection of distribution-adaptive activated negative labels. By further exploring the activation information within the current testing batch, we introduce a more fine-grained, batch-adaptive variant. To fully utilize label activation knowledge, we propose an activation-aware score function that emphasizes negative labels with stronger activations, boosting performance and enhancing its robustness to the label number. Our TANL is training-free, test-efficient, and grounded in theoretical justification. Experiments on diverse backbones and wide task settings validate its effectiveness. Notably, on the large-scale ImageNet benchmark, TANL significantly reduces the FPR95 from 17.5\% to 9.8\%. Codes are available at \href{https://github.com/YBZh/OpenOOD-VLM}{YBZh/OpenOOD-VLM}.

Related papers

• NegAS: Negative Label Guided Attention and Scoring for Out-of-Distribution Object Detection with Vision-Language Models [10.936920515353107]
  Out-of-Distribution (OOD) detection is essential for ensuring the robustness and reliability of object detection systems in safety-critical applications.<n>While prior research has mainly focused on uni-modal detectors or vision-language model (VLM) based classifiers, the potential of VLM-based object detectors in OOD scenarios remains underexplored.<n>We identify two challenges specific to VLM detectors: (i) their text-guided attention enhances foreground with ID labels but treats background uniformly, and (ii) their sigmoid-based multi-label outputs are incompatible with softmax-based OOD scores
  arXiv  Detail & Related papers  (2026-06-21T14:50:41Z)
• Debiased Negative Mining Improves Out-of-distribution Detection with Pre-trained Vision-Language Models [30.819876174251863]
  Out-of-distribution (OOD) detection has emerged as a pivotal approach to enhancing the reliability of machine learning models.<n>This paper focuses on the burgeoning paradigm of post-hoc OOD detection with pre-trained vision-language models (VLMs)<n>We develop a theoretical framework for correcting the sampling bias of negatives labels by indirectly approximating the distribution of negative labels.
  arXiv  Detail & Related papers  (2026-05-22T15:57:56Z)
• NegRefine: Refining Negative Label-Based Zero-Shot OOD Detection [3.9940875711185124]
  NegRefine is a novel negative label refinement framework for zero-shot OOD detection.<n>We introduce a filtering mechanism to exclude subcategory labels and proper nouns from the negative label set.<n>We evaluate NegRefine on large-scale benchmarks, including ImageNet-1K.
  arXiv  Detail & Related papers  (2025-07-13T21:15:30Z)
• AdaNeg: Adaptive Negative Proxy Guided OOD Detection with Vision-Language Models [15.754054667010468]
  Pre-trained vision-language models are effective at identifying out-of-distribution (OOD) samples by using negative labels as guidance. We introduce textitadaptive negative proxies, which are dynamically generated during testing by exploring actual OOD images. Our approach significantly outperforms existing methods, with a 2.45% increase in AUROC and a 6.48% reduction in FPR95.
  arXiv  Detail & Related papers  (2024-10-26T11:20:02Z)
• Negative Label Guided OOD Detection with Pretrained Vision-Language Models [96.67087734472912]
  Out-of-distribution (OOD) detection aims at identifying samples from unknown classes. We propose a novel post hoc OOD detection method, called NegLabel, which takes a vast number of negative labels from extensive corpus databases.
  arXiv  Detail & Related papers  (2024-03-29T09:19:52Z)
• Efficient Test-Time Adaptation of Vision-Language Models [58.3646257833533]
  Test-time adaptation with pre-trained vision-language models has attracted increasing attention for tackling distribution shifts during the test time. We design TDA, a training-free dynamic adapter that enables effective and efficient test-time adaptation with vision-language models.
  arXiv  Detail & Related papers  (2024-03-27T06:37:51Z)
• Model-free Test Time Adaptation for Out-Of-Distribution Detection [62.49795078366206]
  We propose a Non-Parametric Test Time textbfAdaptation framework for textbfDistribution textbfDetection (abbr) abbr utilizes online test samples for model adaptation during testing, enhancing adaptability to changing data distributions. We demonstrate the effectiveness of abbr through comprehensive experiments on multiple OOD detection benchmarks.
  arXiv  Detail & Related papers  (2023-11-28T02:00:47Z)
• Dist-PU: Positive-Unlabeled Learning from a Label Distribution Perspective [89.5370481649529]
  We propose a label distribution perspective for PU learning in this paper. Motivated by this, we propose to pursue the label distribution consistency between predicted and ground-truth label distributions. Experiments on three benchmark datasets validate the effectiveness of the proposed method.
  arXiv  Detail & Related papers  (2022-12-06T07:38:29Z)
• Estimating Soft Labels for Out-of-Domain Intent Detection [122.68266151023676]
  Out-of-Domain (OOD) intent detection is important for practical dialog systems. We propose an adaptive soft pseudo labeling (ASoul) method that can estimate soft labels for pseudo OOD samples.
  arXiv  Detail & Related papers  (2022-11-10T13:31:13Z)
• Active Testing: Sample-Efficient Model Evaluation [39.200332879659456]
  We introduce active testing: a new framework for sample-efficient model evaluation. Active testing addresses this by carefully selecting the test points to label. We show how to remove that bias while reducing the variance of the estimator.
  arXiv  Detail & Related papers  (2021-03-09T10:20:49Z)
• Label Smoothed Embedding Hypothesis for Out-of-Distribution Detection [72.35532598131176]
  We propose an unsupervised method to detect OOD samples using a $k$-NN density estimate. We leverage a recent insight about label smoothing, which we call the emphLabel Smoothed Embedding Hypothesis We show that our proposal outperforms many OOD baselines and also provide new finite-sample high-probability statistical results.
  arXiv  Detail & Related papers  (2021-02-09T21:04:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.