Level, Sharpness, and Corpus: Why Zero-Shot OOD Detector Rankings Do Not Transfer

• URL: http://arxiv.org/abs/2607.26582v1
• Date: Wed, 29 Jul 2026 08:00:49 GMT
• Title: Level, Sharpness, and Corpus: Why Zero-Shot OOD Detector Rankings Do Not Transfer
• Abstract summary: We find that detector rankings reverse across deployments, every detector exceeds $80%$ FPR95 on at least one domain, and the preferred detector depends on both the in-distribution data and the underlying VLM.<n>We introduce the Complementary Evidence Guard (CEG), a detector-agnostic wrapper that preserves complementary evidence through a non-compensatory fusion of the base detector, level, and sharpness.
• Score: 36.02174685737611
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Selecting a zero-shot out-of-distribution (OOD) detector for a new deployment is typically based on benchmark rankings, implicitly assuming that the highest-ranked detector will transfer across domains. We show that this assumption does not hold. Through a controlled portability audit across seventeen in-distribution datasets, three vision-language models, and seven representative zero-shot OOD detectors, we find that detector rankings reverse across deployments, every detector exceeds $80\%$ FPR95 on at least one domain, and the preferred detector depends on both the in-distribution data and the underlying VLM. We trace these reversals to complementary evidence channels in vision-language logits. Corpus-free detectors rely on different combinations of absolute match level and relative or spatial sharpness, while WordNet-based methods additionally depend on external semantic coverage. A simple proposition shows that level and sharpness cannot generally be recovered from one another, explaining why no single detector transfers reliably across deployments. Motivated by this diagnosis, we introduce the Complementary Evidence Guard (CEG), a detector-agnostic wrapper that preserves complementary evidence through a non-compensatory fusion of the base detector, level, and sharpness using only empirical in-distribution percentiles. Controls replacing these channels with entropy, logit variance, or random noise do not reproduce the gains. Without OOD samples, auxiliary corpora, or learned fusion, CEG reduces detector sensitivity and improves GL-MCM from $38.1$ to $28.8$ and MCM from $42.6$ to $30.5$ family-balanced FPR95.

Related papers

• Surrogate Substitution Preserves PHI Detectability: A Multi-Detector Equivalence Study [2.7278797508895316]
  Structure-preserving de-identification replaces protected health information with realistic same-type surrogates.<n>Can downstream PHI detectors still find the surrogate?<n>Across 11 detectors, 7 benchmarks, and 7 languages (1,750 documents), recall on masked spans moves from 76.1% to 74.9%.<n>A redaction floor and an open-source surrogate baseline indicate the effect is a property of well-formed substitution, not of one tool.
  arXiv  Detail & Related papers  (2026-08-04T06:04:18Z)
• What the Detector Can See: Evaluating CPS Anomaly Detectors Independently of the Decision Rule [6.145872664954402]
  Anomaly detectors are often the last line of defense for cyber-physical systems.<n>These detectors are usually compared using precision, recall, or F1 at a single operating point.<n>We treat a CPS anomaly detector as a two-stage pipeline: Stage 1 maps observations to residuals, and Stage 2 maps residuals to alarms.<n>We evaluate five detectors across three CPS benchmarks: SWaT, WADI, and HAI.
  arXiv  Detail & Related papers  (2026-08-03T19:35:00Z)
• Log-Likelihood, Simpson's Paradox, and the Detection of Machine-Generated Text [0.039998518782208774]
  We show that the token-level signal distinguishing human and machine text is non-uniform across the hidden space of the detector model.<n>We introduce a learned local calibration step grounded in Bayesian decision theory.<n>This single intervention dramatically and consistently improves detection performance across all baseline detectors and all datasets we consider.
  arXiv  Detail & Related papers  (2026-05-07T13:59:07Z)
• Scaling Pretrained Representations Enables Label-Free Out-of-Distribution Detection Without Fine-Tuning [5.008779702997125]
  We show that modern pretrained models encode sufficient geometric structure for accurate label-free out-of-distribution detection.<n>Our results suggest that label-free OOD detection depends strongly on the geometry exposed by frozen pretrained backbones.
  arXiv  Detail & Related papers  (2026-05-07T03:45:52Z)
• Label-Free Detection of Governance Evidence Degradation in Risk Decision Systems [0.0]
  Risk decision systems in fraud detection and credit scoring operate under structural label absence.<n>No existing framework integrates drift detection with governance evidence assessment and operational response.<n>This paper presents a label-free governance monitoring extension to the Governance Drift Toolkit.
  arXiv  Detail & Related papers  (2026-04-20T05:46:15Z)
• Beyond Raw Detection Scores: Markov-Informed Calibration for Boosting Machine-Generated Text Detection [105.14032334647932]
  Machine-generated texts (MGTs) pose risks such as disinformation and phishing, highlighting the need for reliable detection.<n> Metric-based methods, which extract statistically distinguishable features of MGTs, are often more practical than complex model-based methods that are prone to overfitting.<n>We propose a Markov-informed score calibration strategy that models two relationships of context detection scores that may aid calibration.
  arXiv  Detail & Related papers  (2026-02-08T16:06:12Z)
• How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark study [5.740397289924559]
  No universal winner exists, with detector rankings exhibiting substantial instability.<n>Our findings challenge the one-size-fits-all'' detector paradigm.
  arXiv  Detail & Related papers  (2026-02-08T04:36:13Z)
• Resultant: Incremental Effectiveness on Likelihood for Unsupervised Out-of-Distribution Detection [63.93728560200819]
  Unsupervised out-of-distribution (U-OOD) detection is to identify data samples with a detector trained solely on unlabeled in-distribution (ID) data. Recent studies have developed various detectors based on DGMs to move beyond likelihood. We apply two techniques for each direction, specifically post-hoc prior and dataset entropy-mutual calibration. Experimental results demonstrate that the Resultant could be a new state-of-the-art U-OOD detector.
  arXiv  Detail & Related papers  (2024-09-05T02:58:13Z)
• Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognition [80.07843757970923]
  We show that existing OOD detection methods suffer from significant performance degradation when the training set is long-tail distributed. We propose Partial and Asymmetric Supervised Contrastive Learning (PASCL), which explicitly encourages the model to distinguish between tail-class in-distribution samples and OOD samples. Our method outperforms previous state-of-the-art method by $1.29%$, $1.45%$, $0.69%$ anomaly detection false positive rate (FPR) and $3.24%$, $4.06%$, $7.89%$ in-distribution
  arXiv  Detail & Related papers  (2022-07-04T01:53:07Z)
• S4OD: Semi-Supervised learning for Single-Stage Object Detection [17.44592826610368]
  Single-stage detectors suffer from extreme foreground-background class imbalance, while two-stage detectors do not. In semi-supervised object detection, two-stage detectors can deliver remarkable performance by only selecting high-quality pseudo labels.
  arXiv  Detail & Related papers  (2022-04-09T15:19:37Z)
• Probabilistic Ranking-Aware Ensembles for Enhanced Object Detections [50.096540945099704]
  We propose a novel ensemble called the Probabilistic Ranking Aware Ensemble (PRAE) that refines the confidence of bounding boxes from detectors. We also introduce a bandit approach to address the confidence imbalance problem caused by the need to deal with different numbers of boxes.
  arXiv  Detail & Related papers  (2021-05-07T09:37:06Z)
• SADet: Learning An Efficient and Accurate Pedestrian Detector [68.66857832440897]
  This paper proposes a series of systematic optimization strategies for the detection pipeline of one-stage detector. It forms a single shot anchor-based detector (SADet) for efficient and accurate pedestrian detection. Though structurally simple, it presents state-of-the-art result and real-time speed of $20$ FPS for VGA-resolution images.
  arXiv  Detail & Related papers  (2020-07-26T12:32:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.