Distribution-free false-alarm calibration and chance-corrected spatial evaluation for industrial anomaly detection

• URL: http://arxiv.org/abs/2608.15090v1
• Date: Sat, 15 Aug 2026 07:21:05 GMT
• Title: Distribution-free false-alarm calibration and chance-corrected spatial evaluation for industrial anomaly detection
• Abstract summary: We combine a distribution-free upper tolerance threshold with a paired-minus-crossed spatial test.<n>We evaluate three detectors on 120 point-defect images from three ISP-AD modalities and three fixed data splits.
• Score: 2.5273986395975476
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Studies of industrial visual inspection commonly report the area under the receiver operating characteristic curve (AUROC) and the overlap between anomaly maps and defect masks. Neither measure specifies the false-alarm rate at a selected threshold, while recurrent defect locations and mask geometry can inflate overlap. We combine a distribution-free upper tolerance threshold with a paired-minus-crossed spatial test. This test compares each detector's score-contributing locations with the matched defect mask and with masks from other images; the difference in rates defines spatial-evidence lift relative to the empirical chance-overlap rate. We evaluate three detectors on 120 point-defect images from three ISP-AD modalities and three fixed data splits. Of 378 alarms, 230 overlap the matched mask. Paired and crossed rates are nevertheless similar in eight of nine detector--modality cells; only DINOv2--ASM has a positive 95\% bootstrap lower bound (lift 0.259, 95\% interval 0.159--0.347). On the independent Magnetic Tile Defect dataset, the same analysis gives lifts of 0.203 (0.169--0.236) for Wide ResNet-50 (WRN50) patch memory and 0.231 (0.202--0.262) for Vision Transformer B/16 (ViT-B/16) patch memory, with one-sided permutation $p=10^{-5}$ for both. When crossed masks are restricted to the same defect class, the lifts remain 0.185 and 0.210. Exact sample planning shows that, with 150 calibration normals, a 95\%-confidence distribution-free claim is supported only for target false-positive rates of 1.98\% or higher; a 1\% target requires at least 299 normals. The results support reporting operating-point performance and chance-corrected spatial evidence alongside AUROC and raw mask overlap.

Related papers

• Not All Relations Are Equal: Relation-Balanced and Calibrated Graph Learning for Provenance-Based Intrusion Detection [66.44527094471619]
  We present RECAL, an unsupervised framework using relation-balanced masked graph learning to better capture rare interaction patterns.<n>On three DARPA E3 datasets, RECAL achieves F1 scores of 99.99%, 99.93%, and 99.99%, outperforming the best baseline on each dataset by 0.88, 0.82, and 0.42 percentage points, respectively.
  arXiv  Detail & Related papers  (2026-09-15T00:31:01Z)
• SHIFT-M3: Pre-fusion Alignment-based Consistency Screening for Multimodal ECG Record Integrity [0.0]
  Multimodal clinical AI typically assumes that the waveform, report, metadata, and downstream predictions attached to a record belong to the same patient.<n>We study this problem as multimodal record integrity triage: given an assembled record, should its modalities be trusted to belong together?<n>We introduce SHIFT-M3, a lightweight text-based pre-fusion screen that measures alignment-based consistency between two separately produced ECG text views.
  arXiv  Detail & Related papers  (2026-09-12T10:58:02Z)
• Drift Calibration in Geometric Eye Tracking Systems [34.12106856838315]
  We present a calibration-focused dataset containing 163 trials from 12 participants.<n>We use it to evaluate global, local, and composite correction functions under a common spatial-extrapolation protocol.
  arXiv  Detail & Related papers  (2026-08-30T12:05:44Z)
• RibAssist 3D: Biplanar Rib-Fracture Detection, Addressing, and Selective 3D Localization from CT-Derived Projections [0.6768558752130311]
  Rib fractures are common and time-consuming to localize on computed tomography (CT)<n>We ask whether fractures detected independently in two orthogonal CT-derived projections can be paired across views and triangulated into reliable 3D points at a controlled rate of false outputs.<n>The study establishes a reproducible framework for selective 3D localization and identifies cross-view correspondence as the dominant operational bottleneck.
  arXiv  Detail & Related papers  (2026-08-07T07:47:20Z)
• A Few Neurons Reveal When LLMs Misuse Tools: Sparse Detection and Selective Steering for Reliable Tool Use [28.57781785937644]
  We introduce PRISMS (Probing Representations In Support of Monitoring and Steering), a closed-loop framework that shares a failure-specific neuron basis between sparse detection and activation.<n>Across six models, PRISMS reduces pooled over-calling rate by 80% while increasing tool-required accuracy by 14.2 percentage points.
  arXiv  Detail & Related papers  (2026-07-31T19:03:44Z)
• VESTIGE: A Knowledge-Guided Masking Strategy for Corruption-Aware Fine-Tuning of Genomic Transformers, Validated on Ancient DNA Reconstruction [0.0]
  Masked--model fine-tuning applies a uniform masking probability across every token position, assuming reconstruction difficulty is position-agnostic.<n>We introduce VESTIGE, a parameter-free, drop-in replacement for the standard collator that aligns the masking distribution with an empirically measured per-position corruption profile.
  arXiv  Detail & Related papers  (2026-07-30T05:47:47Z)
• Level, Sharpness, and Corpus: Why Zero-Shot OOD Detector Rankings Do Not Transfer [36.02174685737611]
  We find that detector rankings reverse across deployments, every detector exceeds $80%$ FPR95 on at least one domain, and the preferred detector depends on both the in-distribution data and the underlying VLM.<n>We introduce the Complementary Evidence Guard (CEG), a detector-agnostic wrapper that preserves complementary evidence through a non-compensatory fusion of the base detector, level, and sharpness.
  arXiv  Detail & Related papers  (2026-07-29T08:00:49Z)
• Specificity- and Calibration-Aware Breast Ultrasound Segmentation via Entropy-Guided Boundary Supervision [0.0]
  In images with lesions, speckle noise, low tissue contrast, and posterior acoustic shadowing cause boundary leakage and incomplete contour delineation.<n>This study addresses both failure modes through a single modification to the training objective.<n>Rather than weighting every boundary pixel equally, the proposed loss scales contour penalties by per-pixel predictive entropy and the ground-truth boundary map.
  arXiv  Detail & Related papers  (2026-06-21T02:21:11Z)
• Online Shift Detection and Conformal Adaptation for Deployed Safety Classifiers [0.0]
  We present an online monitoring system for distributional shift in deployed safety classifiers.<n>After detection, a conformal abstention layer adapts decision to recover a target error.<n>The system achieves 86.6% detection with mean latency of 39.5800 steps.
  arXiv  Detail & Related papers  (2026-06-10T11:24:25Z)
• Efficient Transformer-Based Localized Patch Sampling for Choroid Plexus Segmentation in Multiple Sclerosis [26.831715552066694]
  The lateral ventricle choroid plexus (LVCP) is gaining recognition as a key imaging biomarker for multiple sclerosis (MS) related to physical disability and neuroinflammation.<n>This research aims to develop a SwinUNETR-driven pipeline that automatically segment the LVCP in MS from both standalone and multi-modal MRI inputs.
  arXiv  Detail & Related papers  (2026-06-02T12:32:43Z)
• Amplifying, Not Learning: Fine-Tuned AI Text Detectors Amplify a Pretrained Direction [51.56484100374058]
  Text detectors amplify a pretrained typicality axis; they do not construct an AI-vs-human boundary.<n>On raw encoders before any task supervision, projecting onto centroid(AI)-centroid(HC3) achieves NYT-vs-HC3 AUROC 0.806/0.944/0.834 across three architectures.<n>On RoBERTa-base, raw projection exceeds fine-tuning; on RoBERTa-base, full fine-tuning reduces discrimination below raw on both fluent-formal populations tested.
  arXiv  Detail & Related papers  (2026-05-20T19:08:38Z)
• Impact of Labeling Inaccuracy and Image Noise on Tooth Segmentation in Panoramic Radiographs using Federated, Centralized and Local Learning [46.232038247686745]
  Federated learning (FL) may mitigate privacy constraints, heterogeneous data quality, and inconsistent labeling in dental diagnostic AI.<n>We compared FL with centralized (CL) and local learning (LL) for tooth segmentation in panoramic radiographs across multiple data corruption scenarios.
  arXiv  Detail & Related papers  (2025-09-08T11:07:47Z)
• Automated Pulmonary Embolism Detection from CTPA Images Using an End-to-End Convolutional Neural Network [31.58557856188164]
  This study presents an end-to-end trainable convolutional neural network (CNN) for detecting pulmonary embolisms (PEs) Our system achieves a sensitivity of 63.2%, 78.9% and 86.8% at 2 false positives per volume at 0mm, 2mm and 5mm localization error.
  arXiv  Detail & Related papers  (2021-11-10T03:01:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.