Post-hoc Selective Classification for Reliable Synthetic Image Detection

• URL: http://arxiv.org/abs/2605.08574v1
• Date: Sat, 09 May 2026 00:25:22 GMT
• Title: Post-hoc Selective Classification for Reliable Synthetic Image Detection
• Abstract summary: Deep neural network-based synthetic image detectors (SIDs) lack reliability in deployment.<n>We propose a selective classification (SC) strategy by allowing SIDs to abstain from making low confidence predictions.<n>We introduce a preference optimization algorithm that aggregates confidence scores extracted from different layers to a final confidence estimate.
• Score: 5.743750345138882
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: As synthetic images become increasingly realistic, reliable synthetic image detection techniques are of pressing need to prevent their misuse. Despite satisfactory in-distribution performance, deep neural network-based synthetic image detectors (SIDs) lack reliability in deployment and often fail in the presence of common covariate shifts, resulting in poor detection accuracy. To avoid the risk caused by potential errors, we adopt a selective classification (SC) strategy by allowing SIDs to abstain from making low confidence predictions. For practicality, we focus on post-hoc methods which perform confidence estimation on a given SID without retraining. However, we show that conventional logit-based confidence score functions (CSFs) exhibit pathological behavior under covariate shifts, leading to SC performance close to or even worse than random guessing. To address this, we propose a simple yet effective SC framework for Reliable Synthetic Image Detection (ReSIDe). First, we generalize the notion of logits to an SID's intermediate layers from a centroid matching perspective, extending the use of logit-based CSFs to any layer of an SID. Then, we introduce a preference optimization algorithm that aggregates confidence scores extracted from different layers to a final confidence estimate by minimizing an upper bound of the area under the risk-coverage curve (AURC). Extensive experimental results show that ReSIDe significantly boosts the SC performance of various logit-based CSFs under common covariate shifts, achieving up to 69.55% AURC reduction.

Related papers

• When Modalities Fail to Tango: Conformal Backdoor Detection in Multimodal Contrastive Learning [22.47689018895596]
  Backdoor attacks in multimodal contrastive learning (MCL) have garnered growing attention in recent years.<n>Existing detection-based defenses predominantly rely on the CLIPScore metric.<n>We introduce CASCADE, a novel two-stage Coarse-to-Fine Conformal Backdoor Detection framework.
  arXiv  Detail & Related papers  (2026-08-04T10:20:41Z)
• Conformal Changepoint Localization and Root Cause Analysis with Corrupted Observations [55.76952683833966]
  This paper proposes weighted CONCH (W-CONCH) and weighted CROC (W-CROC) to reduce confidence set size when data may be corrupted.<n>Experiments on image-based and real-world changepoint and root-cause benchmarks show that uncertainty-based weighting substantially reduces confidence set size.
  arXiv  Detail & Related papers  (2026-07-29T05:16:59Z)
• LCPNet: Latent Consistent Proximal Unfolding Network for Infrared Small Target Detection [50.3892176822492]
  Infrared small target detection (IRSTD) aims to identify long distance small targets from complex infrared backgrounds.<n>Deep learning methods have improved IRSTD by learning discriminative image-to-mask mappings.<n>Deep unfolding methods partially address this issue by embedding model-driven iterations into neural networks.<n>We propose Latent Consistent Proximal unfolding network (LCPNet) to address these limitations.
  arXiv  Detail & Related papers  (2026-07-06T02:15:09Z)
• Clipping Bottleneck: Stabilizing RLVR via Stochastic Recovery of Near-Boundary Signals [83.0127582612634]
  Near-boundary Rescue (NSR) is a minimal, plug-and-play modification that retains out-of-bound tokens to recover lost signals.<n>NSR substantially improves training stability and delivers consistent gains over strong baselines such as DAPO and GSPO.
  arXiv  Detail & Related papers  (2026-05-21T16:45:31Z)
• Beyond Semantic Priors: Mitigating Optimization Collapse for Generalizable Visual Forensics [12.973951916863989]
  We identify a failure mode termed Optimization Collapse, where detectors degenerate to random guessing on non-semantic forgeries.<n>We propose a Contrastive Regional Injection Transformer (CoRIT) which integrates a computationally efficient Contrastive Gradient Proxy (CGP) with three training-free strategies.<n>CoRIT mitigates optimization collapse and achieves state-of-the-art generalization across cross-domain and universal forgery benchmarks.
  arXiv  Detail & Related papers  (2026-03-25T08:03:30Z)
• Decoupled Sensitivity-Consistency Learning for Weakly Supervised Video Anomaly Detection [14.851086599818302]
  We propose a novel Decoupled Sensitivity-Consistency framework to train two specialized streams.<n>The temporal sensitivity stream adopts an aggressive optimization strategy to capture high-frequency abrupt changes, whereas the semantic consistency stream applies robust constraints to maintain long-term coherence and reduce noise.<n>Their complementary strengths are fused through a collaborative inference mechanism that reduces individual biases and produces balanced predictions.
  arXiv  Detail & Related papers  (2026-03-20T09:15:37Z)
• Heterogeneous Uncertainty-Guided Composed Image Retrieval with Fine-Grained Probabilistic Learning [49.28548464288051]
  Composed Image Retrieval (CIR) enables image search by combining a reference image with modification text.<n>In intrinsic noise in CIR triplets incurs intrinsic uncertainty and threatens the model's robustness.<n>This paper introduces a Heterogeneous Uncertainty-Guided (HUG) paradigm to overcome these limitations.
  arXiv  Detail & Related papers  (2026-01-16T16:05:49Z)
• Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning [78.92934995292113]
  We propose a Confidence-Aware Asymmetric Learning (CAL) framework, which balances confidence across known and novel forgery types.<n>CAL consistently outperforms previous methods, achieving new state-of-the-art performance on both known and novel forgery attribution.
  arXiv  Detail & Related papers  (2025-12-14T12:31:28Z)
• A Hybrid Deep Learning and Forensic Approach for Robust Deepfake Detection [0.0]
  Existing deepfake detection methods either rely on deep learning, which suffers from poor generalization and vulnerability to distortions, or forensic analysis, which is interpretable but limited against new manipulation techniques.<n>This study proposes a hybrid framework that fuses forensic features, including noise residuals, JPEG compression traces, and frequency-domain descriptors, with deep learning representations from CNNs and vision transformers.
  arXiv  Detail & Related papers  (2025-10-31T11:32:52Z)
• Uncertainty-aware retinal layer segmentation in OCT through probabilistic signed distance functions [6.765624289092461]
  We present a new approach for uncertainty-aware retinal layer segmentation in Optical Coherence Tomography ( OCT) scans.<n>Our methodology refines the segmentation by predicting a signed distance function (SDF) that effectively parameterizes the retinal layer shape via level set.<n>This ensures a robust representation of the retinal layer even in the presence of ambiguous input, imaging noise, and unreliable segmentations.
  arXiv  Detail & Related papers  (2024-12-06T10:44:11Z)
• Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images [55.83984261827332]
  In this paper, we propose a novel reliable multi-scale wavelet-enhanced transformer network. We develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module. Our proposed method achieves better segmentation accuracy with a high degree of reliability as compared to other state-of-the-art segmentation approaches.
  arXiv  Detail & Related papers  (2022-12-01T07:32:56Z)
• Label Geometry Aware Discriminator for Conditional Generative Networks [40.89719383597279]
  Conditional Generative Adversarial Networks (GANs) can generate highly photo realistic images with desired target classes. These synthetic images have not always been helpful to improve downstream supervised tasks such as image classification.
  arXiv  Detail & Related papers  (2021-05-12T08:17:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.