RIGID: A Training-free and Model-Agnostic Framework for Robust AI-Generated Image Detection

• URL: http://arxiv.org/abs/2405.20112v1
• Date: Thu, 30 May 2024 14:49:54 GMT
• Title: RIGID: A Training-free and Model-Agnostic Framework for Robust AI-Generated Image Detection
• Abstract summary: RIGID is a training-free and model-agnostic method for robust AI-generated image detection. RIGID significantly outperforms existing trainingbased and training-free detectors.
• Score: 60.960988614701414
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The rapid advances in generative AI models have empowered the creation of highly realistic images with arbitrary content, raising concerns about potential misuse and harm, such as Deepfakes. Current research focuses on training detectors using large datasets of generated images. However, these training-based solutions are often computationally expensive and show limited generalization to unseen generated images. In this paper, we propose a training-free method to distinguish between real and AI-generated images. We first observe that real images are more robust to tiny noise perturbations than AI-generated images in the representation space of vision foundation models. Based on this observation, we propose RIGID, a training-free and model-agnostic method for robust AI-generated image detection. RIGID is a simple yet effective approach that identifies whether an image is AI-generated by comparing the representation similarity between the original and the noise-perturbed counterpart. Our evaluation on a diverse set of AI-generated images and benchmarks shows that RIGID significantly outperforms existing trainingbased and training-free detectors. In particular, the average performance of RIGID exceeds the current best training-free method by more than 25%. Importantly, RIGID exhibits strong generalization across different image generation methods and robustness to image corruptions.

Related papers

• RAID: Towards Robust AI-Generated Image Detection with Bit-Reversed Images [25.492080916045012]
  We investigate AI-generated image detection using bit-planes, and introduce the bit-reversed image.<n>We propose a simple yet effective pipeline consisting of construction of bit-reversed images, gradient-based patch selection and a convolutional classifier.<n>Our approach outperforms existing methods on over 40 benchmarks, and is nearly 100 times faster than counterparts.
  arXiv  Detail & Related papers  (2026-07-31T02:53:07Z)
• GenShield: Unified Detection and Artifact Correction for AI-Generated Images [65.11434977803509]
  GenShield is a framework that performs AIGI detection and artifact correction in a closed loop from diagnosis to restoration.<n>A high-quality dataset with large-scale artifact-restored'' pairs is constructed alongside a unified evaluation pipeline.
  arXiv  Detail & Related papers  (2026-05-15T16:06:20Z)
• Intermediate Representations are Strong AI-Generated Image Detectors [51.7378156094049]
  We propose a search-based method employing data sensitivity embedding in intermediate layers to detect AI-generated images.<n>Given a set of real and AI-generated images, our method examines the similarity between original image embeddings and perturbed image embeddings, and detects AI-generated images based on the similarity.<n>Our method achieves the largest performance gain on the Forensics Small benchmark by 39.61% compared to the best training-free method and 5.14% compared to the best training-based method in AUROC score.
  arXiv  Detail & Related papers  (2026-05-05T23:26:02Z)
• Boosting Robust AIGI Detection with LoRA-based Pairwise Training [55.076681464804636]
  Current AIGI detectors perform admirably on clean datasets, but their detection performance decreases when deployed "in the wild"<n>We propose a novel Lo-based Pairwise Training (RA) strategy designed specifically to achieve robust detection for AIGI under severe distortions.
  arXiv  Detail & Related papers  (2026-04-14T05:35:32Z)
• Efficient Zero-Shot AI-Generated Image Detection [2.915868985330569]
  We propose a training-free AI-generated image detection method that measures representation sensitivity to structured frequencys.<n>The proposed method is computationally lightweight, as perturbation generation requires only a single Fourier transform for an input image.<n>Extensive experiments on challenging benchmarks demonstrate the efficacy of our method over state-of-the-art (SoTA)
  arXiv  Detail & Related papers  (2026-03-23T06:33:20Z)
• RealHD: A High-Quality Dataset for Robust Detection of State-of-the-Art AI-Generated Images [14.691738115737962]
  We propose a high-quality, large-scale dataset comprising over 730,000 images across multiple categories, including both real and AI-generated images.<n>The generated images are synthesized via state-of-the-art methods, including text-to-image generation (guided by over 10,000 carefully designed prompts), image inpainting, image refinement, and face swapping.<n>Our dataset not only serves as a strong benchmark for evaluating detection methods but also contributes to advancing the robustness of AI-generated image detection techniques.
  arXiv  Detail & Related papers  (2026-02-11T05:38:40Z)
• Detecting AI-Generated Images via Distributional Deviations from Real Images [6.615773227400183]
  We propose a Masking-based Pre-trained model Fine-Tuning (MPFT) strategy, which introduces a Texture-Aware Masking (TAM) mechanism to mask textured areas containing generative model-specific patterns during fine-tuning.<n>Our method, fine-tuned with only a minimal number of images, significantly outperforms existing approaches, achieving up to 98.2% and 94.6% average accuracy on the two datasets, respectively.
  arXiv  Detail & Related papers  (2026-01-07T05:00:13Z)
• Provenance of AI-Generated Images: A Vector Similarity and Blockchain-based Approach [3.632189127068905]
  We propose an embedding-based AI image detection framework to distinguish AI-generated images from real (human-created) ones.<n>Our methodology is built on the hypothesis that AI-generated images demonstrate closer embedding proximity to other AI-generated content.<n>Our results confirm that moderate to high perturbations minimally impact the embedding signatures, with perturbed images maintaining close similarity matches to their original versions.
  arXiv  Detail & Related papers  (2025-10-15T00:49:56Z)
• Bridging the Gap Between Ideal and Real-world Evaluation: Benchmarking AI-Generated Image Detection in Challenging Scenarios [54.07895223545793]
  This paper introduces the Real-World Robustness dataset (RRDataset) for comprehensive evaluation of detection models across three dimensions.<n>RRDataset includes high-quality images from seven major scenarios.<n>We benchmarked 17 detectors and 10 vision-language models (VLMs) on RRDataset and conducted a large-scale human study.
  arXiv  Detail & Related papers  (2025-09-11T06:15:52Z)
• LAID: Lightweight AI-Generated Image Detection in Spatial and Spectral Domains [6.676901499867856]
  Current state-of-the-art AIGI detection methods rely on large, deep neural architectures.<n>We introduce LAID, the first framework that benchmarks and evaluates the detection performance and efficiency of off-the-shelf lightweight neural networks.<n>Our results demonstrate that lightweight models can achieve competitive accuracy, even under adversarial conditions.
  arXiv  Detail & Related papers  (2025-07-07T16:18:19Z)
• RAID: A Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectors [57.81012948133832]
  We present RAID (Robust evaluation of AI-generated image Detectors), a dataset of 72k diverse and highly transferable adversarial examples.<n>Our methodology generates adversarial images that transfer with a high success rate to unseen detectors.<n>Our findings indicate that current state-of-the-art AI-generated image detectors can be easily deceived by adversarial examples.
  arXiv  Detail & Related papers  (2025-06-04T14:16:00Z)
• Few-Shot Learner Generalizes Across AI-Generated Image Detection [14.069833211684715]
  Few-Shot Detector (FSD) is a novel AI-generated image detector which learns a specialized metric space to effectively distinguish unseen fake images. Experiments show FSD state-of-the-art performance by $+7.4%$ average ACC on GenImage dataset.
  arXiv  Detail & Related papers  (2025-01-15T12:33:11Z)
• Self-Supervised Learning for Detecting AI-Generated Faces as Anomalies [58.11545090128854]
  We describe an anomaly detection method for AI-generated faces by leveraging self-supervised learning of camera-intrinsic and face-specific features purely from photographic face images. The success of our method lies in designing a pretext task that trains a feature extractor to rank four ordinal exchangeable image file format (EXIF) tags and classify artificially manipulated face images.
  arXiv  Detail & Related papers  (2025-01-04T06:23:24Z)
• Detecting Discrepancies Between AI-Generated and Natural Images Using Uncertainty [91.64626435585643]
  We propose a novel approach for detecting AI-generated images by leveraging predictive uncertainty to mitigate misuse and associated risks. The motivation arises from the fundamental assumption regarding the distributional discrepancy between natural and AI-generated images. We propose to leverage large-scale pre-trained models to calculate the uncertainty as the score for detecting AI-generated images.
  arXiv  Detail & Related papers  (2024-12-08T11:32:25Z)
• Understanding and Improving Training-Free AI-Generated Image Detections with Vision Foundation Models [68.90917438865078]
  Deepfake techniques for facial synthesis and editing pose serious risks for generative models. In this paper, we investigate how detection performance varies across model backbones, types, and datasets. We introduce Contrastive Blur, which enhances performance on facial images, and MINDER, which addresses noise type bias, balancing performance across domains.
  arXiv  Detail & Related papers  (2024-11-28T13:04:45Z)
• Time Step Generating: A Universal Synthesized Deepfake Image Detector [0.4488895231267077]
  We propose a universal synthetic image detector Time Step Generating (TSG) TSG does not rely on pre-trained models' reconstructing ability, specific datasets, or sampling algorithms. We test the proposed TSG on the large-scale GenImage benchmark and it achieves significant improvements in both accuracy and generalizability.
  arXiv  Detail & Related papers  (2024-11-17T09:39:50Z)
• Zero-Shot Detection of AI-Generated Images [54.01282123570917]
  We propose a zero-shot entropy-based detector (ZED) to detect AI-generated images. Inspired by recent works on machine-generated text detection, our idea is to measure how surprising the image under analysis is compared to a model of real images. ZED achieves an average improvement of more than 3% over the SoTA in terms of accuracy.
  arXiv  Detail & Related papers  (2024-09-24T08:46:13Z)
• StealthDiffusion: Towards Evading Diffusion Forensic Detection through Diffusion Model [62.25424831998405]
  StealthDiffusion is a framework that modifies AI-generated images into high-quality, imperceptible adversarial examples. It is effective in both white-box and black-box settings, transforming AI-generated images into high-quality adversarial forgeries.
  arXiv  Detail & Related papers  (2024-08-11T01:22:29Z)
• A Sanity Check for AI-generated Image Detection [49.08585395873425]
  We present a sanity check on whether the task of AI-generated image detection has been solved. To quantify the generalization of existing methods, we evaluate 9 off-the-shelf AI-generated image detectors on Chameleon dataset. We propose AIDE (AI-generated Image DEtector with Hybrid Features), which leverages multiple experts to simultaneously extract visual artifacts and noise patterns.
  arXiv  Detail & Related papers  (2024-06-27T17:59:49Z)
• Improving Interpretability and Robustness for the Detection of AI-Generated Images [6.116075037154215]
  We analyze existing state-of-the-art AIGI detection methods based on frozen CLIP embeddings. We show how to interpret them, shedding light on how images produced by various AI generators differ from real ones.
  arXiv  Detail & Related papers  (2024-06-21T10:33:09Z)
• Invisible Relevance Bias: Text-Image Retrieval Models Prefer AI-Generated Images [67.18010640829682]
  We show that AI-generated images introduce an invisible relevance bias to text-image retrieval models. The inclusion of AI-generated images in the training data of the retrieval models exacerbates the invisible relevance bias. We propose an effective training method aimed at alleviating the invisible relevance bias.
  arXiv  Detail & Related papers  (2023-11-23T16:22:58Z)
• Detecting Generated Images by Real Images Only [64.12501227493765]
  Existing generated image detection methods detect visual artifacts in generated images or learn discriminative features from both real and generated images by massive training. This paper approaches the generated image detection problem from a new perspective: Start from real images. By finding the commonality of real images and mapping them to a dense subspace in feature space, the goal is that generated images, regardless of their generative model, are then projected outside the subspace.
  arXiv  Detail & Related papers  (2023-11-02T03:09:37Z)
• GenImage: A Million-Scale Benchmark for Detecting AI-Generated Image [28.38575401686718]
  We introduce the GenImage dataset, which includes over one million pairs of AI-generated fake images and collected real images. The advantages allow the detectors trained on GenImage to undergo a thorough evaluation and demonstrate strong applicability to diverse images. We conduct a comprehensive analysis of the dataset and propose two tasks for evaluating the detection method in resembling real-world scenarios.
  arXiv  Detail & Related papers  (2023-06-14T15:21:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.