Detecting AI-Generated Forgeries via Iterative Manifold Deviation Amplification

• URL: http://arxiv.org/abs/2602.18842v1
• Date: Sat, 21 Feb 2026 14:14:17 GMT
• Title: Detecting AI-Generated Forgeries via Iterative Manifold Deviation Amplification
• Abstract summary: We propose IFA-Net, which shifts from learning "what is fake" to modeling "what is real"<n>Experiments on four diffusion-based inpainting benchmarks show that IFA-Net achieves an average improvement of 6.5% in IoU and 8.1% in F1-score over the second-best method.
• Score: 11.465428962772245
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The proliferation of highly realistic AI-generated images poses critical challenges for digital forensics, demanding precise pixel-level localization of manipulated regions. Existing methods predominantly learn discriminative patterns of specific forgeries and often struggle with novel manipulations as editing techniques continue to evolve. We propose the Iterative Forgery Amplifier Network (IFA-Net), which shifts from learning "what is fake" to modeling "what is real". Grounded in the principle that all manipulations deviate from the natural image manifold, IFA-Net leverages a frozen Masked Autoencoder (MAE) pretrained on real images as a universal realness prior. Our framework operates through a two-stage closed-loop process: an initial Dual-Stream Segmentation Network (DSSN) fuses the original image with MAE reconstruction residuals for coarse localization, followed by a Task-Adaptive Prior Injection (TAPI) module that converts this coarse prediction into guiding prompts to steer the MAE decoder and amplify reconstruction failures in suspicious regions for precise refinement. Extensive experiments on four diffusion-based inpainting benchmarks show that IFA-Net achieves an average improvement of 6.5% in IoU and 8.1% in F1-score over the second-best method, while demonstrating strong generalization to traditional manipulation types.

Related papers

• Harnessing CLIP and DINO: An Uncertainty-Aware Cascaded Fusion Network for Generalizable Deepfake Image Detection [37.90071216560782]
  UCF-Net is an uncertainty-aware cascaded fusion network that harnesses CLIP's language-aligned semantic priors and DINO's self-supervised visual-structure priors.<n>We consolidate public deepfake datasets into a unified benchmark of approximately 4M images and construct a separate cross-generator evaluation set with over 8K face images.<n>On the unified benchmark, UCF-Net achieves the best mean AUC among the evaluated methods in both in-domain and cross-domain evaluations.
  arXiv  Detail & Related papers  (2026-09-07T15:59:19Z)
• Efficient Difficulty-Aware Dynamic Routing for Diffusion-Based Real-World Image Super-Resolution [69.17533212524447]
  We propose a Difficulty-aware Dynamic Routing ( DDR) strategy that overcomes the rigid, one-size-fits-all processing paradigm.<n>Specifically, we design a difficulty estimator to predict the restoration cost of each input image, enabling automatic assignment to a network of appropriate capacity.<n>Extensive experiments have demonstrated the superior efficiency and effectiveness of the proposed model compared to recent state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-07-17T07:49:05Z)
• Reduce the Artifacts Bias for More Generalizable AI-Generated Image Detection [34.37666528689241]
  A common strategy is to employ reconstruction techniques, e.g., VAE and DDIM, which show remarkable results in diffusion-based methods.<n>We propose a GAN-based upsampling approach that mimics GAN-generated fake patterns while preserving content, size, and format alignment.<n>We first train domain-specific experts via LoRA adaptation on a frozen foundational model, then conduct decoupled fusion with a gating network to adaptively combine expert features.
  arXiv  Detail & Related papers  (2026-05-14T07:26:36Z)
• Bridging the Micro--Macro Gap: Frequency-Aware Semantic Alignment for Image Manipulation Localization [8.02155804287918]
  We propose FASA, a unified framework for localizing both traditional and diffusion-generated manipulations.<n>Experiments demonstrate state-of-the-art localization performance, strong cross-dataset generalization, and robust performance under common image degradations.
  arXiv  Detail & Related papers  (2026-04-14T06:24:12Z)
• R$^2$BD: A Reconstruction-Based Method for Generalizable and Efficient Detection of Fake Images [31.9904761238593]
  We propose a novel fake image detection framework, called R$2$BD, built upon two key designs.<n>Experiments on the benchmark from 10 public datasets demonstrate that R$2$BD is over 22$times$ faster than existing reconstruction-based methods.<n>In cross-dataset evaluations, it outperforms state-of-the-art methods by an average of 13.87%.
  arXiv  Detail & Related papers  (2026-01-11T02:31:51Z)
• Detecting AI-Generated Images via Distributional Deviations from Real Images [6.615773227400183]
  We propose a Masking-based Pre-trained model Fine-Tuning (MPFT) strategy, which introduces a Texture-Aware Masking (TAM) mechanism to mask textured areas containing generative model-specific patterns during fine-tuning.<n>Our method, fine-tuned with only a minimal number of images, significantly outperforms existing approaches, achieving up to 98.2% and 94.6% average accuracy on the two datasets, respectively.
  arXiv  Detail & Related papers  (2026-01-07T05:00:13Z)
• CINEMAE: Leveraging Frozen Masked Autoencoders for Cross-Generator AI Image Detection [25.84217122259626]
  CINEMAE adapts the core principles of text detection methods to the visual domain.<n>We trained exclusively on Stable Diffusion v1.4, our method achieves over 95% accuracy on all eight unseen generators in the GenImage benchmark.<n>This demonstrates that context-conditional reconstruction uncertainty provides a robust, transferable signal for AIGC detection.
  arXiv  Detail & Related papers  (2025-11-09T11:05:45Z)
• Bi-Level Optimization for Self-Supervised AI-Generated Face Detection [56.57881725223548]
  We introduce a self-supervised method for AI-generated face detectors based on bi-level optimization.<n>Our detectors significantly outperform existing approaches in both one-class and binary classification settings.
  arXiv  Detail & Related papers  (2025-07-30T16:38:29Z)
• Deep Learning Based Speckle Filtering for Polarimetric SAR Images. Application to Sentinel-1 [51.404644401997736]
  We propose a complete framework to remove speckle in polarimetric SAR images using a convolutional neural network. Experiments show that the proposed approach offers exceptional results in both speckle reduction and resolution preservation.
  arXiv  Detail & Related papers  (2024-08-28T10:07:17Z)
• Timestep-Aware Diffusion Model for Extreme Image Rescaling [47.89362819768323]
  We propose a novel framework called Timestep-Aware Diffusion Model (TADM) for extreme image rescaling.<n>TADM performs rescaling operations in the latent space of a pre-trained autoencoder.<n>It effectively leverages powerful natural image priors learned by a pre-trained text-to-image diffusion model.
  arXiv  Detail & Related papers  (2024-08-17T09:51:42Z)
• Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detection [106.39544368711427]
  We study the problem of generalizable synthetic image detection, aiming to detect forgery images from diverse generative methods. We present a novel forgery-aware adaptive transformer approach, namely FatFormer. Our approach tuned on 4-class ProGAN data attains an average of 98% accuracy to unseen GANs, and surprisingly generalizes to unseen diffusion models with 95% accuracy.
  arXiv  Detail & Related papers  (2023-12-27T17:36:32Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• ReContrast: Domain-Specific Anomaly Detection via Contrastive Reconstruction [29.370142078092375]
  Most advanced unsupervised anomaly detection (UAD) methods rely on modeling feature representations of frozen encoder networks pre-trained on large-scale datasets. We propose a novel epistemic UAD method, namely ReContrast, which optimize the entire network to reduce biases towards the pre-trained image domain. We conduct experiments across two popular industrial defect detection benchmarks and three medical image UAD tasks, which shows our superiority over current state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-06-05T05:21:15Z)
• ISSTAD: Incremental Self-Supervised Learning Based on Transformer for Anomaly Detection and Localization [12.975540251326683]
  We introduce a novel approach based on the Transformer backbone network. We train a Masked Autoencoder (MAE) model solely on normal images. In the subsequent stage, we apply pixel-level data augmentation techniques to generate corrupted normal images. This process allows the model to learn how to repair corrupted regions and classify the status of each pixel.
  arXiv  Detail & Related papers  (2023-03-30T13:11:26Z)
• Denoising Diffusion Autoencoders are Unified Self-supervised Learners [58.194184241363175]
  This paper shows that the networks in diffusion models, namely denoising diffusion autoencoders (DDAE), are unified self-supervised learners. DDAE has already learned strongly linear-separable representations within its intermediate layers without auxiliary encoders. Our diffusion-based approach achieves 95.9% and 50.0% linear evaluation accuracies on CIFAR-10 and Tiny-ImageNet.
  arXiv  Detail & Related papers  (2023-03-17T04:20:47Z)
• Transformer-based SAR Image Despeckling [53.99620005035804]
  We introduce a transformer-based network for SAR image despeckling. The proposed despeckling network comprises of a transformer-based encoder which allows the network to learn global dependencies between different image regions. Experiments show that the proposed method achieves significant improvements over traditional and convolutional neural network-based despeckling methods.
  arXiv  Detail & Related papers  (2022-01-23T20:09:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.