Swin Meets EfficientNet: Lightweight Architectures for GAN-Based Face Forensics

• URL: http://arxiv.org/abs/2609.01749v1
• Date: Tue, 01 Sep 2026 18:19:32 GMT
• Title: Swin Meets EfficientNet: Lightweight Architectures for GAN-Based Face Forensics
• Abstract summary: This research focuses on GAN-generated synthetic faces, which underpin many face-centric deepfakes.<n>Existing detection systems rely heavily on either convolutional neural networks (CNNs) or global vision transformers.<n>Our work explores Swin-Transformer-based architectures across three implementations.
• Score: 6.316205493379209
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Modern generative models, such as GANs, diffusion architectures, and autoregressive systems, now produce facial images that are nearly indistinguishable from authentic photographs. This capability makes detecting forged images increasingly difficult, raising serious concerns about identity theft, fraud, and misinformation campaigns. Our research focuses specifically on GAN-generated synthetic faces, which underpin many face-centric deepfakes, and investigates efficient detection approaches using image analysis alone. Existing detection systems rely heavily on either convolutional neural networks (CNNs) or global vision transformers. While CNNs excel at identifying texture-based local features, they struggle with broader contextual understanding. Traditional Vision Transformer (ViT) models can capture long-range structures effectively, but demand substantial computational resources. Our work explores Swin-Transformer-based architectures across three implementations: a compact Swin Transformer trained from the ground up, ImageNet-1K pre-trained Swin-Tiny and Swin-Small models adapted for binary classification, and a novel hybrid combining EfficientNet-B0's convolutional processing with a Swin Transformer backend. We evaluated all models using the 140K Real and Fake Faces dataset, which includes StyleGAN-generated fake faces alongside authentic images from Flickr and DFDC, with balanced splits for training, validation, and testing. The EfficientNetB0+Swin hybrid achieved 99% accuracy and a 99.44% recall on 5,000 test images, outperforming both pure Swin variants and a previous CNN-only baseline on this dataset. Our results suggest that combining hierarchical CNN features with shifted-window self-attention provides an efficient and computationally lightweight method for detecting GAN-generated synthetic faces.

Related papers

• SSAFE: Simple and Strong AI-Generated Image Detection via Frozen Vision Encoders [61.07733730455141]
  We investigate how much information about image authenticity is already encoded in modern multimodal vision representations.<n>We develop a representation-aware data curation strategy that selects a compact set of representative generators for training.<n>Experiments show that combining frozen multimodal representations with carefully curated training data provides a simple and effective approach to AI-generated image detection.
  arXiv  Detail & Related papers  (2026-06-07T13:56:17Z)
• Digital Image Forgery Detection Using Transfer Learning [0.3914676152740142]
  This study presents a transfer learning-based framework for digital image forgery detection.<n>It integrates compression-aware feature enhancement with deep convolutional neural network (CNN) architectures.<n>Overall, the proposed framework improves the visibility of manipulation artifacts and enhances classification robustness, making it suitable for real-world digital image forgery detection scenarios.
  arXiv  Detail & Related papers  (2026-05-04T17:48:36Z)
• Hands-on Evaluation of Visual Transformers for Object Recognition and Detection [0.0]
  We compare different types of Vision Transformers (ViTs) against traditional CNN models across various tasks.<n>We find that hybrid and hierarchical transformers, especially Swin and CvT, offer a strong balance between accuracy and computational resources.<n>Overall, our results indicate that Vision Transformers are competitive and, in many cases, outperform traditional CNNs.
  arXiv  Detail & Related papers  (2025-12-10T12:15:48Z)
• Edge-Enhanced Vision Transformer Framework for Accurate AI-Generated Image Detection [0.0]
  We propose a hybrid detection framework that combines a fine-tuned Vision Transformer (ViT) with a novel edge-based image processing module.<n>The proposed method is highly suitable for real-world applications in automated content verification and digital forensics.
  arXiv  Detail & Related papers  (2025-08-25T10:30:56Z)
• CO-SPY: Combining Semantic and Pixel Features to Detect Synthetic Images by AI [58.35348718345307]
  Current efforts to distinguish between real and AI-generated images may lack generalization.<n>We propose a novel framework, Co-Spy, that first enhances existing semantic features.<n>We also create Co-Spy-Bench, a comprehensive dataset comprising 5 real image datasets and 22 state-of-the-art generative models.
  arXiv  Detail & Related papers  (2025-03-24T01:59:29Z)
• Classifying Deepfakes Using Swin Transformers [12.693895808318794]
  This study explores the application of Swin Transformers, a state-of-the-art architecture leveraging shifted windows for self-attention, in detecting and classifying deepfake images.<n>We evaluate the Swin Transformer and hybrid models such as Swin-ResNet and Swin-KNN, focusing on their ability to identify subtle manipulation artifacts.
  arXiv  Detail & Related papers  (2025-01-26T19:35:46Z)
• Swin Transformer for Robust Differentiation of Real and Synthetic Images: Intra- and Inter-Dataset Analysis [0.0]
  This study proposes a Swin Transformer-based model for accurate differentiation between natural and synthetic images. The model's performance was evaluated through intra-dataset and inter-dataset testing across three distinct datasets.
  arXiv  Detail & Related papers  (2024-09-07T06:43:17Z)
• Contrasting Deepfakes Diffusion via Contrastive Learning and Global-Local Similarities [88.398085358514]
  Contrastive Deepfake Embeddings (CoDE) is a novel embedding space specifically designed for deepfake detection. CoDE is trained via contrastive learning by additionally enforcing global-local similarities.
  arXiv  Detail & Related papers  (2024-07-29T18:00:10Z)
• Alleviating Catastrophic Forgetting in Facial Expression Recognition with Emotion-Centered Models [49.3179290313959]
  The proposed method, emotion-centered generative replay (ECgr), tackles this challenge by integrating synthetic images from generative adversarial networks. ECgr incorporates a quality assurance algorithm to ensure the fidelity of generated images. The experimental results on four diverse facial expression datasets demonstrate that incorporating images generated by our pseudo-rehearsal method enhances training on the targeted dataset and the source dataset.
  arXiv  Detail & Related papers  (2024-04-18T15:28:34Z)
• GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning [50.7702397913573]
  The rapid advancement of photorealistic generators has reached a critical juncture where the discrepancy between authentic and manipulated images is increasingly indistinguishable. Although there have been a number of publicly available face forgery datasets, the forgery faces are mostly generated using GAN-based synthesis technology. We propose a large-scale, diverse, and fine-grained high-fidelity dataset, namely GenFace, to facilitate the advancement of deepfake detection.
  arXiv  Detail & Related papers  (2024-02-03T03:13:50Z)
• X-Transfer: A Transfer Learning-Based Framework for GAN-Generated Fake Image Detection [33.31312811230408]
  misuse of GANs for generating deceptive images, such as face replacement, raises significant security concerns. This paper introduces a novel GAN-generated image detection algorithm called X-Transfer. It enhances transfer learning by utilizing two neural networks that employ interleaved parallel gradient transmission.
  arXiv  Detail & Related papers  (2023-10-07T01:23:49Z)
• Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation [63.46694853953092]
  Swin-Unet is an Unet-like pure Transformer for medical image segmentation. tokenized image patches are fed into the Transformer-based U-shaped decoder-Decoder architecture.
  arXiv  Detail & Related papers  (2021-05-12T09:30:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.