Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark

• URL: http://arxiv.org/abs/2605.00883v1
• Date: Mon, 27 Apr 2026 03:00:00 GMT
• Title: Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark
• Abstract summary: We present a comprehensive survey and benchmark for face swapping.<n>We introduce CASIA FaceSwapping, a high-quality benchmark with balanced demographic distributions and explicit attribute variations.<n>Our work provides a unified perspective and a principled evaluation framework to facilitate the development of more robust and controllable face swapping methods.
• Score: 60.225079538657496
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Face swapping has witnessed significant progress in recent years, largely driven by advances in deep generative models such as GANs and diffusion models.Despite these advances, existing methods remain fragmented across different paradigms, and their evaluation is highly inconsistent due to the lack of standardized datasets and protocols. Moreover, prior surveys primarily focus on broader deepfake generation or detection, leaving face swapping insufficiently studied as a standalone problem. In this paper, we present a comprehensive survey and benchmark for face swapping. We provide a structured review of existing methods, organizing them into five major paradigms and systematically analyzing their design principles, strengths, and limitations. To enable fair and controlled evaluation, we introduce CASIA FaceSwapping, a high-quality benchmark with balanced demographic distributions and explicit attribute variations, and establish standardized protocols to assess the robustness of different face swapping methods. Extensive experiments on representative approaches yield new insights into the performance characteristics and limitations of current techniques. Overall, our work provides a unified perspective and a principled evaluation framework to facilitate the development of more robust and controllable face swapping methods. More results can be found at https://github.com/CASIA-NLPRAI/face-swapping-survey.

Related papers

• Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives [74.46417373478194]
  Cross-view feature matching aims to establish reliable correspondences across images with large viewpoint variations.<n>Over the past decade, the field has evolved from task-specific models toward increasingly unified and generalizable correspondence models.<n>Despite these advances, existing studies remain highly diverse in their problem formulations, model architectures, training paradigms, and evaluation protocols.
  arXiv  Detail & Related papers  (2026-08-11T16:00:40Z)
• DeepBias: Adaptive In-depth Probing of Social Biases in LVLMs [71.85279836937578]
  We introduce DeepBias, an adaptive framework for the in-depth probing of social biases in LVLMs with carefully designed agents.<n>We build a benchmark named DeepBiasBench using our framework. By employing an ensemble of five diverse state-of-the-art LVLMs as anchors, the benchmark captures vulnerabilities shared across architectures.
  arXiv  Detail & Related papers  (2026-07-13T08:19:09Z)
• Learning Robust Penetration-Testing Policies under Partial Observability: A systematic evaluation [0.28675177318965045]
  Penetration testing, the simulation of cyberattacks to identify security vulnerabilities, presents a sequential decision-making problem.<n>Partial observability invalidates the Markov property present in Markov Decision Processes.<n>We investigate, partially observable penetration testing scenarios over host networks of varying size, aiming to better reflect real-world complexity.
  arXiv  Detail & Related papers  (2025-09-24T11:27:54Z)
• Are foundation models for computer vision good conformal predictors? [17.53651859360999]
  We study the behaviour of vision and vision-language foundation models under Conformal Prediction (CP)<n>Our findings reveal that foundation models are well-suited for conformalization procedures, particularly those integrating Vision Transformers.<n>We also show that few-shot adaptation of Vision-Language Models (VLMs) to downstream tasks, whose popularity is surging, enhances conformal scores compared to zero-shot predictions.
  arXiv  Detail & Related papers  (2024-12-08T22:05:38Z)
• Fairer Analysis and Demographically Balanced Face Generation for Fairer Face Verification [69.04239222633795]
  Face recognition and verification are two computer vision tasks whose performances have advanced with the introduction of deep representations.<n>Ethical, legal, and technical challenges due to the sensitive nature of face data and biases in real-world training datasets hinder their development.<n>We introduce a new controlled generation pipeline that improves fairness.
  arXiv  Detail & Related papers  (2024-12-04T14:30:19Z)
• Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
  The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image. We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
  arXiv  Detail & Related papers  (2024-06-04T01:36:29Z)
• FaceCat: Enhancing Face Recognition Security with a Unified Diffusion Model [30.0523477092216]
  Face anti-spoofing (FAS) and adversarial detection (FAD) have been regarded as critical technologies to ensure the safety of face recognition systems. This paper aims to achieve this goal by breaking through two primary obstacles: 1) the suboptimal face feature representation and 2) the scarcity of training data.
  arXiv  Detail & Related papers  (2024-04-14T09:01:26Z)
• Towards Evaluating Transfer-based Attacks Systematically, Practically, and Fairly [79.07074710460012]
  adversarial vulnerability of deep neural networks (DNNs) has drawn great attention. An increasing number of transfer-based methods have been developed to fool black-box DNN models. We establish a transfer-based attack benchmark (TA-Bench) which implements 30+ methods.
  arXiv  Detail & Related papers  (2023-11-02T15:35:58Z)
• Watch Out for the Confusing Faces: Detecting Face Swapping with the Probability Distribution of Face Identification Models [37.49012763328351]
  We propose a novel face swapping detection approach based on face identification probability distributions. IdP_FSD is specially designed for detecting swapped faces whose identities belong to a finite set. IdP_FSD exploits face swapping's common nature that the identity of swapped face combines that of two faces involved in swapping.
  arXiv  Detail & Related papers  (2023-03-23T09:33:10Z)
• SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustness [15.431761867166]
  We propose a novel concept to measure face quality based on an arbitrary face recognition model. We compare our proposed solution on two face embeddings against six state-of-the-art approaches from academia and industry.
  arXiv  Detail & Related papers  (2020-03-20T16:50:30Z)
• Unsupervised Domain Adaptation in Person re-ID via k-Reciprocal Clustering and Large-Scale Heterogeneous Environment Synthesis [76.46004354572956]
  We introduce an unsupervised domain adaptation approach for person re-identification. Experimental results show that the proposed ktCUDA and SHRED approach achieves an average improvement of +5.7 mAP in re-identification performance.
  arXiv  Detail & Related papers  (2020-01-14T17:43:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.