Deepfake Face Traceability with Disentangling Reversing Network

• URL: http://arxiv.org/abs/2207.03666v1
• Date: Fri, 8 Jul 2022 03:05:28 GMT
• Title: Deepfake Face Traceability with Disentangling Reversing Network
• Authors: Jiaxin Ai, Zhongyuan Wang, Baojin Huang and Zhen Han
• Abstract summary: Deepfake face not only violates the privacy of personal identity, but also confuses the public and causes huge social harm. Current deepfake detection only stays at the level of distinguishing true and false, and cannot trace the original genuine face corresponding to the fake face. This paper pioneers an interesting question about face deepfake, active forensics that "know it and how it happened"
• Score: 40.579533545888516
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deepfake face not only violates the privacy of personal identity, but also confuses the public and causes huge social harm. The current deepfake detection only stays at the level of distinguishing true and false, and cannot trace the original genuine face corresponding to the fake face, that is, it does not have the ability to trace the source of evidence. The deepfake countermeasure technology for judicial forensics urgently calls for deepfake traceability. This paper pioneers an interesting question about face deepfake, active forensics that "know it and how it happened". Given that deepfake faces do not completely discard the features of original faces, especially facial expressions and poses, we argue that original faces can be approximately speculated from their deepfake counterparts. Correspondingly, we design a disentangling reversing network that decouples latent space features of deepfake faces under the supervision of fake-original face pair samples to infer original faces in reverse.

Related papers

• Deepfake detection in videos with multiple faces using geometric-fakeness features [79.16635054977068]
  Deepfakes of victims or public figures can be used by fraudsters for blackmailing, extorsion and financial fraud. In our research we propose to use geometric-fakeness features (GFF) that characterize a dynamic degree of a face presence in a video. We employ our approach to analyze videos with multiple faces that are simultaneously present in a video.
  arXiv  Detail & Related papers  (2024-10-10T13:10:34Z)
• IDRetracor: Towards Visual Forensics Against Malicious Face Swapping [30.804429527783395]
  Face swapping technique based on deepfake methods poses significant social risks to personal identity security. We propose a novel task named face retracing, which considers retracing the original target face from the given fake one via inverse mapping. We show that the IDRetracor exhibits promising retracing performance from both quantitative and qualitative perspectives.
  arXiv  Detail & Related papers  (2024-08-13T04:53:48Z)
• FakeTracer: Catching Face-swap DeepFakes via Implanting Traces in Training [36.158715089667034]
  Face-swap DeepFake is an emerging AI-based face forgery technique. Due to the high privacy of faces, the misuse of this technique can raise severe social concerns. We describe a new proactive defense method called FakeTracer to expose face-swap DeepFakes via implanting traces in training.
  arXiv  Detail & Related papers  (2023-07-27T02:36:13Z)
• ReliableSwap: Boosting General Face Swapping Via Reliable Supervision [9.725105108879717]
  This paper proposes to construct reliable supervision, dubbed cycle triplets, which serves as the image-level guidance when the source identity differs from the target one during training. Specifically, we use face reenactment and blending techniques to synthesize the swapped face from real images in advance. Our face swapping framework, named ReliableSwap, can boost the performance of any existing face swapping network with negligible overhead.
  arXiv  Detail & Related papers  (2023-06-08T17:01:14Z)
• FaceMAE: Privacy-Preserving Face Recognition via Masked Autoencoders [81.21440457805932]
  We propose a novel framework FaceMAE, where the face privacy and recognition performance are considered simultaneously. randomly masked face images are used to train the reconstruction module in FaceMAE. We also perform sufficient privacy-preserving face recognition on several public face datasets.
  arXiv  Detail & Related papers  (2022-05-23T07:19:42Z)
• Restricted Black-box Adversarial Attack Against DeepFake Face Swapping [70.82017781235535]
  We introduce a practical adversarial attack that does not require any queries to the facial image forgery model. Our method is built on a substitute model persuing for face reconstruction and then transfers adversarial examples from the substitute model directly to inaccessible black-box DeepFake models.
  arXiv  Detail & Related papers  (2022-04-26T14:36:06Z)
• Invertible Mask Network for Face Privacy-Preserving [101.08196206784376]
  This paper proposes face privacy-preserving method based on Invertible "Mask" Network (IMN) The proposed method can not only effectively protect the privacy of the protected face, but also almost perfectly recover the protected face from the masked face.
  arXiv  Detail & Related papers  (2022-04-19T13:44:46Z)
• FaceGuard: Proactive Deepfake Detection [15.938409771740643]
  We propose FaceGuard, a proactive deepfake-detection framework. FaceGuard embeds a watermark into a real face image before it is published on social media. It predicts the face image to be fake if the extracted watermark does not match well with the individual's ground truth one.
  arXiv  Detail & Related papers  (2021-09-13T02:36:25Z)
• Landmark Breaker: Obstructing DeepFake By Disturbing Landmark Extraction [40.71503677067645]
  We describe Landmark Breaker, the first dedicated method to disrupt facial landmark extraction. Our motivation is that disrupting the facial landmark extraction can affect the alignment of input face so as to degrade the DeepFake quality. Compared to the detection methods that only work after DeepFake generation, Landmark Breaker goes one step ahead to prevent DeepFake generation.
  arXiv  Detail & Related papers  (2021-02-01T12:27:08Z)
• DeepFake Detection Based on the Discrepancy Between the Face and its Context [94.47879216590813]
  We propose a method for detecting face swapping and other identity manipulations in single images. Our approach involves two networks: (i) a face identification network that considers the face region bounded by a tight semantic segmentation, and (ii) a context recognition network that considers the face context. We describe a method which uses the recognition signals from our two networks to detect such discrepancies. Our method achieves state of the art results on the FaceForensics++, Celeb-DF-v2, and DFDC benchmarks for face manipulation detection, and even generalizes to detect fakes produced by unseen methods.
  arXiv  Detail & Related papers  (2020-08-27T17:04:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.