Challenges and Solutions in DeepFakes

• URL: http://arxiv.org/abs/2109.05397v1
• Date: Sun, 12 Sep 2021 01:22:12 GMT
• Title: Challenges and Solutions in DeepFakes
• Authors: Jatin Sharma and Sahil Sharma
• Abstract summary: A deep learning-powered application recently emerged is Deep Fake. It helps to create fake images and videos that human cannot distinguish them from the real ones and are recent off-shelf manipulation technique that allows swapping two identities in a single video. We introduce a dataset of 140k real and fake faces which contain 70k real faces from the Flickr dataset collected by Nvidia, as well as 70k fake faces sampled from 1 million fake faces generated by style GAN. We will train our model in the dataset so that our model can identify real or fake faces.
• Score: 8.401473551081747
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Deep learning has been successfully appertained to solve various complex problems in the area of big data analytics to computer vision. A deep learning-powered application recently emerged is Deep Fake. It helps to create fake images and videos that human cannot distinguish them from the real ones and are recent off-shelf manipulation technique that allows swapping two identities in a single video. Technology is a controversial technology with many wide-reaching issues impacting society. So, to counter this emerging problem, we introduce a dataset of 140k real and fake faces which contain 70k real faces from the Flickr dataset collected by Nvidia, as well as 70k fake faces sampled from 1 million fake faces generated by style GAN. We will train our model in the dataset so that our model can identify real or fake faces.

Related papers

• Towards Real-World Deepfake Detection: A Diverse In-the-wild Dataset of Forgery Faces [39.505403756048445]
  We introduce RedFace (Real-world-oriented Deepfake Face), a specialized facial deepfake dataset.<n>RedFace comprises over 60,000 forged images and 1,000 manipulated videos derived from authentic facial features.<n>Unlike prior benchmarks, RedFace utilizes 9 commercial online platforms to integrate the latest deepfake technologies found "in the wild"
  arXiv  Detail & Related papers  (2025-10-09T10:54:38Z)
• Deepfake detection in videos with multiple faces using geometric-fakeness features [79.16635054977068]
  Deepfakes of victims or public figures can be used by fraudsters for blackmailing, extorsion and financial fraud. In our research we propose to use geometric-fakeness features (GFF) that characterize a dynamic degree of a face presence in a video. We employ our approach to analyze videos with multiple faces that are simultaneously present in a video.
  arXiv  Detail & Related papers  (2024-10-10T13:10:34Z)
• Deepfake for the Good: Generating Avatars through Face-Swapping with Implicit Deepfake Generation [6.720605329045581]
  We show how to combine emerging deep-learning techniques to produce plausible 3D deepfake-based avatars. Our ImplicitDeepfake uses the classical deepfake algorithm to modify all training images separately and then train NeRF and GS on modified faces.
  arXiv  Detail & Related papers  (2024-02-09T13:11:57Z)
• DeePhy: On Deepfake Phylogeny [58.01631614114075]
  DeePhy is a novel Deepfake Phylogeny dataset which consists of 5040 deepfake videos generated using three different generation techniques. We present the benchmark on DeePhy dataset using six deepfake detection algorithms.
  arXiv  Detail & Related papers  (2022-09-19T15:30:33Z)
• Video Manipulations Beyond Faces: A Dataset with Human-Machine Analysis [60.13902294276283]
  We present VideoSham, a dataset consisting of 826 videos (413 real and 413 manipulated). Many of the existing deepfake datasets focus exclusively on two types of facial manipulations -- swapping with a different subject's face or altering the existing face. Our analysis shows that state-of-the-art manipulation detection algorithms only work for a few specific attacks and do not scale well on VideoSham.
  arXiv  Detail & Related papers  (2022-07-26T17:39:04Z)
• Multiface: A Dataset for Neural Face Rendering [108.44505415073579]
  In this work, we present Multiface, a new multi-view, high-resolution human face dataset. We introduce Mugsy, a large scale multi-camera apparatus to capture high-resolution synchronized videos of a facial performance. The goal of Multiface is to close the gap in accessibility to high quality data in the academic community and to enable research in VR telepresence.
  arXiv  Detail & Related papers  (2022-07-22T17:55:39Z)
• A Survey of Deep Fake Detection for Trial Courts [2.320417845168326]
  DeepFake algorithms can create fake images and videos that humans cannot distinguish from authentic ones. It is become essential to detect fake videos to avoid spreading false information. This paper presents a survey of methods used to detect DeepFakes and datasets available for detecting DeepFakes.
  arXiv  Detail & Related papers  (2022-05-31T13:50:25Z)
• A new face swap method for image and video domains: a technical report [60.47144478048589]
  We introduce a new face swap pipeline that is based on FaceShifter architecture. New eye loss function, super-resolution block, and Gaussian-based face mask generation leads to improvements in quality.
  arXiv  Detail & Related papers  (2022-02-07T10:15:50Z)
• WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection [82.42495493102805]
  We introduce a new dataset WildDeepfake which consists of 7,314 face sequences extracted from 707 deepfake videos collected completely from the internet. We conduct a systematic evaluation of a set of baseline detection networks on both existing and our WildDeepfake datasets, and show that WildDeepfake is indeed a more challenging dataset, where the detection performance can decrease drastically.
  arXiv  Detail & Related papers  (2021-01-05T11:10:32Z)
• Using GANs to Synthesise Minimum Training Data for Deepfake Generation [2.7393821783237184]
  Deepfakes can be useful in applications like entertainment, customer relations, or even assistive care. One problem with generating deepfakes is the requirement for a lot of image training data of the subject. We exploit the property of a GAN to produce images of an individual with variable facial expressions which we then use to generate a deepfake.
  arXiv  Detail & Related papers  (2020-11-10T22:05:38Z)
• The DeepFake Detection Challenge (DFDC) Dataset [8.451007921188019]
  Deepfakes are a technique that allows anyone to swap two identities in a single video. To counter this emerging threat, we have constructed an extremely large face swap video dataset. All recorded subjects agreed to participate in and have their likenesses modified during the construction of the face-swapped dataset.
  arXiv  Detail & Related papers  (2020-06-12T18:15:55Z)
• Video Face Manipulation Detection Through Ensemble of CNNs [17.051112469244778]
  We tackle the problem of face manipulation detection in video sequences targeting modern facial manipulation techniques. In particular, we study the ensembling of different trained Convolutional Neural Network (CNN) models. We show that combining these networks leads to promising face manipulation detection results on two publicly available datasets.
  arXiv  Detail & Related papers  (2020-04-16T14:19:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.