Unmasking Deep Fakes: Leveraging Deep Learning for Video Authenticity Detection

• URL: http://arxiv.org/abs/2505.06528v2
• Date: Sun, 15 Jun 2025 06:12:33 GMT
• Title: Unmasking Deep Fakes: Leveraging Deep Learning for Video Authenticity Detection
• Authors: Mahmudul Hasan, Sadia Ruhama, Sabrina Tajnim Sithi, Chowdhury Mohammad Mutamir Samit, Oindrila Saha,
• Abstract summary: The primary motivation of this paper is to recognize deepfake videos using deep learning techniques.<n>We consider using MTCNN as a face detector and EfficientNet-B5 as encoder model to predict if a video is deepfake or not.<n>The results show that our deepfake detection model acquired 42.78% log loss, 93.80% AUC and 86.82% F1 score on kaggle's DFDC dataset.
• Score: 3.483595743063401
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deepfake videos, produced through advanced artificial intelligence methods now a days, pose a new challenge to the truthfulness of the digital media. As Deepfake becomes more convincing day by day, detecting them requires advanced methods capable of identifying subtle inconsistencies. The primary motivation of this paper is to recognize deepfake videos using deep learning techniques, specifically by using convolutional neural networks. Deep learning excels in pattern recognition, hence, makes it an ideal approach for detecting the intricate manipulations in deepfakes. In this paper, we consider using MTCNN as a face detector and EfficientNet-B5 as encoder model to predict if a video is deepfake or not. We utilize training and evaluation dataset from Kaggle DFDC. The results shows that our deepfake detection model acquired 42.78% log loss, 93.80% AUC and 86.82% F1 score on kaggle's DFDC dataset.

Related papers

• Deepfake detection in videos with multiple faces using geometric-fakeness features [79.16635054977068]
  Deepfakes of victims or public figures can be used by fraudsters for blackmailing, extorsion and financial fraud. In our research we propose to use geometric-fakeness features (GFF) that characterize a dynamic degree of a face presence in a video. We employ our approach to analyze videos with multiple faces that are simultaneously present in a video.
  arXiv  Detail & Related papers  (2024-10-10T13:10:34Z)
• Unmasking Deepfake Faces from Videos Using An Explainable Cost-Sensitive Deep Learning Approach [0.0]
  Deepfake technology is widely used, which has led to serious worries about the authenticity of digital media. This study employs a resource-effective and transparent cost-sensitive deep learning method to effectively detect deepfake faces in videos.
  arXiv  Detail & Related papers  (2023-12-17T14:57:10Z)
• DeePhy: On Deepfake Phylogeny [58.01631614114075]
  DeePhy is a novel Deepfake Phylogeny dataset which consists of 5040 deepfake videos generated using three different generation techniques. We present the benchmark on DeePhy dataset using six deepfake detection algorithms.
  arXiv  Detail & Related papers  (2022-09-19T15:30:33Z)
• Voice-Face Homogeneity Tells Deepfake [56.334968246631725]
  Existing detection approaches contribute to exploring the specific artifacts in deepfake videos. We propose to perform the deepfake detection from an unexplored voice-face matching view. Our model obtains significantly improved performance as compared to other state-of-the-art competitors.
  arXiv  Detail & Related papers  (2022-03-04T09:08:50Z)
• Model Attribution of Face-swap Deepfake Videos [39.771800841412414]
  We first introduce a new dataset with DeepFakes from Different Models (DFDM) based on several Autoencoder models. Specifically, five generation models with variations in encoder, decoder, intermediate layer, input resolution, and compression ratio have been used to generate a total of 6,450 Deepfake videos. We take Deepfakes model attribution as a multiclass classification task and propose a spatial and temporal attention based method to explore the differences among Deepfakes.
  arXiv  Detail & Related papers  (2022-02-25T20:05:18Z)
• Adversarially robust deepfake media detection using fused convolutional neural network predictions [79.00202519223662]
  Current deepfake detection systems struggle against unseen data. We employ three different deep Convolutional Neural Network (CNN) models to classify fake and real images extracted from videos. The proposed technique outperforms state-of-the-art models with 96.5% accuracy.
  arXiv  Detail & Related papers  (2021-02-11T11:28:00Z)
• WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection [82.42495493102805]
  We introduce a new dataset WildDeepfake which consists of 7,314 face sequences extracted from 707 deepfake videos collected completely from the internet. We conduct a systematic evaluation of a set of baseline detection networks on both existing and our WildDeepfake datasets, and show that WildDeepfake is indeed a more challenging dataset, where the detection performance can decrease drastically.
  arXiv  Detail & Related papers  (2021-01-05T11:10:32Z)
• A Convolutional LSTM based Residual Network for Deepfake Video Detection [23.275080108063406]
  We develop a Convolutional LSTM based Residual Network (CLRNet) to detect deepfake videos. We also propose a transfer learning-based approach to generalize different deepfake methods.
  arXiv  Detail & Related papers  (2020-09-16T05:57:06Z)
• Deepfake Detection using Spatiotemporal Convolutional Networks [0.0]
  Deepfake detection methods only use individual frames and therefore fail to learn from temporal information. We created a benchmark of performance using Celeb-DF dataset. Our methods outperformed state-of-theart frame-based detection methods.
  arXiv  Detail & Related papers  (2020-06-26T01:32:31Z)
• Deepfake Video Forensics based on Transfer Learning [0.0]
  "Deepfake" can create fake images and videos that humans cannot differentiate from the genuine ones. This paper details retraining the image classification models to apprehend the features from each deepfake video frames. When checking Deepfake videos, this technique received more than 87 per cent accuracy.
  arXiv  Detail & Related papers  (2020-04-29T13:21:28Z)
• Emotions Don't Lie: An Audio-Visual Deepfake Detection Method Using Affective Cues [75.1731999380562]
  We present a learning-based method for detecting real and fake deepfake multimedia content. We extract and analyze the similarity between the two audio and visual modalities from within the same video. We compare our approach with several SOTA deepfake detection methods and report per-video AUC of 84.4% on the DFDC and 96.6% on the DF-TIMIT datasets.
  arXiv  Detail & Related papers  (2020-03-14T22:07:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.