EEG-Features for Generalized Deepfake Detection

• URL: http://arxiv.org/abs/2405.08527v1
• Date: Tue, 14 May 2024 12:06:44 GMT
• Title: EEG-Features for Generalized Deepfake Detection
• Authors: Arian Beckmann, Tilman Stephani, Felix Klotzsche, Yonghao Chen, Simon M. Hofmann, Arno Villringer, Michael Gaebler, Vadim Nikulin, Sebastian Bosse, Peter Eisert, Anna Hilsmann,
• Abstract summary: We explore a novel approach to Deepfake detection by utilizing electroencephalography (EEG) measured from the neural processing of a human. Preliminary results indicate that human neural processing signals can be successfully integrated into Deepfake detection frameworks. Our study provides next steps towards the understanding of how digital realism is embedded in the human cognitive system.
• Score: 3.7117930046173173
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Since the advent of Deepfakes in digital media, the development of robust and reliable detection mechanism is urgently called for. In this study, we explore a novel approach to Deepfake detection by utilizing electroencephalography (EEG) measured from the neural processing of a human participant who viewed and categorized Deepfake stimuli from the FaceForensics++ datset. These measurements serve as input features to a binary support vector classifier, trained to discriminate between real and manipulated facial images. We examine whether EEG data can inform Deepfake detection and also if it can provide a generalized representation capable of identifying Deepfakes beyond the training domain. Our preliminary results indicate that human neural processing signals can be successfully integrated into Deepfake detection frameworks and hint at the potential for a generalized neural representation of artifacts in computer generated faces. Moreover, our study provides next steps towards the understanding of how digital realism is embedded in the human cognitive system, possibly enabling the development of more realistic digital avatars in the future.

Related papers

• Deep Learning Technology for Face Forgery Detection: A Survey [17.519617618071003]
  Deep learning has enabled the creation or manipulation of high-fidelity facial images and videos. This technology, also known as deepfake, has achieved dramatic progress and become increasingly popular in social media. To diminish the risks of deepfake, it is desirable to develop powerful forgery detection methods.
  arXiv  Detail & Related papers  (2024-09-22T01:42:01Z)
• Deepfake Media Forensics: State of the Art and Challenges Ahead [51.33414186878676]
  AI-generated synthetic media, also called Deepfakes, have influenced so many domains, from entertainment to cybersecurity. Deepfake detection has become a vital area of research, focusing on identifying subtle inconsistencies and artifacts with machine learning techniques. This paper reviews the primary algorithms that address these challenges, examining their advantages, limitations, and future prospects.
  arXiv  Detail & Related papers  (2024-08-01T08:57:47Z)
• Common Sense Reasoning for Deepfake Detection [13.502008402754658]
  State-of-the-art deepfake detection approaches rely on image-based features extracted via neural networks. We frame deepfake detection as a Deepfake Detection VQA (DD-VQA) task and model human intuition. We introduce a new annotated dataset and propose a Vision and Language Transformer-based framework for the DD-VQA task.
  arXiv  Detail & Related papers  (2024-01-31T19:11:58Z)
• Unidirectional brain-computer interface: Artificial neural network encoding natural images to fMRI response in the visual cortex [12.1427193917406]
  We propose an artificial neural network dubbed VISION to mimic the human brain and show how it can foster neuroscientific inquiries. VISION successfully predicts human hemodynamic responses as fMRI voxel values to visual inputs with an accuracy exceeding state-of-the-art performance by 45%.
  arXiv  Detail & Related papers  (2023-09-26T15:38:26Z)
• Real Face Foundation Representation Learning for Generalized Deepfake Detection [74.4691295738097]
  The emergence of deepfake technologies has become a matter of social concern as they pose threats to individual privacy and public security. It is almost impossible to collect sufficient representative fake faces, and it is hard for existing detectors to generalize to all types of manipulation. We propose Real Face Foundation Representation Learning (RFFR), which aims to learn a general representation from large-scale real face datasets.
  arXiv  Detail & Related papers  (2023-03-15T08:27:56Z)
• Leveraging Human Selective Attention for Medical Image Analysis with Limited Training Data [72.1187887376849]
  The selective attention mechanism helps the cognition system focus on task-relevant visual clues by ignoring the presence of distractors. We propose a framework to leverage gaze for medical image analysis tasks with small training data. Our method is demonstrated to achieve superior performance on both 3D tumor segmentation and 2D chest X-ray classification tasks.
  arXiv  Detail & Related papers  (2021-12-02T07:55:25Z)
• Representative Forgery Mining for Fake Face Detection [52.896286647898386]
  We propose an attention-based data augmentation framework to guide detector refine and enlarge its attention. Our method tracks and occludes the Top-N sensitive facial regions, encouraging the detector to mine deeper into the regions ignored before for more representative forgery.
  arXiv  Detail & Related papers  (2021-04-14T03:24:19Z)
• Introducing Representations of Facial Affect in Automated Multimodal Deception Detection [18.16596562087374]
  Automated deception detection systems can enhance health, justice, and security in society. This paper presents a novel analysis of the power of dimensional representations of facial affect for automated deception detection. We used a video dataset of people communicating truthfully or deceptively in real-world, high-stakes courtroom situations.
  arXiv  Detail & Related papers  (2020-08-31T05:12:57Z)
• A Developmental Neuro-Robotics Approach for Boosting the Recognition of Handwritten Digits [91.3755431537592]
  Recent evidence shows that a simulation of the children's embodied strategies can improve the machine intelligence too. This article explores the application of embodied strategies to convolutional neural network models in the context of developmental neuro-robotics.
  arXiv  Detail & Related papers  (2020-03-23T14:55:00Z)
• Continuous Emotion Recognition via Deep Convolutional Autoencoder and Support Vector Regressor [70.2226417364135]
  It is crucial that the machine should be able to recognize the emotional state of the user with high accuracy. Deep neural networks have been used with great success in recognizing emotions. We present a new model for continuous emotion recognition based on facial expression recognition.
  arXiv  Detail & Related papers  (2020-01-31T17:47:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.