Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations

• URL: http://arxiv.org/abs/2201.12084v1
• Date: Fri, 28 Jan 2022 12:45:33 GMT
• Title: Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations
• Authors: Robert Nichols, Christian Rathgeb, Pawel Drozdowski, Christoph Busch
• Abstract summary: This work introduces a web-based, remote visual discrimination experiment on the basis of principles adopted from the field of psychophysics. We examine human proficiency in detecting different types of digitally manipulated face images, specifically face swapping, morphing, and retouching.
• Score: 14.63266615325105
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In recent years, increasing deployment of face recognition technology in security-critical settings, such as border control or law enforcement, has led to considerable interest in the vulnerability of face recognition systems to attacks utilising legitimate documents, which are issued on the basis of digitally manipulated face images. As automated manipulation and attack detection remains a challenging task, conventional processes with human inspectors performing identity verification remain indispensable. These circumstances merit a closer investigation of human capabilities in detecting manipulated face images, as previous work in this field is sparse and often concentrated only on specific scenarios and biometric characteristics. This work introduces a web-based, remote visual discrimination experiment on the basis of principles adopted from the field of psychophysics and subsequently discusses interdisciplinary opportunities with the aim of examining human proficiency in detecting different types of digitally manipulated face images, specifically face swapping, morphing, and retouching. In addition to analysing appropriate performance measures, a possible metric of detectability is explored. Experimental data of 306 probands indicate that detection performance is widely distributed across the population and detection of certain types of face image manipulations is much more challenging than others.

Related papers

• ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification [60.73617868629575]
  misuse of deep learning-based facial manipulation poses a potential threat to civil rights. To prevent this fraud at its source, proactive defense technology was proposed to disrupt the manipulation process. We propose a novel universal framework for combating facial manipulation, called ID-Guard.
  arXiv  Detail & Related papers  (2024-09-20T09:30:08Z)
• Semantic Contextualization of Face Forgery: A New Definition, Dataset, and Detection Method [77.65459419417533]
  We put face forgery in a semantic context and define that computational methods that alter semantic face attributes are sources of face forgery. We construct a large face forgery image dataset, where each image is associated with a set of labels organized in a hierarchical graph. We propose a semantics-oriented face forgery detection method that captures label relations and prioritizes the primary task.
  arXiv  Detail & Related papers  (2024-05-14T10:24:19Z)
• Exploring Decision-based Black-box Attacks on Face Forgery Detection [53.181920529225906]
  Face forgery generation technologies generate vivid faces, which have raised public concerns about security and privacy. Although face forgery detection has successfully distinguished fake faces, recent studies have demonstrated that face forgery detectors are very vulnerable to adversarial examples.
  arXiv  Detail & Related papers  (2023-10-18T14:49:54Z)
• Impact of Image Context for Single Deep Learning Face Morphing Attack Detection [0.0]
  Face recognition systems (FRSs) have become prevalent, but they are still vulnerable to image manipulation techniques such as face morphing attacks. This study investigates the impact of the alignment settings of input images on deep learning face morphing detection performance.
  arXiv  Detail & Related papers  (2023-09-01T15:57:24Z)
• Robustness Disparities in Face Detection [64.71318433419636]
  We present the first of its kind detailed benchmark of face detection systems, specifically examining the robustness to noise of commercial and academic models. Across all the datasets and systems, we generally find that photos of individuals who are $textitmasculine presenting$, of $textitolder$, of $textitdarker skin type$, or have $textitdim lighting$ are more susceptible to errors than their counterparts in other identities.
  arXiv  Detail & Related papers  (2022-11-29T05:22:47Z)
• Detect Faces Efficiently: A Survey and Evaluations [13.105528567365281]
  Many applications including face recognition, facial expression recognition, face tracking and head-pose estimation assume that both the location and the size of faces are known in the image. Deep learning techniques brought remarkable breakthroughs to face detection along with the price of a considerable increase in computation. This paper introduces representative deep learning-based methods and presents a deep and thorough analysis in terms of accuracy and efficiency.
  arXiv  Detail & Related papers  (2021-12-03T08:39:40Z)
• Evaluation of Human and Machine Face Detection using a Novel Distinctive Human Appearance Dataset [0.76146285961466]
  We evaluate current state-of-the-art face-detection models in their ability to detect faces in images. The evaluation results show that face-detection algorithms do not generalize well to diverse appearances.
  arXiv  Detail & Related papers  (2021-11-01T02:20:40Z)
• Differential Anomaly Detection for Facial Images [15.54185745912878]
  Identity attacks pose a big security threat as they can be used to gain unauthorised access and spread misinformation. Most algorithms for detecting identity attacks generalise poorly to attack types that are unknown at training time. We introduce a differential anomaly detection framework in which deep face embeddings are first extracted from pairs of images.
  arXiv  Detail & Related papers  (2021-10-07T13:45:13Z)
• Robust Face-Swap Detection Based on 3D Facial Shape Information [59.32489266682952]
  Face-swap images and videos have attracted more and more malicious attackers to discredit some key figures. Previous pixel-level artifacts based detection techniques always focus on some unclear patterns but ignore some available semantic clues. We propose a biometric information based method to fully exploit the appearance and shape feature for face-swap detection of key figures.
  arXiv  Detail & Related papers  (2021-04-28T09:35:48Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.