Identity masking effectiveness and gesture recognition: Effects of eye enhancement in seeing through the mask

• URL: http://arxiv.org/abs/2301.08408v1
• Date: Fri, 20 Jan 2023 03:10:19 GMT
• Title: Identity masking effectiveness and gesture recognition: Effects of eye enhancement in seeing through the mask
• Authors: Madeline Rachow, Thomas Karnowski and Alice J. O'Toole
• Abstract summary: Face identity masking algorithms are designed to interfere with identification, while preserving information about facial actions. We evaluated the effectiveness of identity-masking algorithms based on Canny filters, applied with and without eye enhancement. We conclude that relatively simple, filter-based masking algorithms can be used in privacy protection without compromising action perception.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Face identity masking algorithms developed in recent years aim to protect the privacy of people in video recordings. These algorithms are designed to interfere with identification, while preserving information about facial actions. An important challenge is to preserve subtle actions in the eye region, while obscuring the salient identity cues from the eyes. We evaluated the effectiveness of identity-masking algorithms based on Canny filters, applied with and without eye enhancement, for interfering with identification and preserving facial actions. In Experiments 1 and 2, we tested human participants' ability to match the facial identity of a driver in a low resolution video to a high resolution facial image. Results showed that both masking methods impaired identification, and that eye enhancement did not alter the effectiveness of the Canny filter mask. In Experiment 3, we tested action preservation and found that neither method interfered significantly with driver action perception. We conclude that relatively simple, filter-based masking algorithms, which are suitable for application to low quality video, can be used in privacy protection without compromising action perception.

Related papers

• ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification [60.73617868629575]
  misuse of deep learning-based facial manipulation poses a potential threat to civil rights. To prevent this fraud at its source, proactive defense technology was proposed to disrupt the manipulation process. We propose a novel universal framework for combating facial manipulation, called ID-Guard.
  arXiv  Detail & Related papers  (2024-09-20T09:30:08Z)
• Seeing through the Mask: Multi-task Generative Mask Decoupling Face Recognition [47.248075664420874]
  Current general face recognition system suffers from serious performance degradation when encountering occluded scenes. This paper proposes a Multi-task gEnerative mask dEcoupling face Recognition (MEER) network to jointly handle these two tasks. We first present a novel mask decoupling module to disentangle mask and identity information, which makes the network obtain purer identity features from visible facial components.
  arXiv  Detail & Related papers  (2023-11-20T03:23:03Z)
• Deep Learning based CNN Model for Classification and Detection of Individuals Wearing Face Mask [0.0]
  This project utilizes deep learning to create a model that can detect face masks in real-time streaming video as well as images. The primary focus of this research is to enhance security, particularly in sensitive areas. The research unfolds in three stages: image pre-processing, image cropping, and image classification.
  arXiv  Detail & Related papers  (2023-11-17T09:24:04Z)
• Diff-Privacy: Diffusion-based Face Privacy Protection [58.1021066224765]
  In this paper, we propose a novel face privacy protection method based on diffusion models, dubbed Diff-Privacy. Specifically, we train our proposed multi-scale image inversion module (MSI) to obtain a set of SDM format conditional embeddings of the original image. Based on the conditional embeddings, we design corresponding embedding scheduling strategies and construct different energy functions during the denoising process to achieve anonymization and visual identity information hiding.
  arXiv  Detail & Related papers  (2023-09-11T09:26:07Z)
• The Effect of Wearing a Face Mask on Face Image Quality [4.189643331553922]
  This work studies the effect of wearing a face mask on face image quality by utilising state-of-the-art face image quality assessment methods. We discuss the correlation between the mask effect on face image quality and that on the face verification performance by automatic systems and human experts.
  arXiv  Detail & Related papers  (2021-10-21T17:12:21Z)
• On the Effect of Selfie Beautification Filters on Face Detection and Recognition [53.561797148529664]
  Social media image filters modify the image contrast or illumination or occlude parts of the face with for example artificial glasses or animal noses. We develop a method to reconstruct the applied manipulation with a modified version of the U-NET segmentation network. From a recognition perspective, we employ distance measures and trained machine learning algorithms applied to features extracted using a ResNet-34 network trained to recognize faces.
  arXiv  Detail & Related papers  (2021-10-17T22:10:56Z)
• Towards NIR-VIS Masked Face Recognition [47.00916333095693]
  Near-infrared to visible (NIR-VIS) face recognition is the most common case in heterogeneous face recognition. We propose a novel training method to maximize the mutual information shared by the face representation of two domains. In addition, a 3D face reconstruction based approach is employed to synthesize masked face from the existing NIR image.
  arXiv  Detail & Related papers  (2021-04-14T10:40:09Z)
• Unmasking Face Embeddings by Self-restrained Triplet Loss for Accurate Masked Face Recognition [6.865656740940772]
  We present a solution to improve the masked face recognition performance. Specifically, we propose the Embedding Unmasking Model (EUM) operated on top of existing face recognition models. We also propose a novel loss function, the Self-restrained Triplet (SRT), which enabled the EUM to produce embeddings similar to these of unmasked faces of the same identities.
  arXiv  Detail & Related papers  (2021-03-02T13:43:11Z)
• Deep Learning Framework to Detect Face Masks from Video Footage [0.0]
  We propose an approach for detecting facial masks in videos using deep learning. The proposed framework capitalizes on the MTCNN face detection model to identify the faces and their corresponding facial landmarks present in the video frame. The proposed methodology demonstrated its effectiveness in detecting facial masks by achieving high precision, recall, and accuracy.
  arXiv  Detail & Related papers  (2020-11-04T16:02:03Z)
• The Effect of Wearing a Mask on Face Recognition Performance: an Exploratory Study [17.577672647262116]
  Face recognition has become essential in our daily lives as a convenient and contactless method of accurate identity verification. The recent COVID-19 pandemic have increased the value of hygienic and contactless identity verification. The effect of wearing a mask on face recognition in a collaborative environment is currently sensitive yet understudied.
  arXiv  Detail & Related papers  (2020-07-27T13:03:32Z)
• Towards Face Encryption by Generating Adversarial Identity Masks [53.82211571716117]
  We propose a targeted identity-protection iterative method (TIP-IM) to generate adversarial identity masks. TIP-IM provides 95%+ protection success rate against various state-of-the-art face recognition models.
  arXiv  Detail & Related papers  (2020-03-15T12:45:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.