A Machine Learning-Based Secure Face Verification Scheme and Its Applications to Digital Surveillance
- URL: http://arxiv.org/abs/2410.21993v1
- Date: Tue, 29 Oct 2024 12:25:00 GMT
- Title: A Machine Learning-Based Secure Face Verification Scheme and Its Applications to Digital Surveillance
- Authors: Huan-Chih Wang, Ja-Ling Wu,
- Abstract summary: Most real-world recognition systems ignore the importance of protecting the identity-sensitive facial images that are used for verification.
We use the DeepID2 convolutional neural network to extract the features of a facial image and an EM algorithm to solve the facial verification problem.
We develop three face verification systems for surveillance (or entrance) control of a local community based on three levels of privacy concerns.
- Score: 0.9208007322096533
- License:
- Abstract: Face verification is a well-known image analysis application and is widely used to recognize individuals in contemporary society. However, most real-world recognition systems ignore the importance of protecting the identity-sensitive facial images that are used for verification. To address this problem, we investigate how to implement a secure face verification system that protects the facial images from being imitated. In our work, we use the DeepID2 convolutional neural network to extract the features of a facial image and an EM algorithm to solve the facial verification problem. To maintain the privacy of facial images, we apply homomorphic encryption schemes to encrypt the facial data and compute the EM algorithm in the ciphertext domain. We develop three face verification systems for surveillance (or entrance) control of a local community based on three levels of privacy concerns. The associated timing performances are presented to demonstrate their feasibility for practical implementation.
Related papers
- Privacy-preserving Optics for Enhancing Protection in Face De-identification [60.110274007388135]
We propose a hardware-level face de-identification method to solve this vulnerability.
We also propose an anonymization framework that generates a new face using the privacy-preserving image, face heatmap, and a reference face image from a public dataset as input.
arXiv Detail & Related papers (2024-03-31T19:28:04Z) - Exploring Decision-based Black-box Attacks on Face Forgery Detection [53.181920529225906]
Face forgery generation technologies generate vivid faces, which have raised public concerns about security and privacy.
Although face forgery detection has successfully distinguished fake faces, recent studies have demonstrated that face forgery detectors are very vulnerable to adversarial examples.
arXiv Detail & Related papers (2023-10-18T14:49:54Z) - Diff-Privacy: Diffusion-based Face Privacy Protection [58.1021066224765]
In this paper, we propose a novel face privacy protection method based on diffusion models, dubbed Diff-Privacy.
Specifically, we train our proposed multi-scale image inversion module (MSI) to obtain a set of SDM format conditional embeddings of the original image.
Based on the conditional embeddings, we design corresponding embedding scheduling strategies and construct different energy functions during the denoising process to achieve anonymization and visual identity information hiding.
arXiv Detail & Related papers (2023-09-11T09:26:07Z) - Face Encryption via Frequency-Restricted Identity-Agnostic Attacks [25.198662208981467]
Malicious collectors use deep face recognition systems to easily steal biometric information.
We propose a frequency-restricted identity-agnostic (FRIA) framework to encrypt face images from unauthorized face recognition.
arXiv Detail & Related papers (2023-08-11T07:38:46Z) - Enhancing Mobile Privacy and Security: A Face Skin Patch-Based
Anti-Spoofing Approach [0.0]
Face anti-spoofing system(FAS) for face recognition is an important component used to enhance the security of face recognition systems.
Traditional FAS used images containing identity information to detect spoofing traces, however there is a risk of privacy leakage during the transmission and storage of these images.
We propose a face anti-spoofing algorithm based on facial skin patches leveraging pure facial skin patch images as input.
arXiv Detail & Related papers (2023-08-09T08:36:13Z) - A Comparative Analysis of the Face Recognition Methods in Video
Surveillance Scenarios [0.0]
This study presents comparative benchmark tables for the state-of-art face recognition methods.
We constructed a video surveillance dataset of face IDs with high age variance, intra-class variance (face make-up, beard, etc.) with native surveillance facial imagery data for evaluation.
On the other hand, this work discovers the best recognition methods for different conditions like non-masked faces, masked faces, and faces with glasses.
arXiv Detail & Related papers (2022-11-05T17:59:18Z) - Privacy-Preserving Face Recognition with Learnable Privacy Budgets in
Frequency Domain [77.8858706250075]
This paper proposes a privacy-preserving face recognition method using differential privacy in the frequency domain.
Our method performs very well with several classical face recognition test sets.
arXiv Detail & Related papers (2022-07-15T07:15:36Z) - Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
This work explores facial expression bias as a security vulnerability of face recognition systems.
We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
arXiv Detail & Related papers (2020-11-17T18:12:41Z) - Towards Face Encryption by Generating Adversarial Identity Masks [53.82211571716117]
We propose a targeted identity-protection iterative method (TIP-IM) to generate adversarial identity masks.
TIP-IM provides 95%+ protection success rate against various state-of-the-art face recognition models.
arXiv Detail & Related papers (2020-03-15T12:45:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.