Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domain

• URL: http://arxiv.org/abs/2207.07316v3
• Date: Tue, 19 Jul 2022 09:43:15 GMT
• Title: Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domain
• Authors: Jiazhen Ji, Huan Wang, Yuge Huang, Jiaxiang Wu, Xingkun Xu, Shouhong Ding, ShengChuan Zhang, Liujuan Cao, Rongrong Ji
• Abstract summary: This paper proposes a privacy-preserving face recognition method using differential privacy in the frequency domain. Our method performs very well with several classical face recognition test sets.
• Score: 77.8858706250075
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Face recognition technology has been used in many fields due to its high recognition accuracy, including the face unlocking of mobile devices, community access control systems, and city surveillance. As the current high accuracy is guaranteed by very deep network structures, facial images often need to be transmitted to third-party servers with high computational power for inference. However, facial images visually reveal the user's identity information. In this process, both untrusted service providers and malicious users can significantly increase the risk of a personal privacy breach. Current privacy-preserving approaches to face recognition are often accompanied by many side effects, such as a significant increase in inference time or a noticeable decrease in recognition accuracy. This paper proposes a privacy-preserving face recognition method using differential privacy in the frequency domain. Due to the utilization of differential privacy, it offers a guarantee of privacy in theory. Meanwhile, the loss of accuracy is very slight. This method first converts the original image to the frequency domain and removes the direct component termed DC. Then a privacy budget allocation method can be learned based on the loss of the back-end face recognition network within the differential privacy framework. Finally, it adds the corresponding noise to the frequency domain features. Our method performs very well with several classical face recognition test sets according to the extensive experiments.

Related papers

• A Machine Learning-Based Secure Face Verification Scheme and Its Applications to Digital Surveillance [0.9208007322096533]
  Most real-world recognition systems ignore the importance of protecting the identity-sensitive facial images that are used for verification. We use the DeepID2 convolutional neural network to extract the features of a facial image and an EM algorithm to solve the facial verification problem. We develop three face verification systems for surveillance (or entrance) control of a local community based on three levels of privacy concerns.
  arXiv  Detail & Related papers  (2024-10-29T12:25:00Z)
• Privacy-preserving Optics for Enhancing Protection in Face De-identification [60.110274007388135]
  We propose a hardware-level face de-identification method to solve this vulnerability. We also propose an anonymization framework that generates a new face using the privacy-preserving image, face heatmap, and a reference face image from a public dataset as input.
  arXiv  Detail & Related papers  (2024-03-31T19:28:04Z)
• Privacy-Preserving Face Recognition in Hybrid Frequency-Color Domain [16.05230409730324]
  Face image is a sensitive biometric attribute tied to the identity information of each user. This paper proposes a hybrid frequency-color fusion approach to reduce the input dimensionality of face recognition. It has around 2.6% to 4.2% higher accuracy than the state-of-the-art in the 1:N verification scenario.
  arXiv  Detail & Related papers  (2024-01-24T11:27:32Z)
• Diff-Privacy: Diffusion-based Face Privacy Protection [58.1021066224765]
  In this paper, we propose a novel face privacy protection method based on diffusion models, dubbed Diff-Privacy. Specifically, we train our proposed multi-scale image inversion module (MSI) to obtain a set of SDM format conditional embeddings of the original image. Based on the conditional embeddings, we design corresponding embedding scheduling strategies and construct different energy functions during the denoising process to achieve anonymization and visual identity information hiding.
  arXiv  Detail & Related papers  (2023-09-11T09:26:07Z)
• Privacy-Preserving Face Recognition Using Random Frequency Components [46.95003101593304]
  Face recognition has sparked increasing privacy concerns. We propose to conceal visual information by pruning human-perceivable low-frequency components. We distill our findings into a novel privacy-preserving face recognition method, PartialFace.
  arXiv  Detail & Related papers  (2023-08-21T04:31:02Z)
• Enhancing Mobile Privacy and Security: A Face Skin Patch-Based Anti-Spoofing Approach [0.0]
  Face anti-spoofing system(FAS) for face recognition is an important component used to enhance the security of face recognition systems. Traditional FAS used images containing identity information to detect spoofing traces, however there is a risk of privacy leakage during the transmission and storage of these images. We propose a face anti-spoofing algorithm based on facial skin patches leveraging pure facial skin patch images as input.
  arXiv  Detail & Related papers  (2023-08-09T08:36:13Z)
• DuetFace: Collaborative Privacy-Preserving Face Recognition via Channel Splitting in the Frequency Domain [23.4606547767188]
  DuetFace is a privacy-preserving face recognition method that employs collaborative inference in the frequency domain. The proposed method achieves a comparable recognition accuracy and cost to the unprotected ArcFace and outperforms the state-of-the-art privacy-preserving methods.
  arXiv  Detail & Related papers  (2022-07-15T08:35:44Z)
• Towards Face Encryption by Generating Adversarial Identity Masks [53.82211571716117]
  We propose a targeted identity-protection iterative method (TIP-IM) to generate adversarial identity masks. TIP-IM provides 95%+ protection success rate against various state-of-the-art face recognition models.
  arXiv  Detail & Related papers  (2020-03-15T12:45:10Z)
• Investigating the Impact of Inclusion in Face Recognition Training Data on Individual Face Identification [93.5538147928669]
  We audit ArcFace, a state-of-the-art, open source face recognition system, in a large-scale face identification experiment with more than one million distractor images. We find a Rank-1 face identification accuracy of 79.71% for individuals present in the model's training data and an accuracy of 75.73% for those not present.
  arXiv  Detail & Related papers  (2020-01-09T15:50:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.