PrivacyProber: Assessment and Detection of Soft-Biometric
Privacy-Enhancing Techniques
- URL: http://arxiv.org/abs/2211.08864v1
- Date: Wed, 16 Nov 2022 12:20:18 GMT
- Title: PrivacyProber: Assessment and Detection of Soft-Biometric
Privacy-Enhancing Techniques
- Authors: Peter Rot, Peter Peer, Vitomir \v{S}truc
- Abstract summary: We study the robustness of several state-of-the-art soft-biometric privacy-enhancing techniques to attribute recovery attempts.
We propose PrivacyProber, a high-level framework for restoring soft-biometric information from privacy-enhanced facial images.
- Score: 1.790445868185437
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Soft-biometric privacy-enhancing techniques represent machine learning
methods that aim to: (i) mitigate privacy concerns associated with face
recognition technology by suppressing selected soft-biometric attributes in
facial images (e.g., gender, age, ethnicity) and (ii) make unsolicited
extraction of sensitive personal information infeasible. Because such
techniques are increasingly used in real-world applications, it is imperative
to understand to what extent the privacy enhancement can be inverted and how
much attribute information can be recovered from privacy-enhanced images. While
these aspects are critical, they have not been investigated in the literature.
We, therefore, study the robustness of several state-of-the-art soft-biometric
privacy-enhancing techniques to attribute recovery attempts. We propose
PrivacyProber, a high-level framework for restoring soft-biometric information
from privacy-enhanced facial images, and apply it for attribute recovery in
comprehensive experiments on three public face datasets, i.e., LFW, MUCT and
Adience. Our experiments show that the proposed framework is able to restore a
considerable amount of suppressed information, regardless of the
privacy-enhancing technique used, but also that there are significant
differences between the considered privacy models. These results point to the
need for novel mechanisms that can improve the robustness of existing
privacy-enhancing techniques and secure them against potential adversaries
trying to restore suppressed information.
Related papers
- Masked Differential Privacy [64.32494202656801]
We propose an effective approach called masked differential privacy (DP), which allows for controlling sensitive regions where differential privacy is applied.
Our method operates selectively on data and allows for defining non-sensitive-temporal regions without DP application or combining differential privacy with other privacy techniques within data samples.
arXiv Detail & Related papers (2024-10-22T15:22:53Z) - Privacy-preserving Optics for Enhancing Protection in Face De-identification [60.110274007388135]
We propose a hardware-level face de-identification method to solve this vulnerability.
We also propose an anonymization framework that generates a new face using the privacy-preserving image, face heatmap, and a reference face image from a public dataset as input.
arXiv Detail & Related papers (2024-03-31T19:28:04Z) - OpticalDR: A Deep Optical Imaging Model for Privacy-Protective
Depression Recognition [66.91236298878383]
Depression Recognition (DR) poses a considerable challenge, especially in the context of privacy concerns.
We design a new imaging system to erase the identity information of captured facial images while retain disease-relevant features.
It is irreversible for identity information recovery while preserving essential disease-related characteristics necessary for accurate DR.
arXiv Detail & Related papers (2024-02-29T01:20:29Z) - Reversing Deep Face Embeddings with Probable Privacy Protection [6.492755549391469]
State-of-the-art face image reconstruction approach has been evaluated on protected face embeddings to break soft biometric privacy protection.
Results show that biometric privacy-enhanced face embeddings can be reconstructed with an accuracy of up to approximately 98%.
arXiv Detail & Related papers (2023-10-04T17:48:23Z) - Diff-Privacy: Diffusion-based Face Privacy Protection [58.1021066224765]
In this paper, we propose a novel face privacy protection method based on diffusion models, dubbed Diff-Privacy.
Specifically, we train our proposed multi-scale image inversion module (MSI) to obtain a set of SDM format conditional embeddings of the original image.
Based on the conditional embeddings, we design corresponding embedding scheduling strategies and construct different energy functions during the denoising process to achieve anonymization and visual identity information hiding.
arXiv Detail & Related papers (2023-09-11T09:26:07Z) - OPOM: Customized Invisible Cloak towards Face Privacy Protection [58.07786010689529]
We investigate the face privacy protection from a technology standpoint based on a new type of customized cloak.
We propose a new method, named one person one mask (OPOM), to generate person-specific (class-wise) universal masks.
The effectiveness of the proposed method is evaluated on both common and celebrity datasets.
arXiv Detail & Related papers (2022-05-24T11:29:37Z) - An Attack on Feature Level-based Facial Soft-biometric Privacy
Enhancement [13.780253190395715]
We introduce an attack on feature level-based facial soft-biometric privacy-enhancement techniques.
It is able to circumvent the privacy enhancement to a considerable degree and is able to correctly classify gender with an accuracy of up to approximately 90%.
arXiv Detail & Related papers (2021-11-24T10:41:15Z) - Towards Face Encryption by Generating Adversarial Identity Masks [53.82211571716117]
We propose a targeted identity-protection iterative method (TIP-IM) to generate adversarial identity masks.
TIP-IM provides 95%+ protection success rate against various state-of-the-art face recognition models.
arXiv Detail & Related papers (2020-03-15T12:45:10Z) - Unsupervised Enhancement of Soft-biometric Privacy with Negative Face
Recognition [13.555831336280407]
We present Negative Face Recognition (NFR), a novel face recognition approach that enhances the soft-biometric privacy on the template-level.
Our approach does not require privacy-sensitive labels and offers a more comprehensive privacy-protection not limited to pre-defined attributes.
arXiv Detail & Related papers (2020-02-21T08:37:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.