Selective manipulation of disentangled representations for privacy-aware facial image processing

• URL: http://arxiv.org/abs/2208.12632v1
• Date: Fri, 26 Aug 2022 12:47:18 GMT
• Title: Selective manipulation of disentangled representations for privacy-aware facial image processing
• Authors: Sander De Coninck, Wei-Cheng Wang, Sam Leroux, Pieter Simoens
• Abstract summary: We propose an edge-based filtering stage that removes privacy-sensitive attributes before the sensor data are transmitted to the cloud. We use state-of-the-art image manipulation techniques that leverage disentangled representations to achieve privacy filtering.
• Score: 5.612561387428165
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Camera sensors are increasingly being combined with machine learning to perform various tasks such as intelligent surveillance. Due to its computational complexity, most of these machine learning algorithms are offloaded to the cloud for processing. However, users are increasingly concerned about privacy issues such as function creep and malicious usage by third-party cloud providers. To alleviate this, we propose an edge-based filtering stage that removes privacy-sensitive attributes before the sensor data are transmitted to the cloud. We use state-of-the-art image manipulation techniques that leverage disentangled representations to achieve privacy filtering. We define opt-in and opt-out filter operations and evaluate their effectiveness for filtering private attributes from face images. Additionally, we examine the effect of naturally occurring correlations and residual information on filtering. We find the results promising and believe this elicits further research on how image manipulation can be used for privacy preservation.

Related papers

• Masked Differential Privacy [64.32494202656801]
  We propose an effective approach called masked differential privacy (DP), which allows for controlling sensitive regions where differential privacy is applied. Our method operates selectively on data and allows for defining non-sensitive-temporal regions without DP application or combining differential privacy with other privacy techniques within data samples.
  arXiv  Detail & Related papers  (2024-10-22T15:22:53Z)
• Diff-Privacy: Diffusion-based Face Privacy Protection [58.1021066224765]
  In this paper, we propose a novel face privacy protection method based on diffusion models, dubbed Diff-Privacy. Specifically, we train our proposed multi-scale image inversion module (MSI) to obtain a set of SDM format conditional embeddings of the original image. Based on the conditional embeddings, we design corresponding embedding scheduling strategies and construct different energy functions during the denoising process to achieve anonymization and visual identity information hiding.
  arXiv  Detail & Related papers  (2023-09-11T09:26:07Z)
• PrivacyProber: Assessment and Detection of Soft-Biometric Privacy-Enhancing Techniques [1.790445868185437]
  We study the robustness of several state-of-the-art soft-biometric privacy-enhancing techniques to attribute recovery attempts. We propose PrivacyProber, a high-level framework for restoring soft-biometric information from privacy-enhanced facial images.
  arXiv  Detail & Related papers  (2022-11-16T12:20:18Z)
• On the Design of Privacy-Aware Cameras: a Study on Deep Neural Networks [0.7646713951724011]
  This paper studies the effect of camera distortions on data protection. We build a privacy-aware camera that cannot extract personal information such as license plate numbers. At the same time, we ensure that useful non-sensitive data can still be extracted from distorted images.
  arXiv  Detail & Related papers  (2022-08-24T08:45:31Z)
• Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domain [77.8858706250075]
  This paper proposes a privacy-preserving face recognition method using differential privacy in the frequency domain. Our method performs very well with several classical face recognition test sets.
  arXiv  Detail & Related papers  (2022-07-15T07:15:36Z)
• On the Effect of Selfie Beautification Filters on Face Detection and Recognition [53.561797148529664]
  Social media image filters modify the image contrast or illumination or occlude parts of the face with for example artificial glasses or animal noses. We develop a method to reconstruct the applied manipulation with a modified version of the U-NET segmentation network. From a recognition perspective, we employ distance measures and trained machine learning algorithms applied to features extracted using a ResNet-34 network trained to recognize faces.
  arXiv  Detail & Related papers  (2021-10-17T22:10:56Z)
• Privacy-Preserving Image Acquisition Using Trainable Optical Kernel [50.1239616836174]
  We propose a trainable image acquisition method that removes the sensitive identity revealing information in the optical domain before it reaches the image sensor. As the sensitive content is suppressed before it reaches the image sensor, it does not enter the digital domain therefore is unretrievable by any sort of privacy attack.
  arXiv  Detail & Related papers  (2021-06-28T11:08:14Z)
• SocialGuard: An Adversarial Example Based Privacy-Preserving Technique for Social Images [6.321399006735314]
  We propose a novel adversarial example based privacy-preserving technique for social images against object detectors based privacy stealing. We use two metrics, privacy-preserving success rate and privacy leakage rate, to evaluate the effectiveness of the proposed method. The privacy-preserving success rates of the proposed method on MS-COCO and PASCAL VOC 2007 datasets are high up to 96.1% and 99.3%, respectively.
  arXiv  Detail & Related papers  (2020-11-27T05:12:47Z)
• Privacy-Preserving Pose Estimation for Human-Robot Interaction [8.905235622945254]
  We propose a privacy-preserving camera-based pose estimation method. The proposed system consists of a user-controlled translucent filter that covers the camera. We evaluate the system's performance on a new filtered image dataset.
  arXiv  Detail & Related papers  (2020-11-14T21:09:53Z)
• Privacy-Preserving Image Features via Adversarial Affine Subspace Embeddings [72.68801373979943]
  Many computer vision systems require users to upload image features to the cloud for processing and storage. We propose a new privacy-preserving feature representation. Compared to the original features, our approach makes it significantly more difficult for an adversary to recover private information.
  arXiv  Detail & Related papers  (2020-06-11T17:29:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.