SVIA: A Street View Image Anonymization Framework for Self-Driving Applications

• URL: http://arxiv.org/abs/2501.09393v1
• Date: Thu, 16 Jan 2025 09:05:46 GMT
• Title: SVIA: A Street View Image Anonymization Framework for Self-Driving Applications
• Authors: Dongyu Liu, Xuhong Wang, Cen Chen, Yanhao Wang, Shengyue Yao, Yilun Lin,
• Abstract summary: We propose a Street View Image Anonymization framework for self-driving applications. The SVIA framework consists of three integral components: a semantic segmenter, an inpainter to generate alternatives to privacy-sensitive regions, and a harmonizer to seamlessly stitch modified regions. Compared to existing methods, SVIA achieves a much better trade-off between image generation quality and privacy protection.
• Score: 18.30159119462861
• License:
• Abstract: In recent years, there has been an increasing interest in image anonymization, particularly focusing on the de-identification of faces and individuals. However, for self-driving applications, merely de-identifying faces and individuals might not provide sufficient privacy protection since street views like vehicles and buildings can still disclose locations, trajectories, and other sensitive information. Therefore, it remains crucial to extend anonymization techniques to street view images to fully preserve the privacy of users, pedestrians, and vehicles. In this paper, we propose a Street View Image Anonymization (SVIA) framework for self-driving applications. The SVIA framework consists of three integral components: a semantic segmenter to segment an input image into functional regions, an inpainter to generate alternatives to privacy-sensitive regions, and a harmonizer to seamlessly stitch modified regions to guarantee visual coherence. Compared to existing methods, SVIA achieves a much better trade-off between image generation quality and privacy protection, as evidenced by experimental results for five common metrics on two widely used public datasets.

Related papers

• Diff-Privacy: Diffusion-based Face Privacy Protection [58.1021066224765]
  In this paper, we propose a novel face privacy protection method based on diffusion models, dubbed Diff-Privacy. Specifically, we train our proposed multi-scale image inversion module (MSI) to obtain a set of SDM format conditional embeddings of the original image. Based on the conditional embeddings, we design corresponding embedding scheduling strategies and construct different energy functions during the denoising process to achieve anonymization and visual identity information hiding.
  arXiv  Detail & Related papers  (2023-09-11T09:26:07Z)
• PRO-Face S: Privacy-preserving Reversible Obfuscation of Face Images via Secure Flow [69.78820726573935]
  We name it PRO-Face S, short for Privacy-preserving Reversible Obfuscation of Face images via Secure flow-based model. In the framework, an Invertible Neural Network (INN) is utilized to process the input image along with its pre-obfuscated form, and generate the privacy protected image that visually approximates to the pre-obfuscated one.
  arXiv  Detail & Related papers  (2023-07-18T10:55:54Z)
• Learnable Privacy-Preserving Anonymization for Pedestrian Images [27.178354411900127]
  This paper studies a novel privacy-preserving anonymization problem for pedestrian images. It preserves personal identity information (PII) for authorized models and prevents PII from being recognized by third parties. We propose a joint learning reversible anonymization framework, which can reversibly generate full-body anonymous images.
  arXiv  Detail & Related papers  (2022-07-24T07:04:16Z)
• Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domain [77.8858706250075]
  This paper proposes a privacy-preserving face recognition method using differential privacy in the frequency domain. Our method performs very well with several classical face recognition test sets.
  arXiv  Detail & Related papers  (2022-07-15T07:15:36Z)
• OPOM: Customized Invisible Cloak towards Face Privacy Protection [58.07786010689529]
  We investigate the face privacy protection from a technology standpoint based on a new type of customized cloak. We propose a new method, named one person one mask (OPOM), to generate person-specific (class-wise) universal masks. The effectiveness of the proposed method is evaluated on both common and celebrity datasets.
  arXiv  Detail & Related papers  (2022-05-24T11:29:37Z)
• IdentityDP: Differential Private Identification Protection for Face Images [17.33916392050051]
  Face de-identification, also known as face anonymization, refers to generating another image with similar appearance and the same background, while the real identity is hidden. We propose IdentityDP, a face anonymization framework that combines a data-driven deep neural network with a differential privacy mechanism. Our model can effectively obfuscate the identity-related information of faces, preserve significant visual similarity, and generate high-quality images.
  arXiv  Detail & Related papers  (2021-03-02T14:26:00Z)
• Toward Privacy and Utility Preserving Image Representation [26.768476643200664]
  We study the novel problem of creating privacy-preserving image representations with respect to a given utility task. We propose a principled framework called the Adversarial Image Anonymizer (AIA) AIA first creates an image representation using a generative model, then enhances the learned image representations using adversarial learning to preserve privacy and utility for a given task.
  arXiv  Detail & Related papers  (2020-09-30T01:25:00Z)
• InfoScrub: Towards Attribute Privacy by Targeted Obfuscation [77.49428268918703]
  We study techniques that allow individuals to limit the private information leaked in visual data. We tackle this problem in a novel image obfuscation framework. We find our approach generates obfuscated images faithful to the original input images, and additionally increase uncertainty by 6.2$times$ (or up to 0.85 bits) over the non-obfuscated counterparts.
  arXiv  Detail & Related papers  (2020-05-20T19:48:04Z)
• CIAGAN: Conditional Identity Anonymization Generative Adversarial Networks [12.20367903755194]
  CIAGAN is a model for image and video anonymization based on conditional generative adversarial networks. Our model is able to remove the identifying characteristics of faces and bodies while producing high-quality images and videos.
  arXiv  Detail & Related papers  (2020-05-19T15:56:08Z)
• Towards Face Encryption by Generating Adversarial Identity Masks [53.82211571716117]
  We propose a targeted identity-protection iterative method (TIP-IM) to generate adversarial identity masks. TIP-IM provides 95%+ protection success rate against various state-of-the-art face recognition models.
  arXiv  Detail & Related papers  (2020-03-15T12:45:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.