Privacy-Preserving Semantic Segmentation without Key Management

• URL: http://arxiv.org/abs/2604.16523v1
• Date: Thu, 16 Apr 2026 10:45:58 GMT
• Title: Privacy-Preserving Semantic Segmentation without Key Management
• Abstract summary: This paper proposes a novel privacy-preserving semantic segmentation method that can use independent keys for each client and image.<n>In experiments, the effectiveness of the proposed method is confirmed on the Cityscapes dataset under the use of a vision transformer-based model, called SETR.
• Score: 1.2744523252873348
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper proposes a novel privacy-preserving semantic segmentation method that can use independent keys for each client and image. In the proposed method, the model creator and each client encrypt images using locally generated keys, and model training and inference are conducted on the encrypted images. To mitigate performance degradation, an image encryption method is applied to model training in addition to the generation of test images. In experiments, the effectiveness of the proposed method is confirmed on the Cityscapes dataset under the use of a vision transformer-based model, called SETR.

Related papers

• Neural Scene Designer: Self-Styled Semantic Image Manipulation [67.43125248646653]
  We introduce the Neural Scene Designer (NSD), a novel framework that enables photo-realistic manipulation of user-specified scene regions.<n>NSD ensures both semantic alignment with user intent and stylistic consistency with the surrounding environment.<n>To capture fine-grained style representations, we propose the Progressive Self-style Representational Learning (PSRL) module.
  arXiv  Detail & Related papers  (2025-09-01T11:59:03Z)
• A Privacy-Preserving Semantic-Segmentation Method Using Domain-Adaptation Technique [5.311735227179715]
  We propose a privacy-preserving semantic-segmentation method for applying perceptual encryption to images used for model training and test images.<n>This method also provides almost the same accuracy as models without any encryption.
  arXiv  Detail & Related papers  (2025-07-17T02:14:50Z)
• Enhancing Privacy-Utility Trade-offs to Mitigate Memorization in Diffusion Models [62.979954692036685]
  We introduce PRSS, which refines the classifier-free guidance approach in diffusion models by integrating prompt re-anchoring and semantic prompt search.<n>Our approach consistently improves the privacy-utility trade-off, establishing a new state-of-the-art.
  arXiv  Detail & Related papers  (2025-04-25T02:51:23Z)
• Disposable-key-based image encryption for collaborative learning of Vision Transformer [5.762345156477736]
  We propose a novel method for securely training the vision transformer (ViT) with sensitive data shared from multiple clients similar to privacy-preserving federated learning. In the proposed method, training images are independently encrypted by each client where encryption keys can be prepared by each client, and ViT is trained by using these encrypted images for the first time.
  arXiv  Detail & Related papers  (2024-08-11T09:55:37Z)
• PRO-Face S: Privacy-preserving Reversible Obfuscation of Face Images via Secure Flow [69.78820726573935]
  We name it PRO-Face S, short for Privacy-preserving Reversible Obfuscation of Face images via Secure flow-based model. In the framework, an Invertible Neural Network (INN) is utilized to process the input image along with its pre-obfuscated form, and generate the privacy protected image that visually approximates to the pre-obfuscated one.
  arXiv  Detail & Related papers  (2023-07-18T10:55:54Z)
• DIAGNOSIS: Detecting Unauthorized Data Usages in Text-to-image Diffusion Models [79.71665540122498]
  We propose a method for detecting unauthorized data usage by planting the injected content into the protected dataset. Specifically, we modify the protected images by adding unique contents on these images using stealthy image warping functions. By analyzing whether the model has memorized the injected content, we can detect models that had illegally utilized the unauthorized data.
  arXiv  Detail & Related papers  (2023-07-06T16:27:39Z)
• Taming Encoder for Zero Fine-tuning Image Customization with Text-to-Image Diffusion Models [55.04969603431266]
  This paper proposes a method for generating images of customized objects specified by users. The method is based on a general framework that bypasses the lengthy optimization required by previous approaches. We demonstrate through experiments that our proposed method is able to synthesize images with compelling output quality, appearance diversity, and object fidelity.
  arXiv  Detail & Related papers  (2023-04-05T17:59:32Z)
• An Access Control Method with Secret Key for Semantic Segmentation Models [12.27887776401573]
  A novel method for access control with a secret key is proposed to protect models from unauthorized access. We focus on semantic segmentation models with the vision transformer (ViT), called segmentation transformer (SETR)
  arXiv  Detail & Related papers  (2022-08-28T04:09:36Z)
• An Encryption Method of ConvMixer Models without Performance Degradation [14.505867475659276]
  We propose an encryption method for ConvMixer models with a secret key. The effectiveness of the proposed method is evaluated in terms of classification accuracy and model protection.
  arXiv  Detail & Related papers  (2022-07-25T07:09:16Z)
• Image and Model Transformation with Secret Key for Vision Transformer [16.055655429920993]
  We show for the first time that models trained with plain images can be directly transformed to models trained with encrypted images. The performance of the transformed models is the same as models trained with plain images when using test images encrypted with the key.
  arXiv  Detail & Related papers  (2022-07-12T08:02:47Z)
• Semantic Image Synthesis via Diffusion Models [174.24523061460704]
  Denoising Diffusion Probabilistic Models (DDPMs) have achieved remarkable success in various image generation tasks.<n>Recent work on semantic image synthesis mainly follows the de facto GAN-based approaches.<n>We propose a novel framework based on DDPM for semantic image synthesis.
  arXiv  Detail & Related papers  (2022-06-30T18:31:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.