Voice Privacy from an Attribute-based Perspective

• URL: http://arxiv.org/abs/2603.20301v2
• Date: Tue, 24 Mar 2026 12:13:32 GMT
• Title: Voice Privacy from an Attribute-based Perspective
• Abstract summary: We introduce an attribute-based perspective, where we measure privacy protection in terms of comparisons between sets of speaker attributes.<n>We analyze privacy impact by calculating speaker uniqueness for ground truth attributes, attributes inferred on the original speech, and attributes inferred on speech protected with standard anonymization.
• Score: 0.10195618602298682
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Voice privacy approaches that preserve the anonymity of speakers modify speech in an attempt to break the link with the true identity of the speaker. Current benchmarks measure speaker protection based on signal-to-signal comparisons. In this paper, we introduce an attribute-based perspective, where we measure privacy protection in terms of comparisons between sets of speaker attributes. First, we analyze privacy impact by calculating speaker uniqueness for ground truth attributes, attributes inferred on the original speech, and attributes inferred on speech protected with standard anonymization. Next, we examine a threat scenario involving only a single utterance per speaker and calculate attack error rates. Overall, we observe that inferred attributes still present a risk despite attribute inference errors. Our research points to the importance of considering both attribute-related threats and protection mechanisms in future voice privacy research.

Related papers

• DP-VOXLET: Provable Speaker Anonymization for Disentangled Speech Representations [2.565220169948739]
  Systems for speaker anonymization obfuscate the speaker of an utterance, while maintaining its original semantic contents and prosody.<n>Recent solutions for speaker anonymization rely on learned representations that disentangle an utterance into semantic contents and speaker properties.<n>We introduce speaker differential privacy, a formal definition of speaker anonymization based on the framework of differential privacy, and a mechanism for speaker anonymization that provably satisfies the definition.
  arXiv  Detail & Related papers  (2026-08-31T15:34:16Z)
• A Large-Scale Per-Speaker Analysis of Re-identification Risk in Speech Anonymization [14.038986003108201]
  We conduct a large-scale per-speaker privacy analysis using a linkability-based metric under a worst-case scenario.<n>Nearly 5,000 speakers are evaluated across multiple anonymization systems, attacker architectures, and conversation lengths.
  arXiv  Detail & Related papers  (2026-06-05T12:21:25Z)
• VoxGuard: Evaluating User and Attribute Privacy in Speech via Membership Inference Attacks [51.68795949691009]
  We introduce VoxGuard, a framework grounded in differential privacy and membership inference.<n>For attributes, we show that simple transparent attacks recover gender and accent with near-perfect accuracy even after anonymization.<n>Our results demonstrate that EER substantially underestimates leakage, highlighting the need for low-FPR evaluation.
  arXiv  Detail & Related papers  (2025-09-22T20:57:48Z)
• Asynchronous Voice Anonymization Using Adversarial Perturbation On Speaker Embedding [46.25816642820348]
  We focus on altering the voice attributes against machine recognition while retaining human perception. A speech generation framework incorporating a speaker disentanglement mechanism is employed to generate the anonymized speech. Experiments conducted on the LibriSpeech dataset showed that the speaker attributes were obscured with their human perception preserved for 60.71% of the processed utterances.
  arXiv  Detail & Related papers  (2024-06-12T13:33:24Z)
• Anonymizing Speech with Generative Adversarial Networks to Preserve Speaker Privacy [22.84840887071428]
  Speaker anonymization aims for hiding the identity of a speaker by changing the voice in speech recordings. This typically comes with a privacy-utility trade-off between protection of individuals and usability of the data for downstream applications. We propose to tackle this issue by generating speaker embeddings using a generative adversarial network with Wasserstein distance as cost function.
  arXiv  Detail & Related papers  (2022-10-13T13:12:42Z)
• Differentially Private Speaker Anonymization [44.90119821614047]
  Sharing real-world speech utterances is key to the training and deployment of voice-based services. Speaker anonymization aims to remove speaker information from a speech utterance while leaving its linguistic and prosodic attributes intact. We show that disentanglement is indeed not perfect: linguistic and prosodic attributes still contain speaker information.
  arXiv  Detail & Related papers  (2022-02-23T23:20:30Z)
• Protecting gender and identity with disentangled speech representations [49.00162808063399]
  We show that protecting gender information in speech is more effective than modelling speaker-identity information. We present a novel way to encode gender information and disentangle two sensitive biometric identifiers.
  arXiv  Detail & Related papers  (2021-04-22T13:31:41Z)
• High Fidelity Speech Regeneration with Application to Speech Enhancement [96.34618212590301]
  We propose a wav-to-wav generative model for speech that can generate 24khz speech in a real-time manner. Inspired by voice conversion methods, we train to augment the speech characteristics while preserving the identity of the source.
  arXiv  Detail & Related papers  (2021-01-31T10:54:27Z)
• Improving speaker discrimination of target speech extraction with time-domain SpeakerBeam [100.95498268200777]
  SpeakerBeam exploits an adaptation utterance of the target speaker to extract his/her voice characteristics. SpeakerBeam sometimes fails when speakers have similar voice characteristics, such as in same-gender mixtures. We show experimentally that these strategies greatly improve speech extraction performance, especially for same-gender mixtures.
  arXiv  Detail & Related papers  (2020-01-23T05:36:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.