On the Generation and Removal of Speaker Adversarial Perturbation for Voice-Privacy Protection

• URL: http://arxiv.org/abs/2412.09195v1
• Date: Thu, 12 Dec 2024 11:46:07 GMT
• Title: On the Generation and Removal of Speaker Adversarial Perturbation for Voice-Privacy Protection
• Authors: Chenyang Guo, Liping Chen, Zhuhai Li, Kong Aik Lee, Zhen-Hua Ling, Wu Guo,
• Abstract summary: Recent development in voice-privacy protection has shown the positive use cases of the same technique to conceal speaker's voice attribute. This paper examines the reversibility property where an entity generating adversarial perturbations is authorized to remove them and restore original speech. A similar technique could also be used by an investigator to deanonymize a voice-protected speech to restore criminals' identities in security and forensic analysis.
• Score: 45.49915832081347
• License:
• Abstract: Neural networks are commonly known to be vulnerable to adversarial attacks mounted through subtle perturbation on the input data. Recent development in voice-privacy protection has shown the positive use cases of the same technique to conceal speaker's voice attribute with additive perturbation signal generated by an adversarial network. This paper examines the reversibility property where an entity generating the adversarial perturbations is authorized to remove them and restore original speech (e.g., the speaker him/herself). A similar technique could also be used by an investigator to deanonymize a voice-protected speech to restore criminals' identities in security and forensic analysis. In this setting, the perturbation generative module is assumed to be known in the removal process. To this end, a joint training of perturbation generation and removal modules is proposed. Experimental results on the LibriSpeech dataset demonstrated that the subtle perturbations added to the original speech can be predicted from the anonymized speech while achieving the goal of privacy protection. By removing these perturbations from the anonymized sample, the original speech can be restored. Audio samples can be found in \url{https://voiceprivacy.github.io/Perturbation-Generation-Removal/}.

Related papers

• Asynchronous Voice Anonymization Using Adversarial Perturbation On Speaker Embedding [46.25816642820348]
  We focus on altering the voice attributes against machine recognition while retaining human perception. A speech generation framework incorporating a speaker disentanglement mechanism is employed to generate the anonymized speech. Experiments conducted on the LibriSpeech dataset showed that the speaker attributes were obscured with their human perception preserved for 60.71% of the processed utterances.
  arXiv  Detail & Related papers  (2024-06-12T13:33:24Z)
• Anonymizing Speech with Generative Adversarial Networks to Preserve Speaker Privacy [22.84840887071428]
  Speaker anonymization aims for hiding the identity of a speaker by changing the voice in speech recordings. This typically comes with a privacy-utility trade-off between protection of individuals and usability of the data for downstream applications. We propose to tackle this issue by generating speaker embeddings using a generative adversarial network with Wasserstein distance as cost function.
  arXiv  Detail & Related papers  (2022-10-13T13:12:42Z)
• Are disentangled representations all you need to build speaker anonymization systems? [0.0]
  Speech signals contain a lot of sensitive information, such as the speaker's identity. Speaker anonymization aims to transform a speech signal to remove the source speaker's identity while leaving the spoken content unchanged.
  arXiv  Detail & Related papers  (2022-08-22T07:51:47Z)
• Generating gender-ambiguous voices for privacy-preserving speech recognition [38.733077459065704]
  We present a generative adversarial network, GenGAN, that synthesises voices that conceal the gender or identity of a speaker. We condition the generator only on gender information and use an adversarial loss between signal distortion and privacy preservation.
  arXiv  Detail & Related papers  (2022-07-03T14:23:02Z)
• Differentially Private Speaker Anonymization [44.90119821614047]
  Sharing real-world speech utterances is key to the training and deployment of voice-based services. Speaker anonymization aims to remove speaker information from a speech utterance while leaving its linguistic and prosodic attributes intact. We show that disentanglement is indeed not perfect: linguistic and prosodic attributes still contain speaker information.
  arXiv  Detail & Related papers  (2022-02-23T23:20:30Z)
• Protecting gender and identity with disentangled speech representations [49.00162808063399]
  We show that protecting gender information in speech is more effective than modelling speaker-identity information. We present a novel way to encode gender information and disentangle two sensitive biometric identifiers.
  arXiv  Detail & Related papers  (2021-04-22T13:31:41Z)
• Speaker De-identification System using Autoencoders and Adversarial Training [58.720142291102135]
  We propose a speaker de-identification system based on adversarial training and autoencoders. Experimental results show that combining adversarial learning and autoencoders increase the equal error rate of a speaker verification system.
  arXiv  Detail & Related papers  (2020-11-09T19:22:05Z)
• Backdoor Attack against Speaker Verification [86.43395230456339]
  We show that it is possible to inject the hidden backdoor for infecting speaker verification models by poisoning the training data. We also demonstrate that existing backdoor attacks cannot be directly adopted in attacking speaker verification.
  arXiv  Detail & Related papers  (2020-10-22T11:10:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.