The VoicePrivacy 2022 Challenge Evaluation Plan

• URL: http://arxiv.org/abs/2203.12468v1
• Date: Wed, 23 Mar 2022 15:05:18 GMT
• Title: The VoicePrivacy 2022 Challenge Evaluation Plan
• Authors: Natalia Tomashenko, Xin Wang, Xiaoxiao Miao, Hubert Nourtel, Pierre Champion, Massimiliano Todisco, Emmanuel Vincent, Nicholas Evans, Junichi Yamagishi, Jean Fran\c{c}ois Bonastre
• Abstract summary: Training, development and evaluation datasets are provided. Participants apply their developed anonymization systems. Results will be presented at a workshop held in conjunction with INTERSPEECH 2022.
• Score: 46.807999940446294
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: For new participants - Executive summary: (1) The task is to develop a voice anonymization system for speech data which conceals the speaker's voice identity while protecting linguistic content, paralinguistic attributes, intelligibility and naturalness. (2) Training, development and evaluation datasets are provided in addition to 3 different baseline anonymization systems, evaluation scripts, and metrics. Participants apply their developed anonymization systems, run evaluation scripts and submit objective evaluation results and anonymized speech data to the organizers. (3) Results will be presented at a workshop held in conjunction with INTERSPEECH 2022 to which all participants are invited to present their challenge systems and to submit additional workshop papers. For readers familiar with the VoicePrivacy Challenge - Changes w.r.t. 2020: (1) A stronger, semi-informed attack model in the form of an automatic speaker verification (ASV) system trained on anonymized (per-utterance) speech data. (2) Complementary metrics comprising the equal error rate (EER) as a privacy metric, the word error rate (WER) as a primary utility metric, and the pitch correlation and gain of voice distinctiveness as secondary utility metrics. (3) A new ranking policy based upon a set of minimum target privacy requirements.

Related papers

• The First VoicePrivacy Attacker Challenge Evaluation Plan [39.256453635652484]
  The First VoicePrivacy Attacker Challenge is a new kind of challenge organized as part of the VoicePrivacy initiative and supported by ICASSP 2025 as the SP Grand Challenge. It focuses on developing attacker systems against voice anonymization, which will be evaluated against a set of anonymization systems submitted to the VoicePrivacy 2024 Challenge.
  arXiv  Detail & Related papers  (2024-10-09T20:48:03Z)
• The VoicePrivacy 2024 Challenge Evaluation Plan [40.2768875178317]
  The challenge is to develop a voice anonymization system which conceals the speaker's voice identity while protecting linguistic content and emotional states. Participants apply their developed anonymization systems, run evaluation scripts and submit evaluation results and anonymized speech data to the organizers. Results will be presented at a workshop held in conjunction with Interspeech 2024.
  arXiv  Detail & Related papers  (2024-04-03T12:20:51Z)
• Voice Anonymization for All -- Bias Evaluation of the Voice Privacy Challenge Baseline System [0.48342038441006807]
  This study investigates bias in voice anonymization systems within the context of the Voice Privacy Challenge. We curate a novel benchmark dataset to assess performance disparities among speaker subgroups based on sex and dialect.
  arXiv  Detail & Related papers  (2023-11-27T13:26:49Z)
• Anonymizing Speech: Evaluating and Designing Speaker Anonymization Techniques [1.2691047660244337]
  The growing use of voice user interfaces has led to a surge in the collection and storage of speech data. This thesis proposes solutions for anonymizing speech and evaluating the degree of the anonymization.
  arXiv  Detail & Related papers  (2023-08-05T16:14:17Z)
• Speaker Anonymization with Phonetic Intermediate Representations [22.84840887071428]
  We propose a speaker anonymization pipeline that generates speech conditioned on phonetic transcriptions and anonymized speaker embeddings. Using phones as the intermediate representation ensures near complete elimination of speaker identity information from the input.
  arXiv  Detail & Related papers  (2022-07-11T13:02:08Z)
• The VoicePrivacy 2020 Challenge Evaluation Plan [53.14981205333593]
  The VoicePrivacy Challenge aims to promote the development of privacy preservation tools for speech technology. We formulate the voice anonymization task selected for the VoicePrivacy 2020 Challenge and describe the datasets used for system development and evaluation.
  arXiv  Detail & Related papers  (2022-05-14T20:05:51Z)
• The VoicePrivacy 2020 Challenge: Results and findings [60.13468541150838]
  The first VoicePrivacy 2020 Challenge focuses on developing anonymization solutions for speech technology. We provide a systematic overview of the challenge design with an analysis of submitted systems and evaluation results.
  arXiv  Detail & Related papers  (2021-09-01T23:40:38Z)
• Speaker De-identification System using Autoencoders and Adversarial Training [58.720142291102135]
  We propose a speaker de-identification system based on adversarial training and autoencoders. Experimental results show that combining adversarial learning and autoencoders increase the equal error rate of a speaker verification system.
  arXiv  Detail & Related papers  (2020-11-09T19:22:05Z)
• Introducing the VoicePrivacy Initiative [53.14981205333593]
  The VoicePrivacy initiative aims to promote the development of privacy preservation tools for speech technology. We formulate the voice anonymization task selected for the VoicePrivacy 2020 Challenge and describe the datasets used for system development and evaluation.
  arXiv  Detail & Related papers  (2020-05-04T11:07:52Z)
• Disentangled Speech Embeddings using Cross-modal Self-supervision [119.94362407747437]
  We develop a self-supervised learning objective that exploits the natural cross-modal synchrony between faces and audio in video. We construct a two-stream architecture which: (1) shares low-level features common to both representations; and (2) provides a natural mechanism for explicitly disentangling these factors.
  arXiv  Detail & Related papers  (2020-02-20T14:13:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.