ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scale

• URL: http://arxiv.org/abs/2408.08739v1
• Date: Fri, 16 Aug 2024 13:37:20 GMT
• Title: ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scale
• Authors: Xin Wang, Hector Delgado, Hemlata Tak, Jee-weon Jung, Hye-jin Shim, Massimiliano Todisco, Ivan Kukanov, Xuechen Liu, Md Sahidullah, Tomi Kinnunen, Nicholas Evans, Kong Aik Lee, Junichi Yamagishi,
• Abstract summary: ASVspoof 5 is the fifth edition in a series of challenges that promote the study of speech spoofing and deepfake attacks. We describe the two challenge tracks, the new database, the evaluation metrics, and the evaluation platform, and present a summary of the results.
• Score: 59.25180900687571
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: ASVspoof 5 is the fifth edition in a series of challenges that promote the study of speech spoofing and deepfake attacks, and the design of detection solutions. Compared to previous challenges, the ASVspoof 5 database is built from crowdsourced data collected from a vastly greater number of speakers in diverse acoustic conditions. Attacks, also crowdsourced, are generated and tested using surrogate detection models, while adversarial attacks are incorporated for the first time. New metrics support the evaluation of spoofing-robust automatic speaker verification (SASV) as well as stand-alone detection solutions, i.e., countermeasures without ASV. We describe the two challenge tracks, the new database, the evaluation metrics, baselines, and the evaluation platform, and present a summary of the results. Attacks significantly compromise the baseline systems, while submissions bring substantial improvements.

Related papers

• Temporal Variability and Multi-Viewed Self-Supervised Representations to Tackle the ASVspoof5 Deepfake Challenge [21.655127750485097]
  We introduce Frequency Mask, a data augmentation method that masks specific frequency bands to improve CM. Our experiments achieved a minDCF of 0.0158 and an EER of 0.55% on the ASVspoof 5 Track 1 evaluation progress set.
  arXiv  Detail & Related papers  (2024-08-13T14:15:15Z)
• Towards single integrated spoofing-aware speaker verification embeddings [63.42889348690095]
  This study aims to develop a single integrated spoofing-aware speaker verification embeddings. We analyze that the inferior performance of single SASV embeddings comes from insufficient amount of training data. Experiments show dramatic improvements, achieving a SASV-EER of 1.06% on the evaluation protocol of the SASV2022 challenge.
  arXiv  Detail & Related papers  (2023-05-30T14:15:39Z)
• Voice Spoofing Countermeasures: Taxonomy, State-of-the-art, experimental analysis of generalizability, open challenges, and the way forward [2.393661358372807]
  We conduct a review of the literature on spoofing detection using hand-crafted features, deep learning, end-to-end, and universal spoofing countermeasure solutions. We report the performance of these countermeasures on several datasets and evaluate them across corpora.
  arXiv  Detail & Related papers  (2022-10-02T03:53:37Z)
• Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusion [88.34134732217416]
  This work focuses on fusion-based SASV solutions and proposes a multi-model fusion framework to leverage the power of multiple state-of-the-art ASV and CM models. The proposed framework vastly improves the SASV-EER from 8.75% to 1.17%, which is 86% relative improvement compared to the best baseline system in the SASV challenge.
  arXiv  Detail & Related papers  (2022-06-18T06:41:06Z)
• Spoofing-Aware Speaker Verification with Unsupervised Domain Adaptation [18.684888457998284]
  We enhance the robustness of the automatic speaker verification system without the primary presence of a countermeasure module. We employ three unsupervised domain adaptation techniques to optimize the back-end using the audio data. We demonstrate notable improvements on both logical and physical access scenarios.
  arXiv  Detail & Related papers  (2022-03-21T14:02:06Z)
• ASVspoof 2021: accelerating progress in spoofed and deepfake speech detection [70.45884214674057]
  ASVspoof 2021 is the forth edition in the series of bi-annual challenges which aim to promote the study of spoofing. This paper describes all three tasks, the new databases for each of them, the evaluation metrics, four challenge baselines, the evaluation platform and a summary of challenge results.
  arXiv  Detail & Related papers  (2021-09-01T16:17:31Z)
• Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning [95.60856995067083]
  This work is among the first to perform adversarial defense for ASV without knowing the specific attack algorithms. We propose to perform adversarial defense from two perspectives: 1) adversarial perturbation purification and 2) adversarial perturbation detection. Experimental results show that our detection module effectively shields the ASV by detecting adversarial samples with an accuracy of around 80%.
  arXiv  Detail & Related papers  (2021-06-01T07:10:54Z)
• Investigating Robustness of Adversarial Samples Detection for Automatic Speaker Verification [78.51092318750102]
  This work proposes to defend ASV systems against adversarial attacks with a separate detection network. A VGG-like binary classification detector is introduced and demonstrated to be effective on detecting adversarial samples.
  arXiv  Detail & Related papers  (2020-06-11T04:31:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.