AudioMarkBench: Benchmarking Robustness of Audio Watermarking

• URL: http://arxiv.org/abs/2406.06979v2
• Date: Wed, 13 Nov 2024 08:41:50 GMT
• Title: AudioMarkBench: Benchmarking Robustness of Audio Watermarking
• Authors: Hongbin Liu, Moyang Guo, Zhengyuan Jiang, Lun Wang, Neil Zhenqiang Gong,
• Abstract summary: We present AudioMarkBench, the first systematic benchmark for evaluating the robustness of audio watermarking against watermark removal and watermark forgery. Our findings highlight the vulnerabilities of current watermarking techniques and emphasize the need for more robust and fair audio watermarking solutions.
• Score: 38.25450275151647
• License:
• Abstract: The increasing realism of synthetic speech, driven by advancements in text-to-speech models, raises ethical concerns regarding impersonation and disinformation. Audio watermarking offers a promising solution via embedding human-imperceptible watermarks into AI-generated audios. However, the robustness of audio watermarking against common/adversarial perturbations remains understudied. We present AudioMarkBench, the first systematic benchmark for evaluating the robustness of audio watermarking against watermark removal and watermark forgery. AudioMarkBench includes a new dataset created from Common-Voice across languages, biological sexes, and ages, 3 state-of-the-art watermarking methods, and 15 types of perturbations. We benchmark the robustness of these methods against the perturbations in no-box, black-box, and white-box settings. Our findings highlight the vulnerabilities of current watermarking techniques and emphasize the need for more robust and fair audio watermarking solutions. Our dataset and code are publicly available at https://github.com/moyangkuo/AudioMarkBench.

Related papers

• IDEAW: Robust Neural Audio Watermarking with Invertible Dual-Embedding [29.89341878606415]
  In this paper, we design a dual-embedding watermarking model for efficient locating. Experiments show that the proposed model, IDEAW, can withstand various attacks with higher capacity and more efficient locating ability compared to existing methods.
  arXiv  Detail & Related papers  (2024-09-29T09:32:54Z)
• Audio Codec Augmentation for Robust Collaborative Watermarking of Speech Synthesis [9.48476556434306]
  This paper extends the channel augmentation to work with non-differentiable traditional audio codecs and neural audio codecs. Listening tests demonstrate collaborative watermarking incurs negligible perceptual degradation with high codecs or DAC at 8kbps.
  arXiv  Detail & Related papers  (2024-09-20T10:33:17Z)
• Certifiably Robust Image Watermark [57.546016845801134]
  Generative AI raises many societal concerns such as boosting disinformation and propaganda campaigns. Watermarking AI-generated content is a key technology to address these concerns. We propose the first image watermarks with certified robustness guarantees against removal and forgery attacks.
  arXiv  Detail & Related papers  (2024-07-04T17:56:04Z)
• GumbelSoft: Diversified Language Model Watermarking via the GumbelMax-trick [50.35069175236422]
  Large language models (LLMs) excellently generate human-like text, but also raise concerns about misuse in fake news and academic dishonesty. Decoding-based watermark, particularly the GumbelMax-trick-based watermark(GM watermark), is a standout solution for safeguarding machine-generated texts. We propose a new type of GM watermark, the Logits-Addition watermark, and its three variants, specifically designed to enhance diversity.
  arXiv  Detail & Related papers  (2024-02-20T12:05:47Z)
• WAVES: Benchmarking the Robustness of Image Watermarks [67.955140223443]
  WAVES (Watermark Analysis Via Enhanced Stress-testing) is a benchmark for assessing image watermark robustness. We integrate detection and identification tasks and establish a standardized evaluation protocol comprised of a diverse range of stress tests. We envision WAVES as a toolkit for the future development of robust watermarks.
  arXiv  Detail & Related papers  (2024-01-16T18:58:36Z)
• Invisible Watermarking for Audio Generation Diffusion Models [11.901028740065662]
  This paper presents the first watermarking technique applied to audio diffusion models trained on mel-spectrograms. Our model excels not only in benign audio generation, but also incorporates an invisible watermarking trigger mechanism for model verification.
  arXiv  Detail & Related papers  (2023-09-22T20:10:46Z)
• WavMark: Watermarking for Audio Generation [70.65175179548208]
  This paper introduces an innovative audio watermarking framework that encodes up to 32 bits of watermark within a mere 1-second audio snippet. The watermark is imperceptible to human senses and exhibits strong resilience against various attacks. It can serve as an effective identifier for synthesized voices and holds potential for broader applications in audio copyright protection.
  arXiv  Detail & Related papers  (2023-08-24T13:17:35Z)
• Certified Neural Network Watermarks with Randomized Smoothing [64.86178395240469]
  We propose a certifiable watermarking method for deep learning models. We show that our watermark is guaranteed to be unremovable unless the model parameters are changed by more than a certain l2 threshold. Our watermark is also empirically more robust compared to previous watermarking methods.
  arXiv  Detail & Related papers  (2022-07-16T16:06:59Z)
• A Deep Learning-based Audio-in-Image Watermarking Scheme [1.1231577179316237]
  This paper presents a deep learning-based audio-in-image watermarking scheme. A neural network architecture is designed to automatically learn the watermarking process in an unsupervised manner. Experimental results have shown high fidelity and robustness of the proposed blind audio-in-image watermarking scheme.
  arXiv  Detail & Related papers  (2021-10-06T00:46:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.