Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances

• URL: http://arxiv.org/abs/2410.18775v1
• Date: Thu, 24 Oct 2024 14:28:32 GMT
• Title: Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances
• Authors: Shilin Lu, Zihan Zhou, Jiayou Lu, Yuanzhi Zhu, Adams Wai-Kin Kong,
• Abstract summary: Large-scale text-to-image models can distort embedded watermarks during editing, posing challenges to copyright protection. We introduce W-Bench, the first comprehensive benchmark designed to evaluate the robustness of watermarking methods. We propose VINE, a watermarking method that significantly enhances robustness against various image editing techniques.
• Score: 13.746887960091112
• License:
• Abstract: Current image watermarking methods are vulnerable to advanced image editing techniques enabled by large-scale text-to-image models. These models can distort embedded watermarks during editing, posing significant challenges to copyright protection. In this work, we introduce W-Bench, the first comprehensive benchmark designed to evaluate the robustness of watermarking methods against a wide range of image editing techniques, including image regeneration, global editing, local editing, and image-to-video generation. Through extensive evaluations of eleven representative watermarking methods against prevalent editing techniques, we demonstrate that most methods fail to detect watermarks after such edits. To address this limitation, we propose VINE, a watermarking method that significantly enhances robustness against various image editing techniques while maintaining high image quality. Our approach involves two key innovations: (1) we analyze the frequency characteristics of image editing and identify that blurring distortions exhibit similar frequency properties, which allows us to use them as surrogate attacks during training to bolster watermark robustness; (2) we leverage a large-scale pretrained diffusion model SDXL-Turbo, adapting it for the watermarking task to achieve more imperceptible and robust watermark embedding. Experimental results show that our method achieves outstanding watermarking performance under various image editing techniques, outperforming existing methods in both image quality and robustness. Code is available at https://github.com/Shilin-LU/VINE.

Related papers

• Certifiably Robust Image Watermark [57.546016845801134]
  Generative AI raises many societal concerns such as boosting disinformation and propaganda campaigns. Watermarking AI-generated content is a key technology to address these concerns. We propose the first image watermarks with certified robustness guarantees against removal and forgery attacks.
  arXiv  Detail & Related papers  (2024-07-04T17:56:04Z)
• JIGMARK: A Black-Box Approach for Enhancing Image Watermarks against Diffusion Model Edits [76.25962336540226]
  JIGMARK is a first-of-its-kind watermarking technique that enhances robustness through contrastive learning. Our evaluation reveals that JIGMARK significantly surpasses existing watermarking solutions in resilience to diffusion-model edits.
  arXiv  Detail & Related papers  (2024-06-06T03:31:41Z)
• Robust-Wide: Robust Watermarking against Instruction-driven Image Editing [21.69779516621288]
  Malicious users can easily exploit instruction-driven image editing to create fake images. We propose Robust-Wide, the first robust watermarking methodology against instruction-driven image editing. Experiments demonstrate that Robust-Wide can effectively extract the watermark from the edited image with a low bit error rate of nearly 2.6%.
  arXiv  Detail & Related papers  (2024-02-20T03:33:54Z)
• RAW: A Robust and Agile Plug-and-Play Watermark Framework for AI-Generated Images with Provable Guarantees [33.61946642460661]
  This paper introduces a robust and agile watermark detection framework, dubbed as RAW. We employ a classifier that is jointly trained with the watermark to detect the presence of the watermark. We show that the framework provides provable guarantees regarding the false positive rate for misclassifying a watermarked image.
  arXiv  Detail & Related papers  (2024-01-23T22:00:49Z)
• A Somewhat Robust Image Watermark against Diffusion-based Editing Models [25.034612051522167]
  Editing models based on diffusion models (DMs) have inadvertently introduced new challenges related to image copyright infringement and malicious editing. We develop a novel technique, RIW (Robust Invisible Watermarking), to embed invisible watermarks. Our technique ensures a high extraction accuracy of $96%$ for the invisible watermark after editing, compared to the $0%$ offered by conventional methods.
  arXiv  Detail & Related papers  (2023-11-22T22:18:42Z)
• FT-Shield: A Watermark Against Unauthorized Fine-tuning in Text-to-Image Diffusion Models [64.89896692649589]
  We propose FT-Shield, a watermarking solution tailored for the fine-tuning of text-to-image diffusion models. FT-Shield addresses copyright protection challenges by designing new watermark generation and detection strategies.
  arXiv  Detail & Related papers  (2023-10-03T19:50:08Z)
• T2IW: Joint Text to Image & Watermark Generation [74.20148555503127]
  We introduce a novel task for the joint generation of text to image and watermark (T2IW) This T2IW scheme ensures minimal damage to image quality when generating a compound image by forcing the semantic feature and the watermark signal to be compatible in pixels. We demonstrate remarkable achievements in image quality, watermark invisibility, and watermark robustness, supported by our proposed set of evaluation metrics.
  arXiv  Detail & Related papers  (2023-09-07T16:12:06Z)
• Adaptive Blind Watermarking Using Psychovisual Image Features [8.75217589103206]
  This paper proposes an adaptive method that determines the strength of the watermark embedding in different parts of the cover image. Experimental results also show that the proposed method can effectively reconstruct the embedded payload in different kinds of common watermarking attacks.
  arXiv  Detail & Related papers  (2022-12-25T06:33:36Z)
• Watermarking Images in Self-Supervised Latent Spaces [75.99287942537138]
  We revisit watermarking techniques based on pre-trained deep networks, in the light of self-supervised approaches. We present a way to embed both marks and binary messages into their latent spaces, leveraging data augmentation at marking time.
  arXiv  Detail & Related papers  (2021-12-17T15:52:46Z)
• Visible Watermark Removal via Self-calibrated Localization and Background Refinement [21.632823897244037]
  Superimposing visible watermarks on images provides a powerful weapon to cope with the copyright issue. Modern watermark removal methods perform watermark localization and background restoration simultaneously. We propose a two-stage multi-task network to address the above issues.
  arXiv  Detail & Related papers  (2021-08-08T06:43:55Z)
• Fine-tuning Is Not Enough: A Simple yet Effective Watermark Removal Attack for DNN Models [72.9364216776529]
  We propose a novel watermark removal attack from a different perspective. We design a simple yet powerful transformation algorithm by combining imperceptible pattern embedding and spatial-level transformations. Our attack can bypass state-of-the-art watermarking solutions with very high success rates.
  arXiv  Detail & Related papers  (2020-09-18T09:14:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.