DenMark: Robust Semantic Watermarking for Diffusion Language Models

• URL: http://arxiv.org/abs/2609.14257v1
• Date: Sun, 13 Sep 2026 03:37:48 GMT
• Title: DenMark: Robust Semantic Watermarking for Diffusion Language Models
• Abstract summary: DenMark is a semantic watermarking framework for diffusion language models (DLMs)<n>It injects key-dependent signals directly into the DLM denoising process.<n>It partitions the output into fixed token regions and uses temporary rollouts as semantic lookahead.<n>For detection, DenMark uses calibrated scanning over candidate unit sizes to remain robust to boundary shifts introduced by semantic attacks.
• Score: 56.836684262732994
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Semantic text watermarks encode signals in meaning rather than surface token choices, offering robustness to paraphrasing and other semantic-preserving edits. Existing semantic watermarking methods are primarily designed for autoregressive language models (ARLMs), where completed candidate units can be generated and scored before generation proceeds. This paradigm does not naturally extend to diffusion language models (DLMs), where semantic units remain incomplete during intermediate denoising steps and tokens may be updated in flexible orders. We propose DenMark, a semantic watermarking framework that injects key-dependent signals directly into the DLM denoising process. DenMark partitions the output into fixed token regions and uses temporary rollouts as semantic lookahead: conditional completions estimate the eventual semantics of an incomplete region, enabling DenMark to select local updates with higher estimated semantic watermark scores. Repeating this procedure across denoising steps progressively accumulates watermark evidence in the final output. For detection, DenMark uses calibrated scanning over candidate unit sizes to remain robust to boundary shifts introduced by semantic attacks. Across four DLMs, three datasets, and four semantic attacks, DenMark achieves the best results across all reported detection metrics in all 48 backbone-dataset-attack combinations. These results demonstrate that DenMark provides an effective mechanism for robust semantic watermarking in DLMs.

Related papers

• SWAN: Semantic Watermarking with Abstract Meaning Representation [61.15962841972814]
  SWAN (Semantic Watermarking with Abstract Meaning Representation) is a novel framework that embeds watermark signatures into the semantic structure of a sentence.<n>As the signature is encoded at the semantic structure level, any paraphrase that preserves meaning automatically preserves the signature.
  arXiv  Detail & Related papers  (2026-05-05T21:13:30Z)
• dgMARK: Decoding-Guided Watermarking for Diffusion Language Models [5.43345665278304]
  dgMARK is a decoding-guided watermarking method for discrete diffusion language models.<n>dgMARK steers the unmasking order toward positions whose high-reward candidate tokens satisfy a simple parity constraint.<n> Watermarks are detected via elevated parity-matching statistics.
  arXiv  Detail & Related papers  (2026-01-30T13:51:20Z)
• LR-DWM: Efficient Watermarking for Diffusion Language Models [40.70709965738489]
  Diffusion Language Models (DLMs) generate text via non-sequential iterative denoising.<n>Recent work proposed to watermark DLMs by inverting the process when needed, but suffers significant computational or memory overhead.<n>We introduce Left-Right Diffusion Watermarking (LR-DWM), a scheme that biases the generated token based on both left and right neighbors.
  arXiv  Detail & Related papers  (2026-01-18T12:08:51Z)
• DMark: Order-Agnostic Watermarking for Diffusion Large Language Models [46.07844536066178]
  Diffusion large language models (dLLMs) offer faster generation than autoregressive models while maintaining comparable quality.<n>We present DMark, the first watermarking framework designed specifically for dLLMs.
  arXiv  Detail & Related papers  (2025-10-03T11:14:16Z)
• Watermarking Diffusion Language Models [9.515480957792542]
  We introduce the first watermark tailored for diffusion language models (DLMs)<n>This is an emergent LLM paradigm able to generate tokens in arbitrary order, in contrast to standard autoregressive language models (ARLMs) which generate tokens sequentially.
  arXiv  Detail & Related papers  (2025-09-29T07:11:40Z)
• SimMark: A Robust Sentence-Level Similarity-Based Watermarking Algorithm for Large Language Models [4.069844339028727]
  SimMark is a robust sentence-level watermarking algorithm for large language models (LLMs)<n>It embeds detectable statistical patterns imperceptible to humans, and employs a soft counting mechanism.<n>We show that SimMark sets a new benchmark for robust watermarking of LLM-generated content.
  arXiv  Detail & Related papers  (2025-02-05T00:21:01Z)
• PostMark: A Robust Blackbox Watermark for Large Language Models [56.63560134428716]
  We develop PostMark, a modular post-hoc watermarking procedure. PostMark does not require logit access, which means it can be implemented by a third party. We show that PostMark is more robust to paraphrasing attacks than existing watermarking methods.
  arXiv  Detail & Related papers  (2024-06-20T17:27:14Z)
• A Robust Semantics-based Watermark for Large Language Model against Paraphrasing [50.84892876636013]
  Large language models (LLMs) have show great ability in various natural language tasks. There are concerns that LLMs are possible to be used improperly or even illegally. We propose a semantics-based watermark framework SemaMark.
  arXiv  Detail & Related papers  (2023-11-15T06:19:02Z)
• A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models [65.40460716619772]
  Our research focuses on the importance of a textbfDistribution-textbfPreserving (DiP) watermark. Contrary to the current strategies, our proposed DiPmark simultaneously preserves the original token distribution during watermarking. It is detectable without access to the language model API and prompts (accessible), and is provably robust to moderate changes of tokens.
  arXiv  Detail & Related papers  (2023-10-11T17:57:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.