FARI: Robust One-Step Inversion for Watermarking in Diffusion Models

• URL: http://arxiv.org/abs/2607.26723v1
• Date: Wed, 29 Jul 2026 10:13:55 GMT
• Title: FARI: Robust One-Step Inversion for Watermarking in Diffusion Models
• Abstract summary: Inversion-based watermarking is a promising approach to authenticate diffusion-generated images.<n>Existing approaches over-optimize internal truncation error.<n>textbfFARI is a one-step inversion framework paired with lightweight adversarial LoRA fine-tuning of the denoiser for watermark extraction.
• Score: 89.29541056113442
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Inversion-based watermarking is a promising approach to authenticate diffusion-generated images, yet practical use is bottlenecked by inversion that is both slow and error-prone. While the primary challenge in the watermarking setting is robustness against external distortions, existing approaches over-optimize internal truncation error, and because that error scales with the sampler step size, they are inherently confined to high-NFE (number of function evaluations) regimes that cannot meet the dual demands of speed and robustness. In this work, we have two key observations: (i) the inversion trajectory has markedly lower curvature than the forward generation path does, making it highly compressible and amenable to low-NFE approximation; and (ii) in inversion for watermark verification, the trade-off between speed and truncation error is less critical, since external distortions dominate the error. A faster inverter provides a dual benefit: it is not only more efficient, but it also enables end-to-end adversarial training to directly target robustness, a task that is computationally prohibitive for the original, lengthy inversion trajectories. Building on this, we propose \textbf{FARI} (\textbf{F}ast \textbf{A}symmetric \textbf{R}obust \textbf{I}nversion), a one-step inversion framework paired with lightweight adversarial LoRA fine-tuning of the denoiser for watermark extraction. While consolidation slightly increases internal error, FARI delivers large gains in both speed and robustness: with approximately 20 minutes of fine-tuning on a single NVIDIA RTX A6000 GPU, it surpasses 50-step DDIM inversion on watermark-verification robustness while dramatically reducing inference time. Code and pretrained models are available at https://github.com/0xD009/FARI.

Related papers

• RAIN: Region-Aware Inversion Network for Semantic Watermark Extraction [0.0]
  We propose a lightweight, prompt-free extractor that decomposes endpoint recovery into an image-like anchor and a noise-oriented residual.<n>The computational cost of extracting noise is lower than that of both OSI and FARI.
  arXiv  Detail & Related papers  (2026-09-14T00:07:17Z)
• Timestep Rescheduling in Diffusion Inversion [79.30105376216544]
  We show how the selection of the diffusion timestep in the noise scheduler influences inversion fidelity.<n>We propose a simple yet effective nonuniform timestep scheduler that integrates a global rescaling with a local dynamic programming based rescheduling.<n>Our method serves as an off-the-shelf enhancement for existing inversion techniques and requires no extra parameters or computational overhead.
  arXiv  Detail & Related papers  (2026-06-13T16:32:01Z)
• Drift-AR: Single-Step Visual Autoregressive Generation via Anti-Symmetric Drifting [25.589468409950484]
  Autoregressive (AR)-Diffusion hybrid paradigms combine AR's structured semantic modeling with diffusion's high-fidelity synthesis, yet suffer from a dual speed bottleneck.<n>We propose textbfDrift-AR, which leverages entropy signal to accelerate both stages.<n> Experiments on MAR, TransDiff, and NextStep-1 demonstrate 3.8-5.5$times$ speedup with genuine 1-NFE decoding, matching or surpassing original quality.
  arXiv  Detail & Related papers  (2026-03-30T05:29:00Z)
• Transferable Multi-Bit Watermarking Across Frozen Diffusion Models via Latent Consistency Bridges [1.189955933770711]
  We propose DiffMark, a plug-and-play watermarking method that offers single-pass multi-bit detection, per-image key flexibility, and cross-model transferability.<n>DiffMark also maintains competitive watermark robustness against distortion, regeneration, and adversarial attacks.
  arXiv  Detail & Related papers  (2026-03-19T13:13:34Z)
• OSI: One-step Inversion Excels in Extracting Diffusion Watermarks [56.210696479553945]
  We propose One-step Inversion (OSI), a significantly faster and more accurate method for extracting Gaussian Shading style watermarks.<n>OSI reformulates watermark extraction as a learnable sign classification problem, which eliminates the need for precise regression of the initial noise.<n>Our OSI substantially outperforms the multi-step diffusion inversion method: it is 20x faster, achieves higher extraction accuracy, and doubles the watermark payload capacity.
  arXiv  Detail & Related papers  (2026-02-10T07:43:16Z)
• DeepInv: A Novel Self-supervised Learning Approach for Fast and Accurate Diffusion Inversion [65.5172878666262]
  Diffusion inversion is a challenging task due to the lack of viable supervision signals.<n>We propose a novel self-supervised diffusion inversion approach, termed Deep Inversion (DeepInv)<n>DeepInv is also equipped with an iterative and multi-scale training regime to train a parameterized inversion solver.
  arXiv  Detail & Related papers  (2026-01-04T11:27:26Z)
• WaTeRFlow: Watermark Temporal Robustness via Flow Consistency [46.206343565195375]
  We present WaTeRFlow, a framework tailored for robustness under I2V.<n>It exposes the encoder-decoder to realistic distortions via instruction-driven edits and a fast video diffusion proxy during training.<n>Experiments across representative I2V models show accurate watermark recovery from frames, with higher first-frame and per-frame bit accuracy and resilience.
  arXiv  Detail & Related papers  (2025-12-22T05:33:59Z)
• Runge-Kutta Approximation and Decoupled Attention for Rectified Flow Inversion and Semantic Editing [21.585366155855894]
  We propose an efficient high-order inversion method for rectified flow models based on the Runge-Kutta solver of differential equations.<n>We introduce Decoupled Diffusion Transformer Attention (DDTA), a novel mechanism that disentangles text and image attention inside the multimodal diffusion transformers.<n>Our method achieves state-of-the-art performance in terms of fidelity and editability.
  arXiv  Detail & Related papers  (2025-09-16T09:41:14Z)
• OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time Optimization [66.69924980864053]
  We propose OptMark, an optimization-based approach that embeds a robust multi-bit watermark into the intermediate latents of the diffusion denoising process.<n> OptMark strategically inserts a structural watermark early to resist generative attacks and a detail watermark late to withstand image transformations.<n> Experimental results demonstrate that OptMark achieves invisible multi-bit watermarking while ensuring robust resilience against valuemetric transformations, geometric transformations, editing, and regeneration attacks.
  arXiv  Detail & Related papers  (2025-08-29T15:50:59Z)
• FUSE: Label-Free Image-Event Joint Monocular Depth Estimation via Frequency-Decoupled Alignment and Degradation-Robust Fusion [92.4205087439928]
  Image-event joint depth estimation methods leverage complementary modalities for robust perception, yet face challenges in generalizability.<n>We propose the Self-supervised Transfer (PST) and the FrequencyDe-coupled Fusion module (FreDF)<n>PST establishes cross-modal knowledge transfer through latent space alignment with image foundation models, effectively mitigating data scarcity.<n>FreDF explicitly decouples high-frequency edge features from low-frequency structural components, resolving modality-specific frequency mismatches.<n>This combined approach enables FUSE to construct a universal image-event that only requires lightweight decoder adaptation for target datasets.
  arXiv  Detail & Related papers  (2025-03-25T15:04:53Z)
• Nesterov Accelerated ADMM for Fast Diffeomorphic Image Registration [63.15453821022452]
  Recent developments in approaches based on deep learning have achieved sub-second runtimes for DiffIR. We propose a simple iterative scheme that functionally composes intermediate non-stationary velocity fields. We then propose a convex optimisation model that uses a regularisation term of arbitrary order to impose smoothness on these velocity fields.
  arXiv  Detail & Related papers  (2021-09-26T19:56:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.