RAIN: Region-Aware Inversion Network for Semantic Watermark Extraction

• URL: http://arxiv.org/abs/2609.14856v1
• Date: Mon, 14 Sep 2026 00:07:17 GMT
• Title: RAIN: Region-Aware Inversion Network for Semantic Watermark Extraction
• Abstract summary: We propose a lightweight, prompt-free extractor that decomposes endpoint recovery into an image-like anchor and a noise-oriented residual.<n>The computational cost of extracting noise is lower than that of both OSI and FARI.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Semantic watermarks for diffusion models embed ownership information into the generative process while preserving perceptual quality, but Gaussian-Shading extraction conventionally requires multi-step diffusion inversion to recover the initial noise. Recent one-step methods show that this cost can be reduced substantially. We study this problem through extended flow matching and conditional regression. The key observation is that, near the high-SNR image endpoint, recovering a useful noise statistic given by the first-step output of the extended flow matching in the high-SNR regime is much simpler than reconstructing the full inverse trajectory, and Gaussian Shading only requires the recovered latent to remain in the correct watermark decision region. Based on this observation, we propose a lightweight, prompt-free extractor that decomposes endpoint recovery into an image-like anchor and a noise-oriented residual, which increases the capability of the model to utilize GPU parallel computation. The resulting method avoids iterative inversion and repeated evaluation of a diffusion-scale U-Net, providing an efficient one-step extraction pipeline with a concise theoretical interpretation. The computational cost of extracting noise is lower than that of both OSI and FARI. The github repo is there: https://github.com/TheLovesOfLadyPurple/RAIN-lightweight-NN-for-one-step-semantic-watermark-extracti on

Related papers

• FARI: Robust One-Step Inversion for Watermarking in Diffusion Models [89.29541056113442]
  Inversion-based watermarking is a promising approach to authenticate diffusion-generated images.<n>Existing approaches over-optimize internal truncation error.<n>textbfFARI is a one-step inversion framework paired with lightweight adversarial LoRA fine-tuning of the denoiser for watermark extraction.
  arXiv  Detail & Related papers  (2026-07-29T10:13:55Z)
• Reconstructing Backpropagation from Forward Fluctuations in Noise-modulated Neural Networks [0.0]
  Noise-modulated Neural Network (NNN) learns and infers only in the presence of noise treating noise as a computational resource rather than a disturbance.<n>We show that backpropagation itself can be reconstructed in the NNN from forward-pass statistics alone.
  arXiv  Detail & Related papers  (2026-07-29T05:18:34Z)
• Closed-Form Spectral Regularization for Multi-Task Model Merging [96.82449201305234]
  Model merging combines several independently fine-tuned experts into a single multi-task model without any training data.<n>State-of-the-art merging methods formulate merging as a layer-wise interference problem.<n>We propose SWUDI, a closed-form method that combines a soft exponential filter, which matches the gradient-flow trajectory of iterative descent.
  arXiv  Detail & Related papers  (2026-06-05T14:00:47Z)
• OSI: One-step Inversion Excels in Extracting Diffusion Watermarks [56.210696479553945]
  We propose One-step Inversion (OSI), a significantly faster and more accurate method for extracting Gaussian Shading style watermarks.<n>OSI reformulates watermark extraction as a learnable sign classification problem, which eliminates the need for precise regression of the initial noise.<n>Our OSI substantially outperforms the multi-step diffusion inversion method: it is 20x faster, achieves higher extraction accuracy, and doubles the watermark payload capacity.
  arXiv  Detail & Related papers  (2026-02-10T07:43:16Z)
• DeepInv: A Novel Self-supervised Learning Approach for Fast and Accurate Diffusion Inversion [65.5172878666262]
  Diffusion inversion is a challenging task due to the lack of viable supervision signals.<n>We propose a novel self-supervised diffusion inversion approach, termed Deep Inversion (DeepInv)<n>DeepInv is also equipped with an iterative and multi-scale training regime to train a parameterized inversion solver.
  arXiv  Detail & Related papers  (2026-01-04T11:27:26Z)
• Integrating Reweighted Least Squares with Plug-and-Play Diffusion Priors for Noisy Image Restoration [6.402777145722335]
  We propose a plug-and-play image restoration framework based on generative diffusion priors for robust removal of general noise types, including impulse noise.<n> Experimental results on benchmark datasets demonstrate that the proposed method effectively removes non-Gaussian impulse noise and achieves superior restoration performance.
  arXiv  Detail & Related papers  (2025-11-10T08:11:20Z)
• There and Back Again: On the relation between Noise and Image Inversions in Diffusion Models [3.8384683391475556]
  Diffusion Models generate new samples but lack a low-dimensional latent space that encodes the data into editable features.<n>Inversion-based methods address this by reversing the denoising trajectory, transferring images to their approximated starting noise.<n>We show that latents exhibit structural patterns in the form of less diverse noise predicted for smooth image areas.
  arXiv  Detail & Related papers  (2024-10-31T00:30:35Z)
• Image Restoration by Denoising Diffusion Models with Iteratively Preconditioned Guidance [9.975341265604577]
  Training deep neural networks has become a common approach for addressing image restoration problems. In low-noise settings, guidance that is based on back-projection (BP) has been shown to be a promising strategy. We propose a novel guidance technique, based on preconditioning that allows traversing from BP-based guidance to at least squares based guidance.
  arXiv  Detail & Related papers  (2023-12-27T10:57:03Z)
• Iterative Token Evaluation and Refinement for Real-World Super-Resolution [77.74289677520508]
  Real-world image super-resolution (RWSR) is a long-standing problem as low-quality (LQ) images often have complex and unidentified degradations. We propose an Iterative Token Evaluation and Refinement framework for RWSR. We show that ITER is easier to train than Generative Adversarial Networks (GANs) and more efficient than continuous diffusion models.
  arXiv  Detail & Related papers  (2023-12-09T17:07:32Z)
• Resfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noise [34.65659277870287]
  Research on denoising diffusion models has expanded its application to the field of image restoration. We propose Resfusion, a framework that incorporates the residual term into the diffusion forward process. We show that Resfusion exhibits competitive performance on ISTD dataset, LOL dataset and Raindrop dataset with only five sampling steps.
  arXiv  Detail & Related papers  (2023-11-25T02:09:38Z)
• Unsupervised Single Image Super-resolution Under Complex Noise [60.566471567837574]
  This paper proposes a model-based unsupervised SISR method to deal with the general SISR task with unknown degradations. The proposed method can evidently surpass the current state of the art (SotA) method (about 1dB PSNR) not only with a slighter model (0.34M vs. 2.40M) but also faster speed.
  arXiv  Detail & Related papers  (2021-07-02T11:55:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.