JND-Guided Neural Watermarking with Spatial Transformer Decoding for Screen-Capture Robustness

• URL: http://arxiv.org/abs/2603.26766v1
• Date: Tue, 24 Mar 2026 03:38:42 GMT
• Title: JND-Guided Neural Watermarking with Spatial Transformer Decoding for Screen-Capture Robustness
• Abstract summary: We present an end-to-end deep learning framework that jointly optimize watermark embedding and extraction for screen-shooting.<n>Our framework incorporates three key innovations: (i) a comprehensive noise simulation layer that faithfully models realistic screen-shooting distortions; (ii) a Just Noticeable Distortion (JND) perceptual loss function that adaptively modulates watermark embedding strength; and (iii) two complementary automatic localization modules.
• Score: 13.657959371474886
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Screen-shooting robust watermarking aims to imperceptibly embed extractable information into host images such that the watermark survives the complex distortion pipeline of screen display and camera recapture. However, achieving high extraction accuracy while maintaining satisfactory visual quality remains an open challenge, primarily because the screen-shooting channel introduces severe and entangled degradations including Moiré patterns, color-gamut shifts, perspective warping, and sensor noise. In this paper, we present an end-to-end deep learning framework that jointly optimizes watermark embedding and extraction for screen-shooting robustness. Our framework incorporates three key innovations: (i) a comprehensive noise simulation layer that faithfully models realistic screen-shooting distortions -- notably including a physically-motivated Moiré pattern generator -- enabling the network to learn robust representations against the full spectrum of capture-channel noise through adversarial training; (ii) a Just Noticeable Distortion (JND) perceptual loss function that adaptively modulates watermark embedding strength by supervising the perceptual discrepancy between the JND coefficient map and the watermark residual, thereby concentrating watermark energy in perceptually insensitive regions to maximize visual quality; and (iii) two complementary automatic localization modules -- a semantic-segmentation-based foreground extractor for captured image rectification and a symmetric noise template mechanism for anti-cropping region recovery -- that enable fully automated watermark decoding under realistic deployment conditions. Extensive experiments demonstrate that our method achieves an average PSNR of 30.94~dB and SSIM of 0.94 on watermarked images while embedding 127-bit payloads.

Related papers

• Compressive sensing inspired self-supervised single-pixel imaging [48.79613794195208]
  SISTA-Net is a compressive sensing-inspired self-supervised method for single-pixel imaging.<n>We leverage deep nonlinear networks as adaptive sparse transforms combined with a learnable soft-thresholding operator to impose explicit physical sparsity in the latent domain.<n>Experiments on multiple simulation scenarios demonstrate that SISTA-Net outperforms state-of-the-art methods by 2.6 dB in PSNR.
  arXiv  Detail & Related papers  (2026-03-31T13:31:43Z)
• TIACam: Text-Anchored Invariant Feature Learning with Auto-Augmentation for Camera-Robust Zero-Watermarking [0.5429166905724048]
  TIACam is a text-anchored invariant feature learning framework with auto-augmentation for camera-robust zero-watermarking.<n>Experiments on both synthetic and real-world camera captures demonstrate that TIACam achieves feature stability and watermark extraction accuracy.
  arXiv  Detail & Related papers  (2026-02-21T15:06:16Z)
• T2SMark: Balancing Robustness and Diversity in Noise-as-Watermark for Diffusion Models [89.29541056113442]
  T2SMark is a two-stage watermarking scheme based on Tail-Truncated Sampling (TTS)<n>We evaluate T2SMark on diffusion models with both U-Net and DiT backbones.
  arXiv  Detail & Related papers  (2025-10-25T16:55:55Z)
• MOLM: Mixture of LoRA Markers [28.772539229108286]
  We propose a general watermarking framework that formulates the encoding problem as key-dependent of the parameters of a generative model.<n>Within this framework, we introduce Mixture of LoRA Markers (MOLM), a routing-based instantiation in which binary keys activate lightweight LoRA adapters inside residual and attention blocks.
  arXiv  Detail & Related papers  (2025-09-30T21:27:14Z)
• DiffMark: Diffusion-based Robust Watermark Against Deepfakes [49.05095089309156]
  Deepfakes pose significant security and privacy threats through malicious facial manipulations.<n>Existing watermarking methods often lack sufficient robustness against Deepfake manipulations.<n>We propose a novel robust watermarking framework based on diffusion model, called DiffMark.
  arXiv  Detail & Related papers  (2025-07-02T07:29:33Z)
• TAG-WM: Tamper-Aware Generative Image Watermarking via Diffusion Inversion Sensitivity [76.98973481600002]
  This paper proposes a Tamper-Aware Generative image WaterMarking method named TAG-WM.<n>The proposed method comprises four key modules: a dual-mark joint sampling (DMJS) algorithm for embedding copyright and localization watermarks into the latent space while preserving generative quality.<n>The experimental results demonstrate that TAG-WM achieves state-of-the-art performance in both tampering robustness and localization capability even under distortion.
  arXiv  Detail & Related papers  (2025-06-30T03:14:07Z)
• Gaussian Shading++: Rethinking the Realistic Deployment Challenge of Performance-Lossless Image Watermark for Diffusion Models [66.54457339638004]
  Copyright protection and inappropriate content generation pose challenges for the practical implementation of diffusion models.<n>We propose a diffusion model watermarking method tailored for real-world deployment.<n>Gaussian Shading++ not only maintains performance losslessness but also outperforms existing methods in terms of robustness.
  arXiv  Detail & Related papers  (2025-04-21T11:18:16Z)
• Bridging Knowledge Gap Between Image Inpainting and Large-Area Visible Watermark Removal [57.84348166457113]
  We introduce a novel feature adapting framework that leverages the representation capacity of a pre-trained image inpainting model.<n>Our approach bridges the knowledge gap between image inpainting and watermark removal by fusing information of the residual background content beneath watermarks into the inpainting backbone model.<n>For relieving the dependence on high-quality watermark masks, we introduce a new training paradigm by utilizing coarse watermark masks to guide the inference process.
  arXiv  Detail & Related papers  (2025-04-07T02:37:14Z)
• Learning Heavily-Degraded Prior for Underwater Object Detection [59.5084433933765]
  This paper seeks transferable prior knowledge from detector-friendly images. It is based on statistical observations that, the heavily degraded regions of detector-friendly (DFUI) and underwater images have evident feature distribution gaps. Our method with higher speeds and less parameters still performs better than transformer-based detectors.
  arXiv  Detail & Related papers  (2023-08-24T12:32:46Z)
• ResWCAE: Biometric Pattern Image Denoising Using Residual Wavelet-Conditioned Autoencoder [0.5656672152438563]
  Biometric authentication with pattern images is increasingly popular in compact Internet of Things (IoT) devices.<n>The reliability of such systems can be compromised by image quality issues, particularly in the presence of high levels of noise.<n>This paper proposes a lightweight and robust deep learning architecture, the Residual Wavelet-Conditioned Convolutional Autoencoder (Res-WCAE)
  arXiv  Detail & Related papers  (2023-07-23T08:02:27Z)
• A Screen-Shooting Resilient Document Image Watermarking Scheme using Deep Neural Network [6.662095297079911]
  This paper proposes a novel screen-shooting resilient watermarking scheme for document image using deep neural network. Specifically, our scheme is an end-to-end neural network with an encoder to embed watermark and a decoder to extract watermark. An embedding strength adjustment strategy is designed to improve the visual quality of the watermarked image with little loss of extraction accuracy.
  arXiv  Detail & Related papers  (2022-03-10T07:19:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.