WateRF: Robust Watermarks in Radiance Fields for Protection of Copyrights

• URL: http://arxiv.org/abs/2405.02066v4
• Date: Fri, 12 Jul 2024 03:35:19 GMT
• Title: WateRF: Robust Watermarks in Radiance Fields for Protection of Copyrights
• Authors: Youngdong Jang, Dong In Lee, MinHyuk Jang, Jong Wook Kim, Feng Yang, Sangpil Kim,
• Abstract summary: We introduce an innovative watermarking method that can be employed in both representations of NeRF. This is achieved by fine-tuning NeRF to embed binary messages in the rendering process. We evaluate our method in three different aspects: capacity, invisibility, and robustness of the embedded watermarks in the 2D-rendered images.
• Score: 10.136998438185882
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The advances in the Neural Radiance Fields (NeRF) research offer extensive applications in diverse domains, but protecting their copyrights has not yet been researched in depth. Recently, NeRF watermarking has been considered one of the pivotal solutions for safely deploying NeRF-based 3D representations. However, existing methods are designed to apply only to implicit or explicit NeRF representations. In this work, we introduce an innovative watermarking method that can be employed in both representations of NeRF. This is achieved by fine-tuning NeRF to embed binary messages in the rendering process. In detail, we propose utilizing the discrete wavelet transform in the NeRF space for watermarking. Furthermore, we adopt a deferred back-propagation technique and introduce a combination with the patch-wise loss to improve rendering quality and bit accuracy with minimum trade-offs. We evaluate our method in three different aspects: capacity, invisibility, and robustness of the embedded watermarks in the 2D-rendered images. Our method achieves state-of-the-art performance with faster training speed over the compared state-of-the-art methods.

Related papers

• Shallow Diffuse: Robust and Invisible Watermarking through Low-Dimensional Subspaces in Diffusion Models [10.726987194250116]
  We introduce Shallow Diffuse, a new watermarking technique that embeds robust and invisible watermarks into diffusion model outputs. Our theoretical and empirical analyses show that Shallow Diffuse greatly enhances the consistency of data generation and the detectability of the watermark.
  arXiv  Detail & Related papers  (2024-10-28T14:51:04Z)
• WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splatting [39.58317527488534]
  We propose a novel approach that fuses volumetric rendering with 3DGS to handle underwater data effectively. Our method outperforms state-of-the-art NeRF-based methods in rendering quality on the underwater SeaThru-NeRF dataset.
  arXiv  Detail & Related papers  (2024-08-15T15:16:49Z)
• Protecting NeRFs' Copyright via Plug-And-Play Watermarking Base Model [29.545874014535297]
  Neural Radiance Fields (NeRFs) have become a key method for 3D scene representation. We propose textbfNeRFProtector, which adopts a plug-and-play strategy to protect NeRF's copyright during its creation.
  arXiv  Detail & Related papers  (2024-07-10T15:06:52Z)
• Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models [71.13610023354967]
  Copyright protection and inappropriate content generation pose challenges for the practical implementation of diffusion models. We propose a diffusion model watermarking technique that is both performance-lossless and training-free.
  arXiv  Detail & Related papers  (2024-04-07T13:30:10Z)
• IPR-NeRF: Ownership Verification meets Neural Radiance Field [100.76162575686368]
  This paper proposes a comprehensive intellectual property (IP) protection framework for the NeRF model in both black-box and white-box settings. In the black-box setting, a diffusion-based solution is introduced to embed and extract the watermark. In the white-box setting, a designated digital signature is embedded into the weights of the NeRF model by adopting the sign loss objective.
  arXiv  Detail & Related papers  (2024-01-17T01:33:40Z)
• 3D Visibility-aware Generalizable Neural Radiance Fields for Interacting Hands [51.305421495638434]
  Neural radiance fields (NeRFs) are promising 3D representations for scenes, objects, and humans. This paper proposes a generalizable visibility-aware NeRF framework for interacting hands. Experiments on the Interhand2.6M dataset demonstrate that our proposed VA-NeRF outperforms conventional NeRFs significantly.
  arXiv  Detail & Related papers  (2024-01-02T00:42:06Z)
• Shielding the Unseen: Privacy Protection through Poisoning NeRF with Spatial Deformation [59.302770084115814]
  We introduce an innovative method of safeguarding user privacy against the generative capabilities of Neural Radiance Fields (NeRF) models. Our novel poisoning attack method induces changes to observed views that are imperceptible to the human eye, yet potent enough to disrupt NeRF's ability to accurately reconstruct a 3D scene. We extensively test our approach on two common NeRF benchmark datasets consisting of 29 real-world scenes with high-quality images.
  arXiv  Detail & Related papers  (2023-10-04T19:35:56Z)
• FT-Shield: A Watermark Against Unauthorized Fine-tuning in Text-to-Image Diffusion Models [64.89896692649589]
  We propose FT-Shield, a watermarking solution tailored for the fine-tuning of text-to-image diffusion models. FT-Shield addresses copyright protection challenges by designing new watermark generation and detection strategies.
  arXiv  Detail & Related papers  (2023-10-03T19:50:08Z)
• MarkNerf:Watermarking for Neural Radiance Field [6.29495604869364]
  A watermarking algorithm is proposed to address the copyright protection issue of implicit 3D models. Experimental results demonstrate that the proposed algorithm effectively safeguards the copyright of 3D models.
  arXiv  Detail & Related papers  (2023-09-21T03:00:09Z)
• CopyRNeRF: Protecting the CopyRight of Neural Radiance Fields [13.110156814776294]
  We propose to protect the copyright of NeRF models by replacing the original color representation in NeRF with a watermarked color representation. A distortion-resistant rendering scheme is designed to guarantee robust message extraction in 2D renderings of NeRF.
  arXiv  Detail & Related papers  (2023-07-21T12:14:33Z)
• PDRF: Progressively Deblurring Radiance Field for Fast and Robust Scene Reconstruction from Blurry Images [75.87721926918874]
  We present Progressively Deblurring Radiance Field (PDRF) PDRF is a novel approach to efficiently reconstruct high quality radiance fields from blurry images. We show that PDRF is 15X faster than previous State-of-The-Art scene reconstruction methods.
  arXiv  Detail & Related papers  (2022-08-17T03:42:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.