GaussianMarker: Uncertainty-Aware Copyright Protection of 3D Gaussian Splatting

• URL: http://arxiv.org/abs/2410.23718v1
• Date: Thu, 31 Oct 2024 08:08:54 GMT
• Title: GaussianMarker: Uncertainty-Aware Copyright Protection of 3D Gaussian Splatting
• Authors: Xiufeng Huang, Ruiqi Li, Yiu-ming Cheung, Ka Chun Cheung, Simon See, Renjie Wan,
• Abstract summary: Digital watermarking techniques can be applied to embed ownership information discreetly within 3DGS models. Naively embedding the watermark on a pre-trained 3DGS can cause obvious distortion in rendered images. We propose an uncertainty-based method that constrains the perturbation of model parameters to achieve invisible watermarking for 3DGS.
• Score: 41.90891053671943
• License:
• Abstract: 3D Gaussian Splatting (3DGS) has become a crucial method for acquiring 3D assets. To protect the copyright of these assets, digital watermarking techniques can be applied to embed ownership information discreetly within 3DGS models. However, existing watermarking methods for meshes, point clouds, and implicit radiance fields cannot be directly applied to 3DGS models, as 3DGS models use explicit 3D Gaussians with distinct structures and do not rely on neural networks. Naively embedding the watermark on a pre-trained 3DGS can cause obvious distortion in rendered images. In our work, we propose an uncertainty-based method that constrains the perturbation of model parameters to achieve invisible watermarking for 3DGS. At the message decoding stage, the copyright messages can be reliably extracted from both 3D Gaussians and 2D rendered images even under various forms of 3D and 2D distortions. We conduct extensive experiments on the Blender, LLFF and MipNeRF-360 datasets to validate the effectiveness of our proposed method, demonstrating state-of-the-art performance on both message decoding accuracy and view synthesis quality.

Related papers

• DSplats: 3D Generation by Denoising Splats-Based Multiview Diffusion Models [67.50989119438508]
  We introduce DSplats, a novel method that directly denoises multiview images using Gaussian-based Reconstructors to produce realistic 3D assets. Our experiments demonstrate that DSplats not only produces high-quality, spatially consistent outputs, but also sets a new standard in single-image to 3D reconstruction.
  arXiv  Detail & Related papers  (2024-12-11T07:32:17Z)
• WATER-GS: Toward Copyright Protection for 3D Gaussian Splatting via Universal Watermarking [44.335142946449245]
  WATER-GS is a novel method designed to protect 3DGS copyrights through a universal watermarking strategy. We introduce a pre-trained watermark decoder, treating raw 3DGS generative modules as potential watermarks to ensure imperceptibility. We implement novel 3D distortion layers to enhance the robustness of the embedded watermark against common real-world distortions of point cloud data.
  arXiv  Detail & Related papers  (2024-12-07T16:44:22Z)
• Splats in Splats: Embedding Invisible 3D Watermark within Gaussian Splatting [28.790625685438677]
  WaterGS is the first 3DGS watermarking framework that embeds 3D content in 3DGS itself without modifying any attributes of the vanilla 3DGS. Tests indicate that WaterGS significantly outperforms existing 3D steganography techniques, with 5.31% higher scene fidelity and 3X faster rendering speed.
  arXiv  Detail & Related papers  (2024-12-04T08:40:11Z)
• 3D-GSW: 3D Gaussian Splatting for Robust Watermarking [5.52538716292462]
  We introduce a robust watermarking method for 3D-GS that secures ownership of both the model and its rendered images. Our proposed method remains robust against distortions in rendered images and model attacks while maintaining high rendering quality.
  arXiv  Detail & Related papers  (2024-09-20T05:16:06Z)
• GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction [52.04103235260539]
  We present a diffusion model approach based on Gaussian Splatting representation for 3D object reconstruction from a single view. The model learns to generate 3D objects represented by sets of GS ellipsoids. The final reconstructed objects explicitly come with high-quality 3D structure and texture, and can be efficiently rendered in arbitrary views.
  arXiv  Detail & Related papers  (2024-07-05T03:43:08Z)
• Mani-GS: Gaussian Splatting Manipulation with Triangular Mesh [44.57625460339714]
  We propose a triangular mesh to manipulate 3DGS directly with self-adaptation. Our approach is capable of handling large deformations, local manipulations, and soft body simulations while keeping high-fidelity rendering.
  arXiv  Detail & Related papers  (2024-05-28T04:13:21Z)
• GS-Hider: Hiding Messages into 3D Gaussian Splatting [18.16759704305008]
  3D Gaussian Splatting (3DGS) has already become the emerging research focus in the fields of 3D scene reconstruction and novel view synthesis. It is crucial to protect the copyright, integrity, and privacy of such 3D assets. We propose a steganography framework for 3DGS, dubbed GS-Hider, which can embed 3D scenes and images into original GS point clouds.
  arXiv  Detail & Related papers  (2024-05-24T00:18:15Z)
• GaussianPro: 3D Gaussian Splatting with Progressive Propagation [49.918797726059545]
  3DGS relies heavily on the point cloud produced by Structure-from-Motion (SfM) techniques. We propose a novel method that applies a progressive propagation strategy to guide the densification of the 3D Gaussians. Our method significantly surpasses 3DGS on the dataset, exhibiting an improvement of 1.15dB in terms of PSNR.
  arXiv  Detail & Related papers  (2024-02-22T16:00:20Z)
• Lifting 2D StyleGAN for 3D-Aware Face Generation [52.8152883980813]
  We propose a framework, called LiftedGAN, that disentangles and lifts a pre-trained StyleGAN2 for 3D-aware face generation. Our model is "3D-aware" in the sense that it is able to (1) disentangle the latent space of StyleGAN2 into texture, shape, viewpoint, lighting and (2) generate 3D components for synthetic images.
  arXiv  Detail & Related papers  (2020-11-26T05:02:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.