X-SG$^2$S: Safe and Generalizable Gaussian Splatting with X-dimensional Watermarks

• URL: http://arxiv.org/abs/2502.10475v2
• Date: Wed, 23 Apr 2025 06:38:28 GMT
• Title: X-SG$^2$S: Safe and Generalizable Gaussian Splatting with X-dimensional Watermarks
• Authors: Zihang Cheng, Huiping Zhuang, Chun Li, Xin Meng, Ming Li, Fei Richard Yu, Liqiang Nie,
• Abstract summary: We propose a new framework X-SG$2$S which can simultaneously watermark 1 to 3D messages while keeping the original 3DGS scene almost unchanged.<n>X-SG$2$S is the first to unify 1 to 3D watermarking model for 3DGS and the first framework to add multi-modal watermarks simultaneous in one 3DGS.
• Score: 53.976082636337374
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: 3D Gaussian Splatting (3DGS) has been widely used in 3D reconstruction and 3D generation. Training to get a 3DGS scene often takes a lot of time and resources and even valuable inspiration. The increasing amount of 3DGS digital asset have brought great challenges to the copyright protection. However, it still lacks profound exploration targeted at 3DGS. In this paper, we propose a new framework X-SG$^2$S which can simultaneously watermark 1 to 3D messages while keeping the original 3DGS scene almost unchanged. Generally, we have a X-SG$^2$S injector for adding multi-modal messages simultaneously and an extractor for extract them. Specifically, we first split the watermarks into message patches in a fixed manner and sort the 3DGS points. A self-adaption gate is used to pick out suitable location for watermarking. Then use a XD(multi-dimension)-injection heads to add multi-modal messages into sorted 3DGS points. A learnable gate can recognize the location with extra messages and XD-extraction heads can restore hidden messages from the location recommended by the learnable gate. Extensive experiments demonstrated that the proposed X-SG$^2$S can effectively conceal multi modal messages without changing pretrained 3DGS pipeline or the original form of 3DGS parameters. Meanwhile, with simple and efficient model structure and high practicality, X-SG$^2$S still shows good performance in hiding and extracting multi-modal inner structured or unstructured messages. X-SG$^2$S is the first to unify 1 to 3D watermarking model for 3DGS and the first framework to add multi-modal watermarks simultaneous in one 3DGS which pave the wave for later researches.

Related papers

• PanoGS: Gaussian-based Panoptic Segmentation for 3D Open Vocabulary Scene Understanding [8.72555461868951]
  3D Gaussian Splatting (3DGS) has shown encouraging performance for open vocabulary scene understanding tasks. Previous methods cannot distinguish 3D instance-level information, which usually predicts a heatmap between the scene feature and text query. We propose PanoGS, a novel and effective 3D panoptic open vocabulary scene understanding approach.
  arXiv  Detail & Related papers  (2025-03-23T15:27:29Z)
• SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretraining [100.23919762298227]
  We introduce SceneSplat, the first large-scale 3D indoor scene understanding approach that operates on 3DGS. We also propose a self-supervised learning scheme that unlocks rich 3D feature learning from unlabeled scenes. SceneSplat-7K is the first large-scale 3DGS dataset for indoor scenes, comprising of 6868 scenes.
  arXiv  Detail & Related papers  (2025-03-23T12:50:25Z)
• UniGS: Unified Language-Image-3D Pretraining with Gaussian Splatting [68.37013525040891]
  We propose UniGS, integrating 3D Gaussian Splatting (3DGS) into multi-modal pre-training to enhance the 3D representation. We demonstrate the effectiveness of UniGS in learning a more general and stronger aligned multi-modal representation.
  arXiv  Detail & Related papers  (2025-02-25T05:10:22Z)
• CLIP-GS: Unifying Vision-Language Representation with 3D Gaussian Splatting [88.24743308058441]
  We present CLIP-GS, a novel multimodal representation learning framework grounded in 3DGS.<n>We develop an efficient way to generate triplets of 3DGS, images, and text, facilitating CLIP-GS in learning unified multimodal representations.
  arXiv  Detail & Related papers  (2024-12-26T09:54:25Z)
• EGSRAL: An Enhanced 3D Gaussian Splatting based Renderer with Automated Labeling for Large-Scale Driving Scene [19.20846992699852]
  We propose EGSRAL, a 3D GS-based method that relies solely on training images without extra annotations.<n>EGSRAL enhances 3D GS's capability to model both dynamic objects and static backgrounds.<n>We also propose a grouping strategy for vanilla 3D GS to address perspective issues in rendering large-scale, complex scenes.
  arXiv  Detail & Related papers  (2024-12-20T04:21:54Z)
• WATER-GS: Toward Copyright Protection for 3D Gaussian Splatting via Universal Watermarking [44.335142946449245]
  WATER-GS is a novel method designed to protect 3DGS copyrights through a universal watermarking strategy.<n>We introduce a pre-trained watermark decoder, treating raw 3DGS generative modules as potential watermarks to ensure imperceptibility.<n>We implement novel 3D distortion layers to enhance the robustness of the embedded watermark against common real-world distortions of point cloud data.
  arXiv  Detail & Related papers  (2024-12-07T16:44:22Z)
• Splats in Splats: Embedding Invisible 3D Watermark within Gaussian Splatting [28.790625685438677]
  WaterGS is the first 3DGS watermarking framework that embeds 3D content in 3DGS itself without modifying any attributes of the vanilla 3DGS.<n>Tests indicate that WaterGS significantly outperforms existing 3D steganography techniques, with 5.31% higher scene fidelity and 3X faster rendering speed.
  arXiv  Detail & Related papers  (2024-12-04T08:40:11Z)
• GuardSplat: Efficient and Robust Watermarking for 3D Gaussian Splatting [70.81218231206617]
  3D Gaussian Splatting (3DGS) has recently created impressive assets for various applications.<n>Existing watermarking methods are not suited for 3DGS considering security, capacity, and invisibility.<n>We propose GuardSplat, an innovative and efficient framework that effectively protects the copyright of 3DGS assets.
  arXiv  Detail & Related papers  (2024-11-29T17:59:03Z)
• GS-Hider: Hiding Messages into 3D Gaussian Splatting [18.16759704305008]
  3D Gaussian Splatting (3DGS) has already become the emerging research focus in the fields of 3D scene reconstruction and novel view synthesis. It is crucial to protect the copyright, integrity, and privacy of such 3D assets. We propose a steganography framework for 3DGS, dubbed GS-Hider, which can embed 3D scenes and images into original GS point clouds.
  arXiv  Detail & Related papers  (2024-05-24T00:18:15Z)
• DOGS: Distributed-Oriented Gaussian Splatting for Large-Scale 3D Reconstruction Via Gaussian Consensus [56.45194233357833]
  We propose DoGaussian, a method that trains 3DGS distributedly. Our method accelerates the training of 3DGS by 6+ times when evaluated on large-scale scenes.
  arXiv  Detail & Related papers  (2024-05-22T19:17:58Z)
• Segment Any 3D Gaussians [85.93694310363325]
  This paper presents SAGA, a highly efficient 3D promptable segmentation method based on 3D Gaussian Splatting (3D-GS)<n>Given 2D visual prompts as input, SAGA can segment the corresponding 3D target represented by 3D Gaussians within 4 ms.<n>We show that SAGA achieves real-time multi-granularity segmentation with quality comparable to state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-12-01T17:15:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.