TranSplat: Lighting-Consistent Cross-Scene Object Transfer with 3D Gaussian Splatting

• URL: http://arxiv.org/abs/2503.22676v2
• Date: Wed, 07 May 2025 06:06:33 GMT
• Title: TranSplat: Lighting-Consistent Cross-Scene Object Transfer with 3D Gaussian Splatting
• Abstract summary: TranSplat is a 3D scene rendering algorithm that enables realistic cross-scene object transfer.<n>Our approach addresses two critical challenges: (1) precise 3D object extraction from the source scene, and (2) faithful relighting of the transferred object in the target scene.
• Score: 18.51049292733173
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present TranSplat, a 3D scene rendering algorithm that enables realistic cross-scene object transfer (from a source to a target scene) based on the Gaussian Splatting framework. Our approach addresses two critical challenges: (1) precise 3D object extraction from the source scene, and (2) faithful relighting of the transferred object in the target scene without explicit material property estimation. TranSplat fits a splatting model to the source scene, using 2D object masks to drive fine-grained 3D segmentation. Following user-guided insertion of the object into the target scene, along with automatic refinement of position and orientation, TranSplat derives per-Gaussian radiance transfer functions via spherical harmonic analysis to adapt the object's appearance to match the target scene's lighting environment. This relighting strategy does not require explicitly estimating physical scene properties such as BRDFs. Evaluated on several synthetic and real-world scenes and objects, TranSplat yields excellent 3D object extractions and relighting performance compared to recent baseline methods and visually convincing cross-scene object transfers. We conclude by discussing the limitations of the approach.

Related papers

• Lighting-Consistent Object Transfer Across Radiance Fields [8.199509508364383]
  3D Gaussian Splatting (3DGS) is widely used to capture and render real scenes.<n>We introduce a diffusion model that harmonizes naively composited images with inconsistent lighting.<n>Our method provides visually compelling results, making object transfer between 3DGS easy to use.
  arXiv  Detail & Related papers  (2026-06-21T12:50:07Z)
• Leveraging 2D Priors and SDF Guidance for Dynamic Urban Scene Rendering [23.15241977092541]
  We present a novel approach that integrates Signed Distance Functions (SDFs) with 3D Gaussian Splatting (3DGS) to create a more robust object representation.<n>Our method achieves state-of-the-art performance in rendering metrics even without LiDAR data on urban scenes.
  arXiv  Detail & Related papers  (2025-10-15T10:21:36Z)
• ComGS: Efficient 3D Object-Scene Composition via Surface Octahedral Probes [46.83857963152283]
  Gaussian Splatting (GS) enables immersive rendering, but realistic 3D object-scene composition remains challenging.<n>We propose ComGS, a novel 3D object-scene composition framework.<n>Our method achieves high-quality, real-time rendering at around 28 FPS, produces visually harmonious results with vivid shadows, and requires only 36 seconds for editing.
  arXiv  Detail & Related papers  (2025-10-09T03:10:41Z)
• ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via Gaussian Splatting [54.92763171355442]
  ObjectGS is an object-aware framework that unifies 3D scene reconstruction with semantic understanding.<n>We show through experiments that ObjectGS outperforms state-of-the-art methods on open-vocabulary and panoptic segmentation tasks.
  arXiv  Detail & Related papers  (2025-07-21T10:06:23Z)
• TRAN-D: 2D Gaussian Splatting-based Sparse-view Transparent Object Depth Reconstruction via Physics Simulation for Scene Update [14.360210515795904]
  TRAN-D is a novel 2D Gaussian Splatting-based depth reconstruction method for transparent objects.<n>We mitigate artifacts with an object-aware loss that places Gaussians in obscured regions.<n>We incorporate a physics-based simulation that refines the reconstruction in just a few seconds.
  arXiv  Detail & Related papers  (2025-07-15T08:02:37Z)
• CasaGPT: Cuboid Arrangement and Scene Assembly for Interior Design [35.11283253765395]
  We present a novel approach for indoor scene synthesis, which learns to arrange decomposed cuboid primitives to represent 3D objects within a scene. Our approach, coined CasaGPT for Cuboid Arrangement and Scene Assembly, employs an autoregressive model to sequentially arrange cuboids, producing physically plausible scenes.
  arXiv  Detail & Related papers  (2025-04-28T04:35:04Z)
• D3DR: Lighting-Aware Object Insertion in Gaussian Splatting [48.80431740983095]
  We propose a method, dubbed D3DR, for inserting a 3DGS-parametrized object into 3DGS scenes.<n>We leverage advances in diffusion models, which, trained on real-world data, implicitly understand correct scene lighting.<n>We demonstrate the method's effectiveness by comparing it to existing approaches.
  arXiv  Detail & Related papers  (2025-03-09T19:48:00Z)
• TranSplat: Surface Embedding-guided 3D Gaussian Splatting for Transparent Object Manipulation [10.957451368533302]
  TranSplat is a surface embedding-guided 3D Gaussian Splatting method tailored for transparent objects.<n>By integrating these surface embeddings with input RGB images, TranSplat effectively captures the complexities of transparent surfaces.
  arXiv  Detail & Related papers  (2025-02-11T03:43:56Z)
• Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Description [56.69740649781989]
  3D scene understanding is a long-standing challenge in computer vision and a key component in enabling mixed reality, wearable computing, and embodied AI.<n>We introduce Articulate3D, an expertly curated 3D dataset featuring high-quality manual annotations on 280 indoor scenes.<n>We also present USDNet, a novel unified framework capable of simultaneously predicting part segmentation along with a full specification of motion attributes for articulated objects.
  arXiv  Detail & Related papers  (2024-12-02T11:33:55Z)
• T-3DGS: Removing Transient Objects for 3D Scene Reconstruction [83.05271859398779]
  Transient objects in video sequences can significantly degrade the quality of 3D scene reconstructions.<n>We propose T-3DGS, a novel framework that robustly filters out transient distractors during 3D reconstruction using Gaussian Splatting.
  arXiv  Detail & Related papers  (2024-11-29T07:45:24Z)
• LidaRefer: Outdoor 3D Visual Grounding for Autonomous Driving with Transformers [1.0589208420411014]
  LidaRefer is a transformer-based 3D VG framework designed for large-scale outdoor scenes. We introduce a simple and effective localization method, which supervises the decoder's queries to localize ambiguous objects. LidaRefer achieves state-of-the-art performance on Talk2Car-3D, a 3D VG dataset for autonomous driving.
  arXiv  Detail & Related papers  (2024-11-07T01:12:01Z)
• HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting [53.6394928681237]
  holistic understanding of urban scenes based on RGB images is a challenging yet important problem. Our main idea involves the joint optimization of geometry, appearance, semantics, and motion using a combination of static and dynamic 3D Gaussians. Our approach offers the ability to render new viewpoints in real-time, yielding 2D and 3D semantic information with high accuracy.
  arXiv  Detail & Related papers  (2024-03-19T13:39:05Z)
• SceneWiz3D: Towards Text-guided 3D Scene Composition [134.71933134180782]
  Existing approaches either leverage large text-to-image models to optimize a 3D representation or train 3D generators on object-centric datasets. We introduce SceneWiz3D, a novel approach to synthesize high-fidelity 3D scenes from text.
  arXiv  Detail & Related papers  (2023-12-13T18:59:30Z)
• Generating Visual Spatial Description via Holistic 3D Scene Understanding [88.99773815159345]
  Visual spatial description (VSD) aims to generate texts that describe the spatial relations of the given objects within images. With an external 3D scene extractor, we obtain the 3D objects and scene features for input images. We construct a target object-centered 3D spatial scene graph (Go3D-S2G), such that we model the spatial semantics of target objects within the holistic 3D scenes.
  arXiv  Detail & Related papers  (2023-05-19T15:53:56Z)
• Towards 3D Scene Understanding by Referring Synthetic Models [65.74211112607315]
  Methods typically alleviate on-extensive annotations on real scene scans. We explore how synthetic models rely on real scene categories of synthetic features to a unified feature space. Experiments show that our method achieves the average mAP of 46.08% on the ScanNet S3DIS dataset and 55.49% by learning datasets.
  arXiv  Detail & Related papers  (2022-03-20T13:06:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.