TransmissiveGS: Residual-Guided Disentangled Gaussian Splatting for Transmissive Scene Reconstruction and Rendering

• URL: http://arxiv.org/abs/2605.10705v1
• Date: Mon, 11 May 2026 15:19:04 GMT
• Title: TransmissiveGS: Residual-Guided Disentangled Gaussian Splatting for Transmissive Scene Reconstruction and Rendering
• Abstract summary: We present TransmissiveGS, a novel framework for disentangled reconstruction and rendering of transmissive scenes.<n>Specifically, we model the scene with a dual-Gaussian representation and introduce a deferred shading function to jointly render the two Gaussian components.<n>We propose a reflection light field that enables high-fidelity estimation of near-field reflections.
• Score: 25.24244829648333
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Transmissive scenes are ubiquitous in daily life, yet reconstructing and rendering them remains highly challenging due to the inherent entanglement between near-field reflections from the surrounding environment on the transmissive surface, and the transmitted content of the scene behind it. This coupling gives rise to dual surface geometries and dual radiance components within each observation, posing ambiguities for standard methods. We present TransmissiveGS, a novel framework for disentangled reconstruction and rendering of transmissive scenes. Specifically, we model the scene with a dual-Gaussian representation and introduce a deferred shading function to jointly render the two Gaussian components. To separate reflection and transmission, we exploit the inherent multi-view inconsistency of reflections and leverage the residuals from reconstructing multi-view consistent content as cues for disentangled geometry and appearance modeling. We further propose a reflection light field that enables high-fidelity estimation of near-field reflections. During training, we introduce a high-frequency regularization to preserve fine details. We also contribute a new synthetic dataset for evaluating transmissive surface reconstruction. Experiments on both synthetic and real-world scenes demonstrate that TransmissiveGS consistently outperforms prior Gaussian Splatting-based methods in both reconstruction and rendering quality for transmissive scenes.

Related papers

• GenRec: Knowing Where to Reconstruct and Where to Generate [106.48347271421765]
  GenRec is a flow matching model that builds the reconstruction--generation split directly into its architecture, supervision, and gradient flow.<n>It attains the best reconstruction fidelity in observed regions while also surpassing purely generative baselines on perceptual quality in unobserved ones.
  arXiv  Detail & Related papers  (2026-08-18T14:31:19Z)
• RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting [30.977979059213776]
  RT-Splatting is a framework that disentangles each Gaussian's geometric occupancy from its optical opacity.<n>Our hybrid factorization interprets this representation both as a surface to capture high-frequency reflections and as a volume to preserve clear transmission.<n>Experiments on challenging semi-transparent scenes show that RT-Splatting achieves state-of-the-art performance, delivering high-fidelity reflections and clear transmission with real-time rendering.
  arXiv  Detail & Related papers  (2026-05-18T12:00:00Z)
• Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstruction [18.874270345504716]
  Multi-traversal scene reconstruction is important for high-fidelity autonomous driving simulation and digital twin construction.<n>This paper presents ADM-GS (Appearance Decomposition Splatting for Multi-Traversal Reconstruction), a framework that applies an explicit appearance decomposition to the static background.<n>In multi-traversal experiments, our method achieves a +0.98 dBR improvement over existing latent-based baselines.
  arXiv  Detail & Related papers  (2026-04-07T14:11:54Z)
• RT-GS: Gaussian Splatting with Reflection and Transmittance Primitives [52.10688811929143]
  We propose a unified framework that integrates a microfacet material model and ray tracing to jointly model specular reflection and transmittance in Gaussian Splatting.<n>Our experiments demonstrate that our method successfully produces reflections and recovers objects behind transparent surfaces in complex environments.
  arXiv  Detail & Related papers  (2026-04-01T05:50:03Z)
• PolGS++: Physically-Guided Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [76.9760302941819]
  PolGS++ is a polarimetric Gaussian Splatting framework for fast reflective surface reconstruction.<n>We introduce a depth-guided visibility mask acquisition mechanism that enables angle-of-polarization (AoP)-based tangent-space consistency constraints.
  arXiv  Detail & Related papers  (2026-03-11T14:11:42Z)
• Ref-DGS: Reflective Dual Gaussian Splatting [51.77181103979343]
  Reflective appearance, especially strong and typically near-field specular reflections, poses a fundamental challenge for accurate surface reconstruction and novel view.<n>We present Ref-DGS, a reflective dual Gaussian splatting framework that addresses this trade-off.<n>Experiments demonstrate that Ref-DGS achieves state-of-the-art performance on reflective scenes while training substantially faster than ray-based Gaussian methods.
  arXiv  Detail & Related papers  (2026-03-08T14:54:15Z)
• MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inference [83.38607296779423]
  We show that multi-view consistent material inference with more physically-based environment modeling is key to learning accurate reflections with Gaussian Splatting.<n>Our method faithfully recovers both illumination and geometry, achieving state-of-the-art rendering quality in novel views synthesis.
  arXiv  Detail & Related papers  (2025-10-13T13:29:20Z)
• Reflections Unlock: Geometry-Aware Reflection Disentanglement in 3D Gaussian Splatting for Photorealistic Scenes Rendering [51.223347330075576]
  Ref-Unlock is a novel geometry-aware reflection modeling framework based on 3D Gaussian Splatting.<n>Our approach employs a dual-branch representation with high-order spherical harmonics to capture high-frequency reflective details.<n>Our method thus offers an efficient and generalizable solution for realistic rendering of reflective scenes.
  arXiv  Detail & Related papers  (2025-07-08T15:45:08Z)
• Reflective Gaussian Splatting [36.111845416439095]
  We introduce a Reflective Gaussian splatting (Ref-Gaussian) framework characterized with two components.<n>Ref-Gaussian surpasses existing approaches in terms of quantitative metrics, visual quality, and compute efficiency.<n>Also, we show that Ref-Gaussian supports more applications such as relighting and editing.
  arXiv  Detail & Related papers  (2024-12-26T16:58:35Z)
• Sur2f: A Hybrid Representation for High-Quality and Efficient Surface Reconstruction from Multi-view Images [41.81291587750352]
  Multi-view surface reconstruction is an ill-posed, inverse problem in 3D vision research. Most of the existing methods rely either on explicit meshes, or on implicit field functions, using volume rendering of the fields for reconstruction. We propose a new hybrid representation, termed Sur2f, aiming to better benefit from both representations in a complementary manner.
  arXiv  Detail & Related papers  (2024-01-08T07:22:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.