RT-GS: Gaussian Splatting with Reflection and Transmittance Primitives

• URL: http://arxiv.org/abs/2604.00509v1
• Date: Wed, 01 Apr 2026 05:50:03 GMT
• Title: RT-GS: Gaussian Splatting with Reflection and Transmittance Primitives
• Abstract summary: We propose a unified framework that integrates a microfacet material model and ray tracing to jointly model specular reflection and transmittance in Gaussian Splatting.<n>Our experiments demonstrate that our method successfully produces reflections and recovers objects behind transparent surfaces in complex environments.
• Score: 52.10688811929143
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Gaussian Splatting is a powerful tool for reconstructing diffuse scenes, but it struggles to simultaneously model specular reflections and the appearance of objects behind semi-transparent surfaces. These specular reflections and transmittance are essential for realistic novel view synthesis, and existing methods do not properly incorporate the underlying physical processes to simulate them. To address this issue, we propose RT-GS, a unified framework that integrates a microfacet material model and ray tracing to jointly model specular reflection and transmittance in Gaussian Splatting. We accomplish this by using separate Gaussian primitives for reflections and transmittance, which allow modeling distant reflections and reconstructing objects behind transparent surfaces concurrently. We utilize a differentiable ray tracing framework to obtain the specular reflection and transmittance appearance. Our experiments demonstrate that our method successfully produces reflections and recovers objects behind transparent surfaces in complex environments, achieving significant qualitative improvements over prior methods where these specular light interactions are prominent.

Related papers

• RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting [30.977979059213776]
  RT-Splatting is a framework that disentangles each Gaussian's geometric occupancy from its optical opacity.<n>Our hybrid factorization interprets this representation both as a surface to capture high-frequency reflections and as a volume to preserve clear transmission.<n>Experiments on challenging semi-transparent scenes show that RT-Splatting achieves state-of-the-art performance, delivering high-fidelity reflections and clear transmission with real-time rendering.
  arXiv  Detail & Related papers  (2026-05-18T12:00:00Z)
• PolGS++: Physically-Guided Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [76.9760302941819]
  PolGS++ is a polarimetric Gaussian Splatting framework for fast reflective surface reconstruction.<n>We introduce a depth-guided visibility mask acquisition mechanism that enables angle-of-polarization (AoP)-based tangent-space consistency constraints.
  arXiv  Detail & Related papers  (2026-03-11T14:11:42Z)
• Ref-DGS: Reflective Dual Gaussian Splatting [51.77181103979343]
  Reflective appearance, especially strong and typically near-field specular reflections, poses a fundamental challenge for accurate surface reconstruction and novel view.<n>We present Ref-DGS, a reflective dual Gaussian splatting framework that addresses this trade-off.<n>Experiments demonstrate that Ref-DGS achieves state-of-the-art performance on reflective scenes while training substantially faster than ray-based Gaussian methods.
  arXiv  Detail & Related papers  (2026-03-08T14:54:15Z)
• SSR-GS: Separating Specular Reflection in Gaussian Splatting for Glossy Surface Reconstruction [7.2438370491008754]
  We propose SSR-GS, a specular reflection modeling framework for glossy surface reconstruction.<n>Specifically, we introduce a prefiltered Mip-Cubemap to model direct specular reflections efficiently, and propose an IndiASG module to capture indirect specular reflections.<n>Experiments on both synthetic and real-world datasets demonstrate that SSR-GS achieves state-of-the-art performance in glossy surface reconstruction.
  arXiv  Detail & Related papers  (2026-03-05T13:24:13Z)
• TR-Gaussians: High-fidelity Real-time Rendering of Planar Transmission and Reflection with 3D Gaussian Splatting [35.344270353035945]
  TR-Gaussians is a novel 3D-Gaussian-based representation for high-fidelity rendering of planar transmission and reflection.<n>Experiments on different datasets demonstrate that TR-Gaussians achieve real-time, high-fidelity novel view synthesis.
  arXiv  Detail & Related papers  (2025-11-17T06:09:21Z)
• MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inference [83.38607296779423]
  We show that multi-view consistent material inference with more physically-based environment modeling is key to learning accurate reflections with Gaussian Splatting.<n>Our method faithfully recovers both illumination and geometry, achieving state-of-the-art rendering quality in novel views synthesis.
  arXiv  Detail & Related papers  (2025-10-13T13:29:20Z)
• PolGS: Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [68.8705801813427]
  PolGS is a Polarimetric Gaussian Splatting model allowing fast reflective surface reconstruction in 10 minutes.<n>By integrating polarimetric constraints into the 3DGS framework, PolGS effectively separates specular and diffuse components, enhancing reconstruction quality for challenging reflective materials.
  arXiv  Detail & Related papers  (2025-09-24T03:09:52Z)
• REFRAME: Reflective Surface Real-Time Rendering for Mobile Devices [51.983541908241726]
  This work tackles the challenging task of achieving real-time novel view synthesis for reflective surfaces across various scenes. Existing real-time rendering methods, especially those based on meshes, often have subpar performance in modeling surfaces with rich view-dependent appearances. We decompose the color into diffuse and specular, and model the specular color in the reflected direction based on a neural environment map.
  arXiv  Detail & Related papers  (2024-03-25T07:07:50Z)
• TraM-NeRF: Tracing Mirror and Near-Perfect Specular Reflections through Neural Radiance Fields [3.061835990893184]
  Implicit representations like Neural Radiance Fields (NeRF) showed impressive results for rendering of complex scenes with fine details. We present a novel reflection tracing method tailored for the involved volume rendering within NeRF. We derive efficient strategies for importance sampling and the transmittance computation along rays from only few samples.
  arXiv  Detail & Related papers  (2023-10-16T17:59:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.