RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting

• URL: http://arxiv.org/abs/2605.18263v1
• Date: Mon, 18 May 2026 12:00:00 GMT
• Title: RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting
• Abstract summary: RT-Splatting is a framework that disentangles each Gaussian's geometric occupancy from its optical opacity.<n>Our hybrid factorization interprets this representation both as a surface to capture high-frequency reflections and as a volume to preserve clear transmission.<n>Experiments on challenging semi-transparent scenes show that RT-Splatting achieves state-of-the-art performance, delivering high-fidelity reflections and clear transmission with real-time rendering.
• Score: 30.977979059213776
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: 3D Gaussian Splatting (3DGS) enables real-time novel view synthesis with high visual quality. However, existing methods struggle with semi-transparent specular surfaces that exhibit both complex reflections and clear transmission, often producing blurry reflections or overly occluded transmission. To address this, we present RT-Splatting, a framework that disentangles each Gaussian's geometric occupancy from its optical opacity. This factorization yields a unified surface-volume scene representation with a single set of Gaussian primitives. Our hybrid renderer interprets this representation both as a surface to capture high-frequency reflections and as a volume to preserve clear transmission. To mitigate the ambiguity in jointly optimizing reflection and transmission, we introduce Specular-Aware Gradient Gating, which suppresses misleading gradients from highly specular regions into the transmission branch, effectively reducing distracting floaters. Experiments on challenging semi-transparent scenes show that RT-Splatting achieves state-of-the-art performance, delivering high-fidelity reflections and clear transmission with real-time rendering. Moreover, our factorization naturally enables flexible scene editing. The project page is available at https://sjj118.github.io/RT-Splatting.

Related papers

• TransmissiveGS: Residual-Guided Disentangled Gaussian Splatting for Transmissive Scene Reconstruction and Rendering [25.24244829648333]
  We present TransmissiveGS, a novel framework for disentangled reconstruction and rendering of transmissive scenes.<n>Specifically, we model the scene with a dual-Gaussian representation and introduce a deferred shading function to jointly render the two Gaussian components.<n>We propose a reflection light field that enables high-fidelity estimation of near-field reflections.
  arXiv  Detail & Related papers  (2026-05-11T15:19:04Z)
• RT-GS: Gaussian Splatting with Reflection and Transmittance Primitives [52.10688811929143]
  We propose a unified framework that integrates a microfacet material model and ray tracing to jointly model specular reflection and transmittance in Gaussian Splatting.<n>Our experiments demonstrate that our method successfully produces reflections and recovers objects behind transparent surfaces in complex environments.
  arXiv  Detail & Related papers  (2026-04-01T05:50:03Z)
• RefracGS: Novel View Synthesis Through Refractive Water Surfaces with 3D Gaussian Ray Tracing [59.24689613992402]
  We introduce RefracGS, a framework that jointly reconstructs the refractive water surface and the scene beneath the interface.<n>RefracGS outperforms prior refractive methods in visual quality, while achieving 15x faster training and real-time rendering at 200 FPS.
  arXiv  Detail & Related papers  (2026-03-23T08:31:08Z)
• PolGS++: Physically-Guided Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [76.9760302941819]
  PolGS++ is a polarimetric Gaussian Splatting framework for fast reflective surface reconstruction.<n>We introduce a depth-guided visibility mask acquisition mechanism that enables angle-of-polarization (AoP)-based tangent-space consistency constraints.
  arXiv  Detail & Related papers  (2026-03-11T14:11:42Z)
• TR-Gaussians: High-fidelity Real-time Rendering of Planar Transmission and Reflection with 3D Gaussian Splatting [35.344270353035945]
  TR-Gaussians is a novel 3D-Gaussian-based representation for high-fidelity rendering of planar transmission and reflection.<n>Experiments on different datasets demonstrate that TR-Gaussians achieve real-time, high-fidelity novel view synthesis.
  arXiv  Detail & Related papers  (2025-11-17T06:09:21Z)
• TSPE-GS: Probabilistic Depth Extraction for Semi-Transparent Surface Reconstruction via 3D Gaussian Splatting [15.513430559997701]
  3D Gaussian Splatting offers a strong speed-quality trade-off but struggles to reconstruct semi-transparent surfaces because most methods assume a single depth per pixel.<n>We propose TSPE-GS, which uniformly samples transmittance to model a pixel-wise multi-modal distribution of opacity and depth.
  arXiv  Detail & Related papers  (2025-11-13T04:18:59Z)
• RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and Reflection [16.81533668816093]
  RTR-GS is a novel inverse rendering framework capable of robustly rendering objects with arbitrary reflectance properties, decomposing BRDF and lighting, and delivering credible relighting results.<n>We show that our method enhances novel view synthesis, normal estimation, decomposition, and relighting while maintaining efficient training inference process.
  arXiv  Detail & Related papers  (2025-07-10T13:13:08Z)
• Reflections Unlock: Geometry-Aware Reflection Disentanglement in 3D Gaussian Splatting for Photorealistic Scenes Rendering [51.223347330075576]
  Ref-Unlock is a novel geometry-aware reflection modeling framework based on 3D Gaussian Splatting.<n>Our approach employs a dual-branch representation with high-order spherical harmonics to capture high-frequency reflective details.<n>Our method thus offers an efficient and generalizable solution for realistic rendering of reflective scenes.
  arXiv  Detail & Related papers  (2025-07-08T15:45:08Z)
• CVT-xRF: Contrastive In-Voxel Transformer for 3D Consistent Radiance Fields from Sparse Inputs [65.80187860906115]
  We propose a novel approach to improve NeRF's performance with sparse inputs. We first adopt a voxel-based ray sampling strategy to ensure that the sampled rays intersect with a certain voxel in 3D space. We then randomly sample additional points within the voxel and apply a Transformer to infer the properties of other points on each ray, which are then incorporated into the volume rendering.
  arXiv  Detail & Related papers  (2024-03-25T15:56:17Z)
• GS-IR: 3D Gaussian Splatting for Inverse Rendering [71.14234327414086]
  We propose GS-IR, a novel inverse rendering approach based on 3D Gaussian Splatting (GS) We extend GS, a top-performance representation for novel view synthesis, to estimate scene geometry, surface material, and environment illumination from multi-view images captured under unknown lighting conditions. The flexible and expressive GS representation allows us to achieve fast and compact geometry reconstruction, photorealistic novel view synthesis, and effective physically-based rendering.
  arXiv  Detail & Related papers  (2023-11-26T02:35:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.