Inter-Reflective Gaussian Splatting for Robust and Efficient Inverse Rendering
- URL: http://arxiv.org/abs/2607.22780v1
- Date: Fri, 24 Jul 2026 10:07:10 GMT
- Title: Inter-Reflective Gaussian Splatting for Robust and Efficient Inverse Rendering
- Abstract summary: IRGS++ (Inter-Reflective Gaussian Splatting) is a robust and efficient inverse rendering framework.<n>It employs differentiable 2D Gaussian ray tracing on surface-oriented Gaussian primitives to query visibility and indirect radiance on the fly.
- Score: 15.31654252194479
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Faithful inverse rendering requires visibility and indirect radiance to explain secondary illumination and inter-reflection, yet rasterization-oriented Gaussian representations do not naturally support the secondary-ray queries needed to recover them. We present IRGS++ (Inter-Reflective Gaussian Splatting), a unified robust and efficient Gaussian inverse rendering framework. During transport-aware optimization, IRGS++ employs differentiable 2D Gaussian ray tracing on surface-oriented Gaussian primitives to query visibility and indirect radiance on the fly and evaluate the full rendering equation for inter-reflective transport. This physical core makes Gaussian inverse rendering physically grounded beyond rasterized appearance modeling. To make this backbone useful beyond low-gloss dielectric scenes, the framework incorporates metallic-aware material modeling and robust reflective initialization for glossy, specular, and metallic materials. To make it practical, multiple importance sampling and denoising stabilize finite-sample rendering, while mesh-based secondary-attribute queries reduce the cost of relighting under novel illumination. Quantitative evaluations on low-gloss and glossy benchmarks show improved decomposition and relighting quality together with favorable quality--speed trade-offs under the reported configurations, while real-world studies illustrate plausible relighting under novel illumination.
Related papers
- RT-GS: Gaussian Splatting with Reflection and Transmittance Primitives [52.10688811929143]
We propose a unified framework that integrates a microfacet material model and ray tracing to jointly model specular reflection and transmittance in Gaussian Splatting.<n>Our experiments demonstrate that our method successfully produces reflections and recovers objects behind transparent surfaces in complex environments.
arXiv Detail & Related papers (2026-04-01T05:50:03Z) - PolGS++: Physically-Guided Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [76.9760302941819]
PolGS++ is a polarimetric Gaussian Splatting framework for fast reflective surface reconstruction.<n>We introduce a depth-guided visibility mask acquisition mechanism that enables angle-of-polarization (AoP)-based tangent-space consistency constraints.
arXiv Detail & Related papers (2026-03-11T14:11:42Z) - Ref-DGS: Reflective Dual Gaussian Splatting [51.77181103979343]
Reflective appearance, especially strong and typically near-field specular reflections, poses a fundamental challenge for accurate surface reconstruction and novel view.<n>We present Ref-DGS, a reflective dual Gaussian splatting framework that addresses this trade-off.<n>Experiments demonstrate that Ref-DGS achieves state-of-the-art performance on reflective scenes while training substantially faster than ray-based Gaussian methods.
arXiv Detail & Related papers (2026-03-08T14:54:15Z) - MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inference [83.38607296779423]
We show that multi-view consistent material inference with more physically-based environment modeling is key to learning accurate reflections with Gaussian Splatting.<n>Our method faithfully recovers both illumination and geometry, achieving state-of-the-art rendering quality in novel views synthesis.
arXiv Detail & Related papers (2025-10-13T13:29:20Z) - GOGS: High-Fidelity Geometry and Relighting for Glossy Objects via Gaussian Surfels [0.9392167468538465]
Inverse rendering of glossy objects from RGB imagery remains fundamentally limited by inherent ambiguity.<n>We propose GOGS, a novel two-stage framework based on 2D Gaussian surfels.<n>We demonstrate state-of-the-art performance in geometry reconstruction, material separation, and photorealistic relighting under novel illuminations.
arXiv Detail & Related papers (2025-08-20T09:35:40Z) - Reflective Gaussian Splatting [36.111845416439095]
We introduce a Reflective Gaussian splatting (Ref-Gaussian) framework characterized with two components.<n>Ref-Gaussian surpasses existing approaches in terms of quantitative metrics, visual quality, and compute efficiency.<n>Also, we show that Ref-Gaussian supports more applications such as relighting and editing.
arXiv Detail & Related papers (2024-12-26T16:58:35Z) - IRGS: Inter-Reflective Gaussian Splatting with 2D Gaussian Ray Tracing [3.147103287687791]
We introduce inter-reflective Gaussian splatting (IRGS) for inverse rendering.<n>We apply the full rendering equation without simplification and compute incident radiance on the fly.<n> Furthermore, we introduce a novel strategy for querying the indirect radiance of incident light when relighting the optimized scenes.
arXiv Detail & Related papers (2024-12-20T13:10:43Z) - DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading [50.331929164207324]
We introduce DeferredGS, a method for decoupling and editing the Gaussian splatting representation using deferred shading.
Both qualitative and quantitative experiments demonstrate the superior performance of DeferredGS in novel view and editing tasks.
arXiv Detail & Related papers (2024-04-15T01:58:54Z) - NeFII: Inverse Rendering for Reflectance Decomposition with Near-Field
Indirect Illumination [48.42173911185454]
Inverse rendering methods aim to estimate geometry, materials and illumination from multi-view RGB images.
We propose an end-to-end inverse rendering pipeline that decomposes materials and illumination from multi-view images.
arXiv Detail & Related papers (2023-03-29T12:05:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.