PhyGaP: Physically-Grounded Gaussians with Polarization Cues

• URL: http://arxiv.org/abs/2603.14001v1
• Date: Sat, 14 Mar 2026 16:03:19 GMT
• Title: PhyGaP: Physically-Grounded Gaussians with Polarization Cues
• Abstract summary: 3D Gaussian Splatting (3DGS) has demonstrated great success in modeling reflective 3D objects and their interaction with the environment via reflection (DR)<n>Existing methods often struggle with correctly reconstructing physical attributes such as albedo and reflectance, and therefore they do not support relighting.<n>We develop PhyGaP, a physically-ground 3DGS method that leverages polarization to facilitate precise decomposition and visually consistent relighting.
• Score: 22.116726816522178
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Recent advances in 3D Gaussian Splatting (3DGS) have demonstrated great success in modeling reflective 3D objects and their interaction with the environment via deferred rendering (DR). However, existing methods often struggle with correctly reconstructing physical attributes such as albedo and reflectance, and therefore they do not support high-fidelity relighting. Observing that this limitation stems from the lack of shape and material information in RGB images, we present PhyGaP, a physically-grounded 3DGS method that leverages polarization cues to facilitate precise reflection decomposition and visually consistent relighting of reconstructed objects. Specifically, we design a polarimetric deferred rendering (PolarDR) process to model polarization by reflection, and a self-occlusion-aware environment map building technique (GridMap) to resolve indirect lighting of non-convex objects. We validate on multiple synthetic and real-world scenes, including those featuring only partial polarization cues, that PhyGaP not only excels in reconstructing the appearance and surface normal of reflective 3D objects (~2 dB in PSNR and 45.7% in Cosine Distance better than existing RGB-based methods on average), but also achieves state-of-the-art inverse rendering and relighting capability. Our code will be released soon.

Related papers

• GOR-IS: 3D Gaussian Object Removal in the Intrinsic Space [25.715087606246215]
  3D Gaussian Object Removal in the Intrinsic Space (GOR-IS) is a novel framework for physically consistent and visually coherent 3D object removal.<n>Our approach decomposes the scene into intrinsic components and explicitly models light transport to maintain global lighting effects consistency.<n>Our framework substantially improves the physical consistency and visual coherence of object removal, outperforming existing methods by 13% in perceptual similarity (LPIPS) and 2dB in peak signal-to-noise ratio (PSNR)
  arXiv  Detail & Related papers  (2026-05-01T08:20:47Z)
• PolGS++: Physically-Guided Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [76.9760302941819]
  PolGS++ is a polarimetric Gaussian Splatting framework for fast reflective surface reconstruction.<n>We introduce a depth-guided visibility mask acquisition mechanism that enables angle-of-polarization (AoP)-based tangent-space consistency constraints.
  arXiv  Detail & Related papers  (2026-03-11T14:11:42Z)
• PolarGuide-GSDR: 3D Gaussian Splatting Driven by Polarization Priors and Deferred Reflection for Real-World Reflective Scenes [14.263443353159978]
  Polarization-forward-guided paradigm establishing a bidirectional coupling mechanism between polarization and 3DGS.<n>We demonstrate that PolarGuide-GSDR achieves state-of-the-art performance in specular reconstruction, normal estimation, and novel view synthesis.
  arXiv  Detail & Related papers  (2025-12-02T11:34:55Z)
• MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inference [83.38607296779423]
  We show that multi-view consistent material inference with more physically-based environment modeling is key to learning accurate reflections with Gaussian Splatting.<n>Our method faithfully recovers both illumination and geometry, achieving state-of-the-art rendering quality in novel views synthesis.
  arXiv  Detail & Related papers  (2025-10-13T13:29:20Z)
• PolGS: Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [68.8705801813427]
  PolGS is a Polarimetric Gaussian Splatting model allowing fast reflective surface reconstruction in 10 minutes.<n>By integrating polarimetric constraints into the 3DGS framework, PolGS effectively separates specular and diffuse components, enhancing reconstruction quality for challenging reflective materials.
  arXiv  Detail & Related papers  (2025-09-24T03:09:52Z)
• GOGS: High-Fidelity Geometry and Relighting for Glossy Objects via Gaussian Surfels [0.9392167468538465]
  Inverse rendering of glossy objects from RGB imagery remains fundamentally limited by inherent ambiguity.<n>We propose GOGS, a novel two-stage framework based on 2D Gaussian surfels.<n>We demonstrate state-of-the-art performance in geometry reconstruction, material separation, and photorealistic relighting under novel illuminations.
  arXiv  Detail & Related papers  (2025-08-20T09:35:40Z)
• Reflections Unlock: Geometry-Aware Reflection Disentanglement in 3D Gaussian Splatting for Photorealistic Scenes Rendering [51.223347330075576]
  Ref-Unlock is a novel geometry-aware reflection modeling framework based on 3D Gaussian Splatting.<n>Our approach employs a dual-branch representation with high-order spherical harmonics to capture high-frequency reflective details.<n>Our method thus offers an efficient and generalizable solution for realistic rendering of reflective scenes.
  arXiv  Detail & Related papers  (2025-07-08T15:45:08Z)
• RGS-DR: Deferred Reflections and Residual Shading in 2D Gaussian Splatting [42.30107053583194]
  We argue for a refinement stage to improve specular detail, thereby bridging the gap with reconstruction-only methods.<n>Our pipeline estimates editable material properties and environment illumination while employing a directional residual pass.<n>In contrast to per-Gaussian shading with shortest-axis normals and normal residuals, a pixel-deferred surfel formulation with specular residuals yields sharper highlights, cleaner materials, and improved editability.
  arXiv  Detail & Related papers  (2025-04-25T16:23:50Z)
• GUS-IR: Gaussian Splatting with Unified Shading for Inverse Rendering [83.69136534797686]
  We present GUS-IR, a novel framework designed to address the inverse rendering problem for complicated scenes featuring rough and glossy surfaces. This paper starts by analyzing and comparing two prominent shading techniques popularly used for inverse rendering, forward shading and deferred shading. We propose a unified shading solution that combines the advantages of both techniques for better decomposition.
  arXiv  Detail & Related papers  (2024-11-12T01:51:05Z)
• NeRSP: Neural 3D Reconstruction for Reflective Objects with Sparse Polarized Images [62.752710734332894]
  NeRSP is a Neural 3D reconstruction technique for Reflective surfaces with Sparse Polarized images. We derive photometric and geometric cues from the polarimetric image formation model and multiview azimuth consistency. We achieve the state-of-the-art surface reconstruction results with only 6 views as input.
  arXiv  Detail & Related papers  (2024-06-11T09:53:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.