3DSS: 3D Surface Splatting for Inverse Rendering
- URL: http://arxiv.org/abs/2605.05876v3
- Date: Wed, 13 May 2026 12:24:19 GMT
- Title: 3DSS: 3D Surface Splatting for Inverse Rendering
- Abstract summary: 3D Surface Splatting (3DSS) is the first differentiable surface splatting for physically-based inverse rendering from multi-view images.<n>Our central insight is that the surface separation problem at the heart of surface splatting admits a direct formulation in terms of the reconstruction kernels themselves.
- Score: 16.042394978941516
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We present 3D Surface Splatting (3DSS), the first differentiable surface splatting renderer for physically-based inverse rendering from multi-view images. Our central insight is that the surface separation problem at the heart of surface splatting admits a direct formulation in terms of the reconstruction kernels themselves. From this foundation we derive a coverage-based compositing model whose per-layer opacity arises directly from the accumulated Elliptical Weighted Average reconstruction weight, yielding anti-aliased silhouettes and informative visibility gradients at sparsely covered edges. Combined with forward microfacet shading under co-optimized HDR environment lighting and density-aware adaptive refinement, 3DSS jointly recovers shape, spatially-varying BRDF materials, and illumination. Because the optimized representation is a set of oriented surface samples, it bridges natively to mesh-based workflows via surface reconstruction from oriented point cloud methods. We evaluate 3DSS against mesh-based, implicit, and Gaussian-splatting baselines across geometry reconstruction, novel-view synthesis, and novel-illumination relighting.
Related papers
- Surfsvr: 2D Surface Priors as 3D Geometric Regularizers for Sparse Voxel Reconstruction [56.51413081953813]
SurfSVR is a novel sparse voxel reconstruction paradigm that treats 2D surface priors as explicit 3D geometric regularizers.<n>It consistently improves sparse voxel reconstruction across scenes with substantially different visibility and geometry characteristics.
arXiv Detail & Related papers (2026-08-12T11:25:31Z) - PolGS++: Physically-Guided Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [76.9760302941819]
PolGS++ is a polarimetric Gaussian Splatting framework for fast reflective surface reconstruction.<n>We introduce a depth-guided visibility mask acquisition mechanism that enables angle-of-polarization (AoP)-based tangent-space consistency constraints.
arXiv Detail & Related papers (2026-03-11T14:11:42Z) - SSR-GS: Separating Specular Reflection in Gaussian Splatting for Glossy Surface Reconstruction [7.2438370491008754]
We propose SSR-GS, a specular reflection modeling framework for glossy surface reconstruction.<n>Specifically, we introduce a prefiltered Mip-Cubemap to model direct specular reflections efficiently, and propose an IndiASG module to capture indirect specular reflections.<n>Experiments on both synthetic and real-world datasets demonstrate that SSR-GS achieves state-of-the-art performance in glossy surface reconstruction.
arXiv Detail & Related papers (2026-03-05T13:24:13Z) - SDFoam: Signed-Distance Foam for explicit surface reconstruction [8.803067028201387]
We show how to learn an explicit Voronoi Diagram (VD) with an implicit Distance Field (SDF)<n>The resulting model produces crisper, view-consistent surfaces with fewer floaters and improved topology.<n>Across diverse scenes, our hybrid implicit-explicit formulation, which we name SDFoam, substantially improves mesh reconstruction accuracy (Chamfer distance) with comparable appearance (PSNR, SSIM)
arXiv Detail & Related papers (2025-12-18T16:11:18Z) - PolGS: Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [68.8705801813427]
PolGS is a Polarimetric Gaussian Splatting model allowing fast reflective surface reconstruction in 10 minutes.<n>By integrating polarimetric constraints into the 3DGS framework, PolGS effectively separates specular and diffuse components, enhancing reconstruction quality for challenging reflective materials.
arXiv Detail & Related papers (2025-09-24T03:09:52Z) - SurfaceSplat: Connecting Surface Reconstruction and Gaussian Splatting [92.13737830605902]
Surface reconstruction and novel view rendering from sparse-view images are challenging.<n>We propose a novel hybrid method that combines the strengths of both approaches.<n>Our method surpasses state-of-the-art approaches in surface reconstruction and novel view synthesis on the DTU and MobileBrick datasets.
arXiv Detail & Related papers (2025-07-21T13:25:03Z) - NeuSD: Surface Completion with Multi-View Text-to-Image Diffusion [56.98287481620215]
We present a novel method for 3D surface reconstruction from multiple images where only a part of the object of interest is captured.
Our approach builds on two recent developments: surface reconstruction using neural radiance fields for the reconstruction of the visible parts of the surface, and guidance of pre-trained 2D diffusion models in the form of Score Distillation Sampling (SDS) to complete the shape in unobserved regions in a plausible manner.
arXiv Detail & Related papers (2023-12-07T19:30:55Z) - Delicate Textured Mesh Recovery from NeRF via Adaptive Surface
Refinement [78.48648360358193]
We present a novel framework that generates textured surface meshes from images.
Our approach begins by efficiently initializing the geometry and view-dependency appearance with a NeRF.
We jointly refine the appearance with geometry and bake it into texture images for real-time rendering.
arXiv Detail & Related papers (2023-03-03T17:14:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.