Accelerating Inverse Rendering By Using a GPU and Reuse of Light Paths
- URL: http://arxiv.org/abs/2110.00085v1
- Date: Thu, 30 Sep 2021 20:53:08 GMT
- Title: Accelerating Inverse Rendering By Using a GPU and Reuse of Light Paths
- Authors: Ido Czerninski and Yoav Y. Schechner
- Abstract summary: Inverse rendering seeks to estimate scene characteristics from a set of data images.
Algorithms as such usually rely on a forward model and use an iterative gradient method that requires sampling millions of light paths per iteration.
This is achieved by tailoring the iterative process of inverse rendering specifically to a GPU architecture.
- Score: 14.213973379473652
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Inverse rendering seeks to estimate scene characteristics from a set of data
images. The dominant approach is based on differential rendering using
Monte-Carlo. Algorithms as such usually rely on a forward model and use an
iterative gradient method that requires sampling millions of light paths per
iteration. This paper presents an efficient framework that speeds up existing
inverse rendering algorithms. This is achieved by tailoring the iterative
process of inverse rendering specifically to a GPU architecture. For this
cause, we introduce two interleaved steps - Path Sorting and Path Recycling.
Path Sorting allows the GPU to deal with light paths of the same size. Path
Recycling allows the algorithm to use light paths from previous iterations to
better utilize the information they encode. Together, these steps significantly
speed up gradient optimization. In this paper, we give the theoretical
background for Path Recycling. We demonstrate its efficiency for volumetric
scattering tomography and reflectometry (surface reflections).
Related papers
- 3D Gaussian Ray Tracing: Fast Tracing of Particle Scenes [50.36933474990516]
This work considers ray tracing the particles, building a bounding volume hierarchy and casting a ray for each pixel using high-performance ray tracing hardware.
To efficiently handle large numbers of semi-transparent particles, we describe a specialized algorithm which encapsulates particles with bounding meshes.
Experiments demonstrate the speed and accuracy of our approach, as well as several applications in computer graphics and vision.
arXiv Detail & Related papers (2024-07-09T17:59:30Z) - MIRReS: Multi-bounce Inverse Rendering using Reservoir Sampling [17.435649250309904]
We present MIRReS, a novel two-stage inverse rendering framework.
Our method extracts an explicit geometry (triangular mesh) in stage one, and introduces a more realistic physically-based inverse rendering model.
Our method effectively estimates indirect illumination, including self-shadowing and internal reflections.
arXiv Detail & Related papers (2024-06-24T07:00:57Z) - HashPoint: Accelerated Point Searching and Sampling for Neural Rendering [9.418401219498223]
Two typical approaches are employed: renderingization and ray tracing.
The volumeization-based methods enable real-time rendering at the cost of increased memory and lower fidelity.
In contrast, the ray-tracing-based methods yield superior quality but demand longer time.
We solve this problem by our HashPoint method combining these two strategies.
arXiv Detail & Related papers (2024-04-22T09:57:53Z) - Factorized Inverse Path Tracing for Efficient and Accurate
Material-Lighting Estimation [97.0195314255101]
Inverse path tracing is expensive to compute, and ambiguities exist between reflection and emission.
Our Factorized Inverse Path Tracing (FIPT) addresses these challenges by using a factored light transport formulation.
Our algorithm enables accurate material and lighting optimization faster than previous work, and is more effective at resolving ambiguities.
arXiv Detail & Related papers (2023-04-12T07:46:05Z) - NeFII: Inverse Rendering for Reflectance Decomposition with Near-Field
Indirect Illumination [48.42173911185454]
Inverse rendering methods aim to estimate geometry, materials and illumination from multi-view RGB images.
We propose an end-to-end inverse rendering pipeline that decomposes materials and illumination from multi-view images.
arXiv Detail & Related papers (2023-03-29T12:05:19Z) - Curvature regularization for Non-line-of-sight Imaging from
Under-sampled Data [5.591221518341613]
Non-line-of-sight (NLOS) imaging aims to reconstruct the three-dimensional hidden scenes from the data measured in the line-of-sight.
We propose novel NLOS reconstruction models based on curvature regularization.
We evaluate the proposed algorithms on both synthetic and real datasets.
arXiv Detail & Related papers (2023-01-01T14:10:43Z) - Extracting Triangular 3D Models, Materials, and Lighting From Images [59.33666140713829]
We present an efficient method for joint optimization of materials and lighting from multi-view image observations.
We leverage meshes with spatially-varying materials and environment that can be deployed in any traditional graphics engine.
arXiv Detail & Related papers (2021-11-24T13:58:20Z) - Efficient and Differentiable Shadow Computation for Inverse Problems [64.70468076488419]
Differentiable geometric computation has received increasing interest for image-based inverse problems.
We propose an efficient yet efficient approach for differentiable visibility and soft shadow computation.
As our formulation is differentiable, it can be used to solve inverse problems such as texture, illumination, rigid pose, and deformation recovery from images.
arXiv Detail & Related papers (2021-04-01T09:29:05Z) - Photon-Driven Neural Path Guiding [102.12596782286607]
We present a novel neural path guiding approach that can reconstruct high-quality sampling distributions for path guiding from a sparse set of samples.
We leverage photons traced from light sources as the input for sampling density reconstruction, which is highly effective for challenging scenes with strong global illumination.
Our approach achieves significantly better rendering results of testing scenes than previous state-of-the-art path guiding methods.
arXiv Detail & Related papers (2020-10-05T04:54:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.