Neural Radiosity
- URL: http://arxiv.org/abs/2105.12319v1
- Date: Wed, 26 May 2021 04:10:00 GMT
- Title: Neural Radiosity
- Authors: Saeed Hadadan, Shuhong Chen, Matthias Zwicker
- Abstract summary: We introduce Neural Radiosity, an algorithm to solve the equation by minimizing the norm of its residual equation.
Our approach decouples solving the radiance equation from rendering (perspective) images, and allows us to efficiently synthesize arbitrary views of a scene.
- Score: 31.35525999999182
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We introduce Neural Radiosity, an algorithm to solve the rendering equation
by minimizing the norm of its residual similar as in traditional radiosity
techniques. Traditional basis functions used in radiosity techniques, such as
piecewise polynomials or meshless basis functions are typically limited to
representing isotropic scattering from diffuse surfaces. Instead, we propose to
leverage neural networks to represent the full four-dimensional radiance
distribution, directly optimizing network parameters to minimize the norm of
the residual. Our approach decouples solving the rendering equation from
rendering (perspective) images similar as in traditional radiosity techniques,
and allows us to efficiently synthesize arbitrary views of a scene. In
addition, we propose a network architecture using geometric learnable features
that improves convergence of our solver compared to previous techniques. Our
approach leads to an algorithm that is simple to implement, and we demonstrate
its effectiveness on a variety of scenes with non-diffuse surfaces.
Related papers
- Hyper-VolTran: Fast and Generalizable One-Shot Image to 3D Object
Structure via HyperNetworks [53.67497327319569]
We introduce a novel neural rendering technique to solve image-to-3D from a single view.
Our approach employs the signed distance function as the surface representation and incorporates generalizable priors through geometry-encoding volumes and HyperNetworks.
Our experiments show the advantages of our proposed approach with consistent results and rapid generation.
arXiv Detail & Related papers (2023-12-24T08:42:37Z) - NeuRBF: A Neural Fields Representation with Adaptive Radial Basis
Functions [93.02515761070201]
We present a novel type of neural fields that uses general radial bases for signal representation.
Our method builds upon general radial bases with flexible kernel position and shape, which have higher spatial adaptivity and can more closely fit target signals.
When applied to neural radiance field reconstruction, our method achieves state-of-the-art rendering quality, with small model size and comparable training speed.
arXiv Detail & Related papers (2023-09-27T06:32:05Z) - NeuS-PIR: Learning Relightable Neural Surface using Pre-Integrated Rendering [23.482941494283978]
This paper presents a method, namely NeuS-PIR, for recovering relightable neural surfaces from multi-view images or video.
Unlike methods based on NeRF and discrete meshes, our method utilizes implicit neural surface representation to reconstruct high-quality geometry.
Our method enables advanced applications such as relighting, which can be seamlessly integrated with modern graphics engines.
arXiv Detail & Related papers (2023-06-13T09:02:57Z) - Inverse Global Illumination using a Neural Radiometric Prior [26.29610954064107]
Inverse rendering methods that account for global illumination are becoming more popular.
This paper proposes a radiometric prior as a simple alternative to building complete path integrals in a traditional differentiable path tracer.
arXiv Detail & Related papers (2023-05-03T15:36:39Z) - Differentiable Rendering for Synthetic Aperture Radar Imagery [0.0]
We propose an approach for differentiable rendering of Synthetic Aperture Radar (SAR) imagery, which combines methods from 3D computer graphics with neural rendering.
We demonstrate the approach on the inverse graphics problem of 3D Object Reconstruction from limited SAR imagery using high-fidelity simulated SAR data.
arXiv Detail & Related papers (2022-04-04T05:27:40Z) - Differentiable Neural Radiosity [28.72382947011186]
We introduce Differentiable Neural Radiosity, a novel method of representing the solution of the differential rendering equation using a neural network.
Inspired by neural radiosity techniques, we minimize the norm of the residual of the differential rendering equation to directly optimize our network.
arXiv Detail & Related papers (2022-01-31T12:53:37Z) - InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Rendering [55.70938412352287]
We present an information-theoretic regularization technique for few-shot novel view synthesis based on neural implicit representation.
The proposed approach minimizes potential reconstruction inconsistency that happens due to insufficient viewpoints.
We achieve consistently improved performance compared to existing neural view synthesis methods by large margins on multiple standard benchmarks.
arXiv Detail & Related papers (2021-12-31T11:56:01Z) - Revisit Geophysical Imaging in A New View of Physics-informed Generative
Adversarial Learning [2.12121796606941]
Full waveform inversion produces high-resolution subsurface models.
FWI with least-squares function suffers from many drawbacks such as the local-minima problem.
Recent works relying on partial differential equations and neural networks show promising performance for two-dimensional FWI.
We propose an unsupervised learning paradigm that integrates wave equation with a discriminate network to accurately estimate the physically consistent models.
arXiv Detail & Related papers (2021-09-23T15:54:40Z) - NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor
Multi-view Stereo [97.07453889070574]
We present a new multi-view depth estimation method that utilizes both conventional SfM reconstruction and learning-based priors.
We show that our proposed framework significantly outperforms state-of-the-art methods on indoor scenes.
arXiv Detail & Related papers (2021-09-02T17:54:31Z) - Uncalibrated Neural Inverse Rendering for Photometric Stereo of General
Surfaces [103.08512487830669]
This paper presents an uncalibrated deep neural network framework for the photometric stereo problem.
Existing neural network-based methods either require exact light directions or ground-truth surface normals of the object or both.
We propose an uncalibrated neural inverse rendering approach to this problem.
arXiv Detail & Related papers (2020-12-12T10:33:08Z) - MetaSDF: Meta-learning Signed Distance Functions [85.81290552559817]
Generalizing across shapes with neural implicit representations amounts to learning priors over the respective function space.
We formalize learning of a shape space as a meta-learning problem and leverage gradient-based meta-learning algorithms to solve this task.
arXiv Detail & Related papers (2020-06-17T05:14:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.