Photon-Driven Neural Path Guiding

• URL: http://arxiv.org/abs/2010.01775v1
• Date: Mon, 5 Oct 2020 04:54:01 GMT
• Title: Photon-Driven Neural Path Guiding
• Authors: Shilin Zhu, Zexiang Xu, Tiancheng Sun, Alexandr Kuznetsov, Mark Meyer, Henrik Wann Jensen, Hao Su, Ravi Ramamoorthi
• Abstract summary: We present a novel neural path guiding approach that can reconstruct high-quality sampling distributions for path guiding from a sparse set of samples. We leverage photons traced from light sources as the input for sampling density reconstruction, which is highly effective for challenging scenes with strong global illumination. Our approach achieves significantly better rendering results of testing scenes than previous state-of-the-art path guiding methods.
• Score: 102.12596782286607
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although Monte Carlo path tracing is a simple and effective algorithm to synthesize photo-realistic images, it is often very slow to converge to noise-free results when involving complex global illumination. One of the most successful variance-reduction techniques is path guiding, which can learn better distributions for importance sampling to reduce pixel noise. However, previous methods require a large number of path samples to achieve reliable path guiding. We present a novel neural path guiding approach that can reconstruct high-quality sampling distributions for path guiding from a sparse set of samples, using an offline trained neural network. We leverage photons traced from light sources as the input for sampling density reconstruction, which is highly effective for challenging scenes with strong global illumination. To fully make use of our deep neural network, we partition the scene space into an adaptive hierarchical grid, in which we apply our network to reconstruct high-quality sampling distributions for any local region in the scene. This allows for highly efficient path guiding for any path bounce at any location in path tracing. We demonstrate that our photon-driven neural path guiding method can generalize well on diverse challenging testing scenes that are not seen in training. Our approach achieves significantly better rendering results of testing scenes than previous state-of-the-art path guiding methods.

Related papers

• Fast Local Neural Regression for Low-Cost, Path Traced Lambertian Global Illumination [0.0]
  Real-time ray budgets remain stubbornly limited at a handful of samples per pixel (spp) on commodity hardware. We propose incorporating a neural network into a computationally-efficient local linear model-based denoiser. We demonstrate faithful single-frame reconstruction of global illumination for Lambertian scenes at very low sample counts.
  arXiv  Detail & Related papers  (2024-10-15T14:14:06Z)
• RL-based Stateful Neural Adaptive Sampling and Denoising for Real-Time Path Tracing [1.534667887016089]
  MonteCarlo path tracing is a powerful technique for realistic image synthesis but suffers from high levels of noise at low sample counts. We propose a framework with end-to-end training of a sampling importance network, a latent space encoder network, and a denoiser network.
  arXiv  Detail & Related papers  (2023-10-05T12:39:27Z)
• Efficient Ray Sampling for Radiance Fields Reconstruction [4.004168836949491]
  ray sampling strategy profoundly impacts network convergence. We propose a novel ray sampling approach for neural radiance fields. Our method significantly outperforms state-of-the-art techniques on public benchmark datasets.
  arXiv  Detail & Related papers  (2023-08-29T18:11:32Z)
• Inverse Global Illumination using a Neural Radiometric Prior [26.29610954064107]
  Inverse rendering methods that account for global illumination are becoming more popular. This paper proposes a radiometric prior as a simple alternative to building complete path integrals in a traditional differentiable path tracer.
  arXiv  Detail & Related papers  (2023-05-03T15:36:39Z)
• Deep Dynamic Scene Deblurring from Optical Flow [53.625999196063574]
  Deblurring can provide visually more pleasant pictures and make photography more convenient. It is difficult to model the non-uniform blur mathematically. We develop a convolutional neural network (CNN) to restore the sharp images from the deblurred features.
  arXiv  Detail & Related papers  (2023-01-18T06:37:21Z)
• Active Exploration for Neural Global Illumination of Variable Scenes [6.591705508311505]
  We introduce a novel Active Exploration method using Markov Chain Monte Carlo. We apply our approach on a neural generator that learns to render novel scene instances. Our method allows interactive rendering of hard light transport paths.
  arXiv  Detail & Related papers  (2022-03-15T21:45:51Z)
• InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Rendering [55.70938412352287]
  We present an information-theoretic regularization technique for few-shot novel view synthesis based on neural implicit representation. The proposed approach minimizes potential reconstruction inconsistency that happens due to insufficient viewpoints. We achieve consistently improved performance compared to existing neural view synthesis methods by large margins on multiple standard benchmarks.
  arXiv  Detail & Related papers  (2021-12-31T11:56:01Z)
• Aerial Images Meet Crowdsourced Trajectories: A New Approach to Robust Road Extraction [110.61383502442598]
  We introduce a novel neural network framework termed Cross-Modal Message Propagation Network (CMMPNet) CMMPNet is composed of two deep Auto-Encoders for modality-specific representation learning and a tailor-designed Dual Enhancement Module for cross-modal representation refinement. Experiments on three real-world benchmarks demonstrate the effectiveness of our CMMPNet for robust road extraction.
  arXiv  Detail & Related papers  (2021-11-30T04:30:10Z)
• Deep traffic light detection by overlaying synthetic context on arbitrary natural images [49.592798832978296]
  We propose a method to generate artificial traffic-related training data for deep traffic light detectors. This data is generated using basic non-realistic computer graphics to blend fake traffic scenes on top of arbitrary image backgrounds. It also tackles the intrinsic data imbalance problem in traffic light datasets, caused mainly by the low amount of samples of the yellow state.
  arXiv  Detail & Related papers  (2020-11-07T19:57:22Z)
• Light Stage Super-Resolution: Continuous High-Frequency Relighting [58.09243542908402]
  We propose a learning-based solution for the "super-resolution" of scans of human faces taken from a light stage. Our method aggregates the captured images corresponding to neighboring lights in the stage, and uses a neural network to synthesize a rendering of the face. Our learned model is able to produce renderings for arbitrary light directions that exhibit realistic shadows and specular highlights.
  arXiv  Detail & Related papers  (2020-10-17T23:40:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.