WarpRF: Multi-View Consistency for Training-Free Uncertainty Quantification and Applications in Radiance Fields

• URL: http://arxiv.org/abs/2506.22433v1
• Date: Fri, 27 Jun 2025 17:59:13 GMT
• Title: WarpRF: Multi-View Consistency for Training-Free Uncertainty Quantification and Applications in Radiance Fields
• Authors: Sadra Safadoust, Fabio Tosi, Fatma Güney, Matteo Poggi,
• Abstract summary: WarpRF is a framework for quantifying the uncertainty of radiance fields.<n>It does not require any training and can be applied to any radiance field implementation for free.
• Score: 27.364205809607302
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce WarpRF, a training-free general-purpose framework for quantifying the uncertainty of radiance fields. Built upon the assumption that photometric and geometric consistency should hold among images rendered by an accurate model, WarpRF quantifies its underlying uncertainty from an unseen point of view by leveraging backward warping across viewpoints, projecting reliable renderings to the unseen viewpoint and measuring the consistency with images rendered there. WarpRF is simple and inexpensive, does not require any training, and can be applied to any radiance field implementation for free. WarpRF excels at both uncertainty quantification and downstream tasks, e.g., active view selection and active mapping, outperforming any existing method tailored to specific frameworks.

Related papers

• OPONeRF: One-Point-One NeRF for Robust Neural Rendering [70.56874833759241]
  We propose a One-Point-One NeRF (OPONeRF) framework for robust scene rendering. Small but unpredictable perturbations such as object movements, light changes and data contaminations broadly exist in real-life 3D scenes. Experimental results show that our OPONeRF outperforms state-of-the-art NeRFs on various evaluation metrics.
  arXiv  Detail & Related papers  (2024-09-30T07:49:30Z)
• Sparse-DeRF: Deblurred Neural Radiance Fields from Sparse View [17.214047499850487]
  Recent studies construct deblurred neural radiance fields using dozens of blurry images.<n>This paper focuses on constructing DeRF from sparse-view for more pragmatic real-world scenarios.
  arXiv  Detail & Related papers  (2024-07-09T07:36:54Z)
• ProvNeRF: Modeling per Point Provenance in NeRFs as a Stochastic Field [52.09661042881063]
  We propose an approach that models the bfprovenance for each point -- i.e., the locations where it is likely visible -- of NeRFs as a text field. We show that modeling per-point provenance during the NeRF optimization enriches the model with information on leading to improvements in novel view synthesis and uncertainty estimation.
  arXiv  Detail & Related papers  (2024-01-16T06:19:18Z)
• Aleth-NeRF: Illumination Adaptive NeRF with Concealing Field Assumption [65.96818069005145]
  We introduce the concept of a "Concealing Field," which assigns transmittance values to the surrounding air to account for illumination effects. In dark scenarios, we assume that object emissions maintain a standard lighting level but are attenuated as they traverse the air during the rendering process. We present a comprehensive multi-view dataset captured under challenging illumination conditions for evaluation.
  arXiv  Detail & Related papers  (2023-12-14T16:24:09Z)
• Instant Uncertainty Calibration of NeRFs Using a Meta-calibrator [60.47106421809998]
  We introduce the concept of a meta-calibrator that performs uncertainty calibration for NeRFs with a single forward pass. We show that the meta-calibrator can generalize on unseen scenes and achieves well-calibrated and state-of-the-art uncertainty for NeRFs.
  arXiv  Detail & Related papers  (2023-12-04T21:29:31Z)
• Pose-Free Neural Radiance Fields via Implicit Pose Regularization [117.648238941948]
  IR-NeRF is an innovative pose-free neural radiance field (NeRF) that introduces implicit pose regularization to refine pose estimator with unposed real images. With a collection of 2D images of a specific scene, IR-NeRF constructs a scene codebook that stores scene features and captures the scene-specific pose distribution implicitly as priors.
  arXiv  Detail & Related papers  (2023-08-29T06:14:06Z)
• Self-NeRF: A Self-Training Pipeline for Few-Shot Neural Radiance Fields [17.725937326348994]
  We propose Self-NeRF, a self-evolved NeRF that iteratively refines the radiance fields with very few number of input views. In each iteration, we label unseen views with the predicted colors or warped pixels generated by the model from the preceding iteration. These expanded pseudo-views are afflicted by imprecision in color and warping artifacts, which degrades the performance of NeRF.
  arXiv  Detail & Related papers  (2023-03-10T08:22:36Z)
• GeCoNeRF: Few-shot Neural Radiance Fields via Geometric Consistency [31.22435282922934]
  We present a novel framework to regularize Neural Radiance Field (NeRF) in a few-shot setting with a geometry-aware consistency regularization. We show that our model achieves competitive results compared to state-of-the-art few-shot NeRF models.
  arXiv  Detail & Related papers  (2023-01-26T05:14:12Z)
• Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fields [7.380217868660371]
  We show that ensembling effectively quantifies model uncertainty in Neural Radiance Fields (NeRFs) We demonstrate that NeRF uncertainty can be utilised for next-best view selection and model refinement.
  arXiv  Detail & Related papers  (2022-09-19T02:28:33Z)
• iNeRF: Inverting Neural Radiance Fields for Pose Estimation [68.91325516370013]
  We present iNeRF, a framework that performs mesh-free pose estimation by "inverting" a Neural RadianceField (NeRF) NeRFs have been shown to be remarkably effective for the task of view synthesis.
  arXiv  Detail & Related papers  (2020-12-10T18:36:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.