NeReF: Neural Refractive Field for Fluid Surface Reconstruction and Implicit Representation

• URL: http://arxiv.org/abs/2203.04130v1
• Date: Tue, 8 Mar 2022 14:56:16 GMT
• Title: NeReF: Neural Refractive Field for Fluid Surface Reconstruction and Implicit Representation
• Abstract summary: We present a novel neural refractive field(NeReF) to recover wavefront of transparent fluids by simultaneously estimating the surface position and normal of the fluid front. We show NeReF, as a global optimization scheme, can more robustly tackle refraction distortions to traditional methods for correspondence matching. We validate our approach on both synthetic and real data and show it is particularly suitable for sparse multi-view acquisition.
• Score: 43.76192255181977
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Existing neural reconstruction schemes such as Neural Radiance Field (NeRF) are largely focused on modeling opaque objects. We present a novel neural refractive field(NeReF) to recover wavefront of transparent fluids by simultaneously estimating the surface position and normal of the fluid front. Unlike prior arts that treat the reconstruction target as a single layer of the surface, NeReF is specifically formulated to recover a volumetric normal field with its corresponding density field. A query ray will be refracted by NeReF according to its accumulated refractive point and normal, and we employ the correspondences and uniqueness of refracted ray for NeReF optimization. We show NeReF, as a global optimization scheme, can more robustly tackle refraction distortions detrimental to traditional methods for correspondence matching. Furthermore, the continuous NeReF representation of wavefront enables view synthesis as well as normal integration. We validate our approach on both synthetic and real data and show it is particularly suitable for sparse multi-view acquisition. We hence build a small light field array and experiment on various surface shapes to demonstrate high fidelity NeReF reconstruction.

Related papers

• RefracGS: Novel View Synthesis Through Refractive Water Surfaces with 3D Gaussian Ray Tracing [59.24689613992402]
  We introduce RefracGS, a framework that jointly reconstructs the refractive water surface and the scene beneath the interface.<n>RefracGS outperforms prior refractive methods in visual quality, while achieving 15x faster training and real-time rendering at 200 FPS.
  arXiv  Detail & Related papers  (2026-03-23T08:31:08Z)
• Iterative Diffusion-Refined Neural Attenuation Fields for Multi-Source Stationary CT Reconstruction: NAF Meets Diffusion Model [20.480681036392173]
  Multi-source stationary computed tomography (CT) has recently attracted attention for its ability to achieve rapid image reconstruction.<n>This study proposes Diffusion-Refined Neural Attenuation Fields (Diff-NAF), an iterative framework tailored for multi-source stationary CT under ultra-sparse-view conditions.
  arXiv  Detail & Related papers  (2025-11-18T10:14:28Z)
• Wavelet-Space Representations for Neural Super-Resolution in Rendering Pipelines [0.0]
  We introduce a formulation that predicts stationary wavelet coefficients rather than directly regressing RGB values.<n>Wavelet-domain neural super-resolution provides a principled and efficient path toward higher-quality real-time rendering.
  arXiv  Detail & Related papers  (2025-08-22T01:01:44Z)
• PBR-NeRF: Inverse Rendering with Physics-Based Neural Fields [49.6405458373509]
  We present an inverse rendering (IR) model capable of jointly estimating scene geometry, materials, and illumination. Our method is easily adaptable to other inverse rendering and 3D reconstruction frameworks that require material estimation.
  arXiv  Detail & Related papers  (2024-12-12T19:00:21Z)
• ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstruction [50.07671826433922]
  It is non-trivial to simultaneously recover meticulous geometry and preserve smoothness across regions with differing characteristics. We propose ND-SDF, which learns a Normal Deflection field to represent the angular deviation between the scene normal and the prior normal. Our method not only obtains smooth weakly textured regions such as walls and floors but also preserves the geometric details of complex structures.
  arXiv  Detail & Related papers  (2024-08-22T17:59:01Z)
• RaNeuS: Ray-adaptive Neural Surface Reconstruction [87.20343320266215]
  We leverage a differentiable radiance field eg NeRF to reconstruct detailed 3D surfaces in addition to producing novel view renderings. Considering that different methods formulate and optimize the projection from SDF to radiance field with a globally constant Eikonal regularization, we improve with a ray-wise weighting factor. Our proposed textitRaNeuS are extensively evaluated on both synthetic and real datasets.
  arXiv  Detail & Related papers  (2024-06-14T07:54:25Z)
• NeRSP: Neural 3D Reconstruction for Reflective Objects with Sparse Polarized Images [62.752710734332894]
  NeRSP is a Neural 3D reconstruction technique for Reflective surfaces with Sparse Polarized images. We derive photometric and geometric cues from the polarimetric image formation model and multiview azimuth consistency. We achieve the state-of-the-art surface reconstruction results with only 6 views as input.
  arXiv  Detail & Related papers  (2024-06-11T09:53:18Z)
• NePF: Neural Photon Field for Single-Stage Inverse Rendering [6.977356702921476]
  We present a novel single-stage framework, Neural Photon Field (NePF), to address the ill-posed inverse rendering from multi-view images. NePF achieves this unification by fully utilizing the physical implication behind the weight function of neural implicit surfaces. We evaluate our method on both real and synthetic datasets.
  arXiv  Detail & Related papers  (2023-11-20T06:15:46Z)
• NeRRF: 3D Reconstruction and View Synthesis for Transparent and Specular Objects with Neural Refractive-Reflective Fields [23.099784003061618]
  We introduce the refractive-reflective field to Neural radiance fields (NeRF) NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. We propose a virtual cone supersampling technique to achieve efficient and effective anti-aliasing.
  arXiv  Detail & Related papers  (2023-09-22T17:59:12Z)
• FlipNeRF: Flipped Reflection Rays for Few-shot Novel View Synthesis [30.25904672829623]
  We propose FlipNeRF, a novel regularization method for few-shot novel view synthesis by utilizing our proposed flipped reflection rays. FlipNeRF is able to estimate more reliable outputs with reducing floating artifacts effectively across the different scene structures.
  arXiv  Detail & Related papers  (2023-06-30T15:11:00Z)
• N-SfC: Robust and Fast Shape Estimation from Caustic Images [0.0]
  We introduce a learning-based extension that incorporates two components into the reconstruction pipeline: a denoising module and an optimization process. We significantly outperform the current state-of-the-art in terms of computational speed and final surface error in 3D glass printing.
  arXiv  Detail & Related papers  (2021-12-13T14:45:08Z)
• Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields [40.72851892972173]
  We introduce Ref-NeRF, which replaces NeRF's parameterization of view-dependent outgoing radiance with a representation of reflected radiance and structures. We show that our model's internal representation of outgoing radiance is interpretable and useful for scene editing.
  arXiv  Detail & Related papers  (2021-12-07T18:58:37Z)
• NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination [60.89737319987051]
  We address the problem of recovering shape and spatially-varying reflectance of an object from posed multi-view images of the object illuminated by one unknown lighting condition. This enables the rendering of novel views of the object under arbitrary environment lighting and editing of the object's material properties.
  arXiv  Detail & Related papers  (2021-06-03T16:18:01Z)
• Non-line-of-Sight Imaging via Neural Transient Fields [52.91826472034646]
  We present a neural modeling framework for Non-Line-of-Sight (NLOS) imaging. Inspired by the recent Neural Radiance Field (NeRF) approach, we use a multi-layer perceptron (MLP) to represent the neural transient field or NeTF. We formulate a spherical volume NeTF reconstruction pipeline, applicable to both confocal and non-confocal setups.
  arXiv  Detail & Related papers  (2021-01-02T05:20:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.