BathyFacto: Refraction-Aware Two-Media Neural Radiance Fields for Bathymetry
- URL: http://arxiv.org/abs/2605.10174v1
- Date: Mon, 11 May 2026 08:24:59 GMT
- Title: BathyFacto: Refraction-Aware Two-Media Neural Radiance Fields for Bathymetry
- Abstract summary: Through-water photogrammetry based on UAV imagery enables shallow-water bathymetry.<n>Re refraction at the air-water interface violates the straight-ray assumption of Structure-from-Motion.<n>We present BathyFacto, a refraction-aware two-media extension of Nerfacto integrated into Nerfstudio.
- Score: 1.1183000640635818
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Through-water photogrammetry based on UAV imagery enables shallow-water bathymetry, but refraction at the air-water interface violates the straight-ray assumption of Structure-from-Motion and causes systematic depth bias. We present BathyFacto, a refraction-aware two-media extension of Nerfacto integrated into Nerfstudio that targets metrically precise underwater point clouds. BathyFacto uses a shared hash-grid-based density field with a medium-conditioned color head that receives a one-bit medium flag (air or water) and traces each camera ray as two segments: a straight segment in air up to a planar water surface and a refracted segment in water computed via Snell's law with known refractive indices. To allocate samples efficiently across the air-water boundary, we employ a single proposal-network sampler that operates on a virtual straight ray spanning both media, combined with a kinked density wrapper that transparently corrects water-segment positions along the refracted direction before density evaluation. A data adaptation pipeline converts photogrammetric reconstructions to a Nerfstudio-compatible format, estimates the water plane from boundary markers, and provides per-pixel medium masks to gate refraction. We also extend the point cloud export with refraction-corrected backprojection and reversible coordinate transforms to world and global frames. On a simulated two-media scene with known ground truth, BathyFacto with refraction achieves a Cloud-to-Mesh mean distance of 0.06 m and 87 % completeness, compared to 0.52 m / 29 % for the Nerfacto baseline and 0.36 m / 21% for conventional MVS without refraction correction.
Related papers
- RefracGS: Novel View Synthesis Through Refractive Water Surfaces with 3D Gaussian Ray Tracing [59.24689613992402]
We introduce RefracGS, a framework that jointly reconstructs the refractive water surface and the scene beneath the interface.<n>RefracGS outperforms prior refractive methods in visual quality, while achieving 15x faster training and real-time rendering at 200 FPS.
arXiv Detail & Related papers (2026-03-23T08:31:08Z) - S2ML: Spatio-Spectral Mutual Learning for Depth Completion [56.26679539288063]
Raw depth images captured by RGB-D cameras often suffer from incomplete depth values due to weak reflections, boundary shadows, and artifacts.<n>Existing methods address this problem through depth completion in the image domain, but they overlook the physical characteristics of raw depth images.<n>We propose a Spatio-Spectral Mutual Learning framework (S2ML) to harmonize the advantages of both spatial and frequency domains for depth completion.
arXiv Detail & Related papers (2025-11-08T15:01:55Z) - I2-NeRF: Learning Neural Radiance Fields Under Physically-Grounded Media Interactions [48.696181442718206]
I2-NeRF is a novel neural radiance field framework that enhances isotropic metric perception under media degradation.<n>We present a general radiative formulation for media degradation that unifies emission, absorption, and scattering into a particle model governed by the Beer-Lambert attenuation law.<n>By treating light propagation uniformly in both vertical and horizontal directions, I2-NeRF enables isotropic metric perception and can even estimate medium properties such as water depth.
arXiv Detail & Related papers (2025-10-25T05:13:28Z) - Harnessing the Diamond-Air Interface as an Efficient Photon Antenna for Solid-State Emitters [0.0]
Extracting photons from defect centers is challenging due to the high refractive index of typical substrates.<n>For nitrogen-vacancy centers in diamond, reaching saturation count rates above $2.5times105,mathrmcounts/mathrms$ so far requires nanofabricated optics.<n>Our results indicate that photon count rates approaching those of nanofabricated optics can also be achieved by oil-immersion optics.
arXiv Detail & Related papers (2025-09-30T10:46:08Z) - Evaluation of Polarimetric Fusion for Semantic Segmentation in Aquatic Environments [0.764671395172401]
Polarimetric imaging offers a single-sensor route to mitigate water-surface glare that disrupts semantic segmentation of floating objects.<n>We benchmark state-of-the-art fusion networks on PoTATO, a public dataset of polarimetric images of plastic bottles in inland waterways.
arXiv Detail & Related papers (2025-09-29T12:57:20Z) - Sea-Undistort: A Dataset for Through-Water Image Restoration in High Resolution Airborne Bathymetric Mapping [2.725507329935916]
We introduce Sea-Undistort, a comprehensive synthetic dataset of 1200 paired 512x512 through-water scenes rendered in Blender.<n>Each pair comprises a distortion-free and a distorted view, featuring realistic water effects such as sun glint, waves, and scattering over diverse seabeds.<n>Accompanied by per-image metadata such as camera parameters, sun position, and average depth, Sea-Undistort enables supervised training that is otherwise infeasible in real environments.
arXiv Detail & Related papers (2025-08-11T08:43:29Z) - NeuroPump: Simultaneous Geometric and Color Rectification for Underwater Images [52.863935209616635]
Underwater image restoration aims to remove geometric and color distortions due to water refraction, absorption and scattering.<n>We propose NeuroPump, a self-supervised method to simultaneously optimize and rectify underwater geometry and color as if water were pumped out.
arXiv Detail & Related papers (2024-12-20T13:40:28Z) - Online Refractive Camera Model Calibration in Visual Inertial Odometry [13.462106704905132]
This paper presents a general refractive camera model and online co-estimation of odometry and the refractive index of unknown media.
The refractive index is estimated online as a state variable of a monocular visual-inertial odometry framework.
The method was verified on data collected using an underwater robot traversing inside a pool.
arXiv Detail & Related papers (2024-09-18T15:48:05Z) - RFTrans: Leveraging Refractive Flow of Transparent Objects for Surface
Normal Estimation and Manipulation [50.10282876199739]
This paper introduces RFTrans, an RGB-D-based method for surface normal estimation and manipulation of transparent objects.
It integrates the RFNet, which predicts refractive flow, object mask, and boundaries, followed by the F2Net, which estimates surface normal from the refractive flow.
A real-world robot grasping task witnesses an 83% success rate, proving that refractive flow can help enable direct sim-to-real transfer.
arXiv Detail & Related papers (2023-11-21T07:19:47Z) - Optimal baseline exploitation in vertical dark-matter detectors based on
atom interferometry [50.06952271801328]
Several terrestrial detectors for gravitational waves and dark matter based on long-baseline atom interferometry are currently in the final planning stages or already under construction.
We show that resonant-mode detectors based on multi-diamond fountain gradiometers achieve the optimal, shot-noise limited, sensitivity if their height constitutes 20% of the available baseline.
arXiv Detail & Related papers (2023-09-08T08:38:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.