Non-line-of-sight imaging with arbitrary relay surface geometries via 3D Gaussian Transient Rendering

• URL: http://arxiv.org/abs/2606.21270v1
• Date: Fri, 19 Jun 2026 09:47:17 GMT
• Title: Non-line-of-sight imaging with arbitrary relay surface geometries via 3D Gaussian Transient Rendering
• Abstract summary: Imaging objects hidden outside the direct line of sight expands the effective field of view and is critical for applications such as autonomous driving and robotic perception.<n>We propose a LOS-guided NLOS imaging pipeline that imposes no geometric assumptions on the relay surface and naturally supports both confocal and non-confocal configurations.<n>Our method represents the hidden scene using 3D Gaussian primitives and couples them with an efficient, differentiable rendering transient model, enabling end-to-end optimization directly from measured transients.
• Score: 19.621253931527082
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Imaging objects hidden outside the direct line of sight expands the effective field of view and is critical for applications such as autonomous driving and robotic perception. Despite impressive progress in time-of-flight (ToF)-based non-line-of-sight (NLOS) imaging, real-world deployment remains challenging because practical measurements are often collected over spatially limited, arbitrarily shaped relay regions-conditions that violate the planar-wall and dense-sampling assumptions made by most existing methods. To address these limitations, we propose a LOS-guided NLOS imaging pipeline that imposes no geometric assumptions on the relay surface and naturally supports both confocal and non-confocal configurations. Our method represents the hidden scene using 3D Gaussian primitives and couples them with an efficient, differentiable transient rendering model, enabling end-to-end optimization directly from measured transients. We validate our approach on real-world measurements from both a public dataset and a custom-built capture system. Across settings, our method achieves state-of-the-art reconstruction fidelity under spatially limited, sparsely sampled conditions, and significantly outperforms existing methods on complex, arbitrary relay surface geometries.

Related papers

• ARC-Loc: Leveraging Azimuthal Ray Convergence as a Geometric Cue for Direct Cross-View Localization [9.245490956012633]
  Cross-view localization (CVL) estimates the pose of a ground image by matching it to a geo-referenced satellite image.<n>We present a different approach inspired by a human navigation technique called resection, that can perform direct ground to satellite image matching and localization without relying on external depth foundation models.
  arXiv  Detail & Related papers  (2026-09-04T10:19:37Z)
• Z-FLoc: Zero-Shot Floorplan Localization via Geometric Primitives [72.63181031215858]
  We propose a zero-shot floorplan localization method that generalizes to novel environments without any retraining.<n>Our key insight is that dominant geometric primitives are ubiquitous in human-made environments.<n> Experiments on both simulated and real-world datasets show that our approach outperforms state-of-the-art learning-based methods on unseen environments.
  arXiv  Detail & Related papers  (2026-06-03T12:14:24Z)
• Power Foam: Unifying Real-Time Differentiable Ray Tracing and Rasterization [48.23652592888336]
  We introduce a differentiable 3D representation that unifies the ray tracing capabilities of foam-based ray tracing with the efficiency of modernization pipelines.<n>We generalize Voronoi foams to bounded power diagrams with controllable cell extents, enabling bounded primitives without requiring expensive Delaunay triangulations during training.
  arXiv  Detail & Related papers  (2026-04-27T20:58:36Z)
• Relaxed Rigidity with Ray-based Grouping for Dynamic Gaussian Splatting [45.57187505601368]
  We propose a novel method to explicitly preserve the local geometric structure of Gaussians across time in 4D scenes.<n>Our approach significantly outperforms existing methods, achieving superior temporal consistency and reconstruction quality.
  arXiv  Detail & Related papers  (2026-03-26T03:38:38Z)
• Robust Mesh Saliency GT Acquisition in VR via View Cone Sampling and Geometric Smoothing [59.12032628787018]
  3D mesh saliency ground truth is essential for human-centric visual modeling in virtual reality (VR)<n>Current VR eye-tracking pipelines rely on single ray sampling and Euclidean smoothing, triggering texture attention and signal leakage across gaps.<n>This paper proposes a robust framework to address these limitations.
  arXiv  Detail & Related papers  (2026-01-06T05:20:12Z)
• MonoGSDF: Exploring Monocular Geometric Cues for Gaussian Splatting-Guided Implicit Surface Reconstruction [86.87464903285208]
  We introduce MonoGSDF, a novel method that couples primitives with a neural Signed Distance Field (SDF) for high-quality reconstruction.<n>To handle arbitrary-scale scenes, we propose a scaling strategy for robust generalization.<n>Experiments on real-world datasets outperforms prior methods while maintaining efficiency.
  arXiv  Detail & Related papers  (2024-11-25T20:07:07Z)
• RaNeuS: Ray-adaptive Neural Surface Reconstruction [87.20343320266215]
  We leverage a differentiable radiance field eg NeRF to reconstruct detailed 3D surfaces in addition to producing novel view renderings. Considering that different methods formulate and optimize the projection from SDF to radiance field with a globally constant Eikonal regularization, we improve with a ray-wise weighting factor. Our proposed textitRaNeuS are extensively evaluated on both synthetic and real datasets.
  arXiv  Detail & Related papers  (2024-06-14T07:54:25Z)
• HarmonicNeRF: Geometry-Informed Synthetic View Augmentation for 3D Scene Reconstruction in Driving Scenarios [2.949710700293865]
  HarmonicNeRF is a novel approach for outdoor self-supervised monocular scene reconstruction. It capitalizes on the strengths of NeRF and enhances surface reconstruction accuracy by augmenting the input space with geometry-informed synthetic views. Our approach establishes new benchmarks in synthesizing novel depth views and reconstructing scenes, significantly outperforming existing methods.
  arXiv  Detail & Related papers  (2023-10-09T07:42:33Z)
• Shape, Pose, and Appearance from a Single Image via Bootstrapped Radiance Field Inversion [54.151979979158085]
  We introduce a principled end-to-end reconstruction framework for natural images, where accurate ground-truth poses are not available. We leverage an unconditional 3D-aware generator, to which we apply a hybrid inversion scheme where a model produces a first guess of the solution. Our framework can de-render an image in as few as 10 steps, enabling its use in practical scenarios.
  arXiv  Detail & Related papers  (2022-11-21T17:42:42Z)
• Few-shot Non-line-of-sight Imaging with Signal-surface Collaborative Regularization [18.466941045530408]
  Non-line-of-sight imaging technique aims to reconstruct targets from multiply reflected light. We propose a signal-surface collaborative regularization framework that provides noise-robust reconstructions with a minimal number of measurements. Our approach has great potential in real-time non-line-of-sight imaging applications such as rescue operations and autonomous driving.
  arXiv  Detail & Related papers  (2022-11-21T11:19:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.