Domain Reduction Strategy for Non Line of Sight Imaging
- URL: http://arxiv.org/abs/2308.10269v1
- Date: Sun, 20 Aug 2023 14:00:33 GMT
- Title: Domain Reduction Strategy for Non Line of Sight Imaging
- Authors: Hyunbo Shim, In Cho, Daekyu Kwon, Seon Joo Kim
- Abstract summary: This paper presents a novel optimization-based method for non-line-of-sight (NLOS) imaging.
Our method is built upon the observation that photons returning from each point in hidden volumes can be independently computed.
We demonstrate the effectiveness of the method in various NLOS scenarios, including non-planar relay wall, sparse scanning patterns, confocal and non-confocal, and surface geometry reconstruction.
- Score: 22.365437882740657
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: This paper presents a novel optimization-based method for non-line-of-sight
(NLOS) imaging that aims to reconstruct hidden scenes under various setups. Our
method is built upon the observation that photons returning from each point in
hidden volumes can be independently computed if the interactions between hidden
surfaces are trivially ignored. We model the generalized light propagation
function to accurately represent the transients as a linear combination of
these functions. Moreover, our proposed method includes a domain reduction
procedure to exclude empty areas of the hidden volumes from the set of
propagation functions, thereby improving computational efficiency of the
optimization. We demonstrate the effectiveness of the method in various NLOS
scenarios, including non-planar relay wall, sparse scanning patterns, confocal
and non-confocal, and surface geometry reconstruction. Experiments conducted on
both synthetic and real-world data clearly support the superiority and the
efficiency of the proposed method in general NLOS scenarios.
Related papers
- A Slices Perspective for Incremental Nonparametric Inference in High Dimensional State Spaces [25.16567521220103]
We introduce an innovative method for incremental nonparametric probabilistic inference in high-dimensional state spaces.
Our approach leverages slices from high-dimensional surfaces to efficiently approximate posterior distributions of any shape.
arXiv Detail & Related papers (2024-05-26T06:52:56Z) - AlignMiF: Geometry-Aligned Multimodal Implicit Field for LiDAR-Camera
Joint Synthesis [98.3959800235485]
Recently, there exist some methods exploring multiple modalities within a single field, aiming to share implicit features from different modalities to enhance reconstruction performance.
In this work, we conduct comprehensive analyses on the multimodal implicit field of LiDAR-camera joint synthesis, revealing the underlying issue lies in the misalignment of different sensors.
We introduce AlignMiF, a geometrically aligned multimodal implicit field with two proposed modules: Geometry-Aware Alignment (GAA) and Shared Geometry Initialization (SGI)
arXiv Detail & Related papers (2024-02-27T13:08:47Z) - A Metaheuristic for Amortized Search in High-Dimensional Parameter
Spaces [0.0]
We propose a new metaheuristic that drives dimensionality reductions from feature-informed transformations.
DR-FFIT implements an efficient sampling strategy that facilitates a gradient-free parameter search in high-dimensional spaces.
Our test data show that DR-FFIT boosts the performances of random-search and simulated-annealing against well-established metaheuristics.
arXiv Detail & Related papers (2023-09-28T14:25:14Z) - Self-Calibrating, Fully Differentiable NLOS Inverse Rendering [15.624750787186803]
Time-resolved non-line-of-sight (NLOS) imaging methods reconstruct hidden scenes by inverting the optical paths of indirect illumination measured at visible relay surfaces.
We introduce a fully-differentiable end-to-end NLOS inverse rendering pipeline that self-calibrates the imaging parameters during the reconstruction of hidden scenes.
We demonstrate the robustness of our method to consistently reconstruct geometry and albedo, even under significant noise levels.
arXiv Detail & Related papers (2023-09-21T13:15:54Z) - Anti-Aliased Neural Implicit Surfaces with Encoding Level of Detail [54.03399077258403]
We present LoD-NeuS, an efficient neural representation for high-frequency geometry detail recovery and anti-aliased novel view rendering.
Our representation aggregates space features from a multi-convolved featurization within a conical frustum along a ray.
arXiv Detail & Related papers (2023-09-19T05:44:00Z) - LoLep: Single-View View Synthesis with Locally-Learned Planes and
Self-Attention Occlusion Inference [66.45326873274908]
We propose a novel method, LoLep, which regresses Locally-Learned planes from a single RGB image to represent scenes accurately.
Compared to MINE, our approach has an LPIPS reduction of 4.8%-9.0% and an RV reduction of 73.9%-83.5%.
arXiv Detail & Related papers (2023-07-23T03:38:55Z) - Laplacian-based Cluster-Contractive t-SNE for High Dimensional Data
Visualization [20.43471678277403]
We propose LaptSNE, a new graph-based dimensionality reduction method based on t-SNE.
Specifically, LaptSNE leverages the eigenvalue information of the graph Laplacian to shrink the potential clusters in the low-dimensional embedding.
We show how to calculate the gradient analytically, which may be of broad interest when considering optimization with Laplacian-composited objective.
arXiv Detail & Related papers (2022-07-25T14:10:24Z) - Parametric Level-sets Enhanced To Improve Reconstruction (PaLEnTIR) [0.0]
We introduce PaLEnTIR, a significantly enhanced parametric level-set (PaLS) method addressing the restoration and reconstruction of piecewise constant objects.
Our key contribution involves a unique PaLS formulation utilizing a single level-set function to restore scenes containing multi-contrast piecewise-constant objects.
arXiv Detail & Related papers (2022-04-21T00:03:44Z) - Light Field Reconstruction Using Convolutional Network on EPI and
Extended Applications [78.63280020581662]
A novel convolutional neural network (CNN)-based framework is developed for light field reconstruction from a sparse set of views.
We demonstrate the high performance and robustness of the proposed framework compared with state-of-the-art algorithms.
arXiv Detail & Related papers (2021-03-24T08:16:32Z) - Leveraging Spatial and Photometric Context for Calibrated Non-Lambertian
Photometric Stereo [61.6260594326246]
We introduce an efficient fully-convolutional architecture that can leverage both spatial and photometric context simultaneously.
Using separable 4D convolutions and 2D heat-maps reduces the size and makes more efficient.
arXiv Detail & Related papers (2021-03-22T18:06:58Z) - Discrete Action On-Policy Learning with Action-Value Critic [72.20609919995086]
Reinforcement learning (RL) in discrete action space is ubiquitous in real-world applications, but its complexity grows exponentially with the action-space dimension.
We construct a critic to estimate action-value functions, apply it on correlated actions, and combine these critic estimated action values to control the variance of gradient estimation.
These efforts result in a new discrete action on-policy RL algorithm that empirically outperforms related on-policy algorithms relying on variance control techniques.
arXiv Detail & Related papers (2020-02-10T04:23:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.