Polarimetric Spatio-Temporal Light Transport Probing

• URL: http://arxiv.org/abs/2105.11609v1
• Date: Tue, 25 May 2021 02:16:07 GMT
• Title: Polarimetric Spatio-Temporal Light Transport Probing
• Authors: Seung-Hwan Baek, Felix Heide
• Abstract summary: Light can undergo complex interactions with multiple scene surfaces of different material types before being reflected towards a detector. During this transport, every surface reflection and propagation is encoded in the properties of the photons that ultimately reach the detector. Existing methods can untangle these into their spatial and temporal dimensions, fueling geometric scene understanding. We propose a computational light-transport imaging method that captures the spatially- and temporally-resolved polarimetric response of a scene.
• Score: 33.499684969102816
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Light can undergo complex interactions with multiple scene surfaces of different material types before being reflected towards a detector. During this transport, every surface reflection and propagation is encoded in the properties of the photons that ultimately reach the detector, including travel time, direction, intensity, wavelength and polarization. Conventional imaging systems capture intensity by integrating over all other dimensions of the light into a single quantity, hiding this rich scene information in the accumulated measurements. Existing methods can untangle these into their spatial and temporal dimensions, fueling geometric scene understanding. However, examining polarimetric material properties jointly with geometric properties is an open challenge that could enable unprecedented capabilities beyond geometric understanding, allowing to incorporate material-dependent semantics. In this work, we propose a computational light-transport imaging method that captures the spatially- and temporally-resolved complete polarimetric response of a scene. Our method hinges on a novel 7D tensor theory of light transport. We discover low-rank structures in the polarimetric tensor dimension and propose a data-driven rotating ellipsometry method that learns to exploit redundancy of the polarimetric structures. We instantiate our theory in two imaging prototypes: spatio-polarimetric imaging and coaxial temporal-polarimetric imaging. This allows us to decompose scene light transport into temporal, spatial, and complete polarimetric dimensions that unveil scene properties hidden to conventional methods. We validate the applicability of our method on diverse tasks, including shape reconstruction with subsurface scattering, seeing through scattering medium, untangling multi-bounce light transport, breaking metamerism with polarization, and spatio-polarimetric decomposition of crystals.

Related papers

• Imaging-based Quantum Optomechanics [0.6025438902954768]
  In active imaging protocols, information about a landscape is encoded into the spatial mode of a scattered photon. We show that backaction in this setting arises from spatial photon shot noise, an effect that cannot be observed in single-mode optomechanics. In conjunction with high-$Q$ nanomechanics, our findings point to new opportunities at the interface of quantum imaging and optomechanics.
  arXiv  Detail & Related papers  (2024-07-09T17:31:50Z)
• Dimensional Reduction in Quantum Optics [0.0]
  One-dimensional quantum optical models usually rest on the intuition of large scale separation or frozen dynamics associated with the different spatial dimensions. We show how the quantized electromagnetic field can be decomposed $-$ exactly $-$ into an infinite number of subfields living on a lower dimensional subspace. The dimensional reduction approximation then corresponds to a truncation in the number of such subfields that in turn, when considering the interaction with for instance an atom, corresponds to a modification to the atomic spatial profile.
  arXiv  Detail & Related papers  (2023-12-11T19:00:02Z)
• Directional spontaneous emission in photonic crystal slabs [49.1574468325115]
  Spontaneous emission is a fundamental out-of-equilibrium process in which an excited quantum emitter relaxes to the ground state due to quantum fluctuations. One way to modify these photon-mediated interactions is to alter the dipole radiation patterns of the emitter, e.g., by placing photonic crystals near them. Our study delves into the interaction between these directional emission patterns and the aforementioned variables, revealing the untapped potential to fine-tune collective quantum optical phenomena.
  arXiv  Detail & Related papers  (2023-12-04T15:35:41Z)
• S2P3: Self-Supervised Polarimetric Pose Prediction [55.43547228561919]
  This paper proposes the first self-supervised 6D object pose prediction from multimodal RGB+polarimetric images. The novel training paradigm comprises 1) a physical model to extract geometric information of polarized light, 2) a teacher-student knowledge distillation scheme and 3) a self-supervised loss formulation through differentiable constraints.
  arXiv  Detail & Related papers  (2023-12-02T10:46:40Z)
• NeISF: Neural Incident Stokes Field for Geometry and Material Estimation [50.588983686271284]
  Multi-view inverse rendering is the problem of estimating the scene parameters such as shapes, materials, or illuminations from a sequence of images captured under different viewpoints. We propose Neural Incident Stokes Fields (NeISF), a multi-view inverse framework that reduces ambiguities using polarization cues.
  arXiv  Detail & Related papers  (2023-11-22T06:28:30Z)
• Neural Spectro-polarimetric Fields [23.54056495576914]
  We present Neural Spectro-polarimetric Fields (NeSpoF), a neural representation that models the physically-valid Stokes vector at given continuous variables of position, direction, and wavelength. NeSpoF manages inherently noisy raw measurements, showcases memory efficiency, and preserves physically vital signals. We introduce the first multi-view hyperspectral-polarimetric image dataset, comprised of both synthetic and real-world scenes.
  arXiv  Detail & Related papers  (2023-06-21T21:00:46Z)
• Sparse Ellipsometry: Portable Acquisition of Polarimetric SVBRDF and Shape with Unstructured Flash Photography [32.68190169944569]
  We present a portable polarimetric acquisition method that captures both polarimetric SVBRDF and 3D shape simultaneously. Instead of days, the total acquisition time varies between twenty and thirty minutes per object. Our results show a strong agreement with a recent ground-truth dataset of captured polarimetric BRDFs of real-world objects.
  arXiv  Detail & Related papers  (2022-07-09T09:42:59Z)
• Ultra-long photonic quantum walks via spin-orbit metasurfaces [52.77024349608834]
  We report ultra-long photonic quantum walks across several hundred optical modes, obtained by propagating a light beam through very few closely-stacked liquid-crystal metasurfaces. With this setup we engineer quantum walks up to 320 discrete steps, far beyond state-of-the-art experiments.
  arXiv  Detail & Related papers  (2022-03-28T19:37:08Z)
• Metasurface-Assisted Quantum Ghost Discrimination of Polarization Objects [0.0]
  We develop a concept of metasurface-assisted ghost imaging for non-local discrimination between a set of polarization objects. The specially designed metasurfaces are incorporated in the imaging system to perform parallel state transformations in general elliptical bases of quantum-entangled or classically-correlated photons.
  arXiv  Detail & Related papers  (2021-07-06T16:06:58Z)
• Hyperentanglement in structured quantum light [50.591267188664666]
  Entanglement in high-dimensional quantum systems, where one or more degrees of freedom of light are involved, offers increased information capacities and enables new quantum protocols. Here, we demonstrate a functional source of high-dimensional, noise-resilient hyperentangled states encoded in time-frequency and vector-vortex structured modes. We generate highly entangled photon pairs at telecom wavelength that we characterise via two-photon interference and quantum state tomography, achieving near-unity visibilities and fidelities.
  arXiv  Detail & Related papers  (2020-06-02T18:00:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.