Foveated Thermal Computational Imaging in the Wild Using All-Silicon Meta-Optics

• URL: http://arxiv.org/abs/2212.06345v1
• Date: Tue, 13 Dec 2022 02:59:38 GMT
• Title: Foveated Thermal Computational Imaging in the Wild Using All-Silicon Meta-Optics
• Authors: Vishwanath Saragadam, Zheyi Han, Vivek Boominathan, Luocheng Huang, Shiyu Tan, Johannes E. Fr\"och, Karl F. B\"ohringer, Richard G. Baraniuk, Arka Majumdar, Ashok Veeraraghavan
• Abstract summary: Foveated imaging provides a better tradeoff between situational awareness (field of view) and resolution. We build a first-of-its-kind prototype system and demonstrate 12 frames per second real-time thermal, foveated image, and video capture in the wild.
• Score: 32.56578681779799
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Foveated imaging provides a better tradeoff between situational awareness (field of view) and resolution and is critical in long-wavelength infrared regimes because of the size, weight, power, and cost of thermal sensors. We demonstrate computational foveated imaging by exploiting the ability of a meta-optical frontend to discriminate between different polarization states and a computational backend to reconstruct the captured image/video. The frontend is a three-element optic: the first element which we call the "foveal" element is a metalens that focuses s-polarized light at a distance of $f_1$ without affecting the p-polarized light; the second element which we call the "perifoveal" element is another metalens that focuses p-polarized light at a distance of $f_2$ without affecting the s-polarized light. The third element is a freely rotating polarizer that dynamically changes the mixing ratios between the two polarization states. Both the foveal element (focal length = 150mm; diameter = 75mm), and the perifoveal element (focal length = 25mm; diameter = 25mm) were fabricated as polarization-sensitive, all-silicon, meta surfaces resulting in a large-aperture, 1:6 foveal expansion, thermal imaging capability. A computational backend then utilizes a deep image prior to separate the resultant multiplexed image or video into a foveated image consisting of a high-resolution center and a lower-resolution large field of view context. We build a first-of-its-kind prototype system and demonstrate 12 frames per second real-time, thermal, foveated image, and video capture in the wild.

Related papers

• A Polarization Image Dehazing Method Based on the Principle of Physical Diffusion [12.946460236178178]
  We propose an innovative semi-physical polarization dehazing method that does not rely on an external light source. The method simulates the diffusion process of fog and designs a diffusion kernel that corresponds to image blurriness caused by this diffusion. This approach effectively achieves dehazing and detail enhancement of the scene.
  arXiv  Detail & Related papers  (2024-11-15T03:47:36Z)
• Learning to Deblur Polarized Images [15.415804124776846]
  A polarization camera can capture four polarized images with different polarizer angles in a single shot. The degree of polarization (DoP) and the angle of polarization (AoP) can be directly computed from the captured polarized images. We propose a polarized image deblurring pipeline to solve the problem in a polarization-aware manner.
  arXiv  Detail & Related papers  (2024-02-28T07:56:28Z)
• All-optical modulation with single-photons using electron avalanche [69.65384453064829]
  We demonstrate all-optical modulation using a beam with single-photon intensity. Our approach opens up the possibility of terahertz-speed optical switching at the single-photon level.
  arXiv  Detail & Related papers  (2023-12-18T20:14:15Z)
• Quantum vortices of strongly interacting photons [52.131490211964014]
  Vortices are hallmark of nontrivial dynamics in nonlinear physics. We report on the realization of quantum vortices resulting from a strong photon-photon interaction in a quantum nonlinear optical medium. For three photons, the formation of vortex lines and a central vortex ring attests to a genuine three-photon interaction.
  arXiv  Detail & Related papers  (2023-02-12T18:11:04Z)
• Super-resolution enhancement in bi-photon spatial mode demultiplexin [0.0]
  Imaging systems measuring intensity in the far field succumb to Rayleigh's curse, a resolution limitation dictated by the finite aperture of the optical system. Many proof-of-principle and some two-dimensional imaging experiments have shown that, by using spatial mode demultiplexing (SPADE), the field information collected is maximal.
  arXiv  Detail & Related papers  (2022-12-20T17:40:46Z)
• PS$^2$F: Polarized Spiral Point Spread Function for Single-Shot 3D Sensing [19.300751531634884]
  We propose a compact snapshot monocular depth estimation technique that relies on an engineered point spread function (PSF) Results from simulations and a lab prototype demonstrate that our technique achieves up to $50%$ lower depth error compared to state-of-the-art designs.
  arXiv  Detail & Related papers  (2022-07-03T03:37:27Z)
• A learning-based view extrapolation method for axial super-resolution [52.748944517480155]
  Axial light field resolution refers to the ability to distinguish features at different depths by refocusing. We propose a learning-based method to extrapolate novel views from axial volumes of sheared epipolar plane images.
  arXiv  Detail & Related papers  (2021-03-11T07:22:13Z)
• Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics [72.9038524082252]
  We propose a compact single-shot monocular hyperspectral-depth (HS-D) imaging method. Our method uses a diffractive optical element (DOE), the point spread function of which changes with respect to both depth and spectrum. To facilitate learning the DOE, we present a first HS-D dataset by building a benchtop HS-D imager.
  arXiv  Detail & Related papers  (2020-09-01T14:19:35Z)
• Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual Interpolation [14.5106375775521]
  A microgrid image polarimeter enables us to acquire a set of polarization images in one shot. Since the polarimeter consists of an image sensor equipped with a monochrome or color polarization filter array, the demosaicking process to interpolate missing pixel values plays a crucial role in obtaining high-quality polarization images. We propose a novel MPFA demosaicking method based on edge-aware residual (EARI) and also extend it to CPFA demosaicking.
  arXiv  Detail & Related papers  (2020-07-28T15:04:36Z)
• Correlation Plenoptic Imaging between Arbitrary Planes [52.77024349608834]
  We show that the protocol enables to change the focused planes, in post-processing, and to achieve an unprecedented combination of image resolution and depth of field. Results lead the way towards the development of compact designs for correlation plenoptic imaging devices based on chaotic light, as well as high-SNR plenoptic imaging devices based on entangled photon illumination.
  arXiv  Detail & Related papers  (2020-07-23T14:26:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.