Snapshot Multispectral Imaging Using a Diffractive Optical Network

• URL: http://arxiv.org/abs/2212.05217v1
• Date: Sat, 10 Dec 2022 05:54:24 GMT
• Title: Snapshot Multispectral Imaging Using a Diffractive Optical Network
• Authors: Deniz Mengu, Anika Tabassum, Mona Jarrahi, Aydogan Ozcan
• Abstract summary: We present a diffractive optical network-based multispectral imaging system trained using deep learning. This diffractive multispectral imager performs spatially-coherent imaging over a large spectrum. We experimentally demonstrate a diffractive multispectral imager based on a 3D-printed diffractive network.
• Score: 2.8880000014100506
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep learning to create a virtual spectral filter array at the output image field-of-view. This diffractive multispectral imager performs spatially-coherent imaging over a large spectrum, and at the same time, routes a pre-determined set of spectral channels onto an array of pixels at the output plane, converting a monochrome focal plane array or image sensor into a multispectral imaging device without any spectral filters or image recovery algorithms. Furthermore, the spectral responsivity of this diffractive multispectral imager is not sensitive to input polarization states. Through numerical simulations, we present different diffractive network designs that achieve snapshot multispectral imaging with 4, 9 and 16 unique spectral bands within the visible spectrum, based on passive spatially-structured diffractive surfaces, with a compact design that axially spans ~72 times the mean wavelength of the spectral band of interest. Moreover, we experimentally demonstrate a diffractive multispectral imager based on a 3D-printed diffractive network that creates at its output image plane a spatially-repeating virtual spectral filter array with 2x2=4 unique bands at terahertz spectrum. Due to their compact form factor and computation-free, power-efficient and polarization-insensitive forward operation, diffractive multispectral imagers can be transformative for various imaging and sensing applications and be used at different parts of the electromagnetic spectrum where high-density and wide-area multispectral pixel arrays are not widely available.

Related papers

• Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processor [11.382198495580127]
  We present a 3D stack of phase-only objects using a wavelength-multiplexed diffractive optical processor. We show that our diffractive processor could simultaneously achieve all-optical quantitative phase imaging across several distinct axial planes at the input.
  arXiv  Detail & Related papers  (2024-03-16T22:49:47Z)
• TOP-ReID: Multi-spectral Object Re-Identification with Token Permutation [64.65950381870742]
  We propose a cyclic token permutation framework for multi-spectral object ReID, dubbled TOP-ReID. We also propose a Token Permutation Module (TPM) for cyclic multi-spectral feature aggregation. Our proposed framework can generate more discriminative multi-spectral features for robust object ReID.
  arXiv  Detail & Related papers  (2023-12-15T08:54:15Z)
• SSIF: Learning Continuous Image Representation for Spatial-Spectral Super-Resolution [73.46167948298041]
  We propose a neural implicit model that represents an image as a function of both continuous pixel coordinates in the spatial domain and continuous wavelengths in the spectral domain. We show that SSIF generalizes well to both unseen spatial resolutions and spectral resolutions. It can generate high-resolution images that improve the performance of downstream tasks by 1.7%-7%.
  arXiv  Detail & Related papers  (2023-09-30T15:23:30Z)
• Multispectral Quantitative Phase Imaging Using a Diffractive Optical Network [0.0]
  We present the design of a diffractive processor that can all-optically perform multispectral quantitative phase imaging of transparent phase-only objects in a snapshot. Our design utilizes spatially engineered diffractive layers, optimized through deep learning, to encode the phase profile of the input object. These diffractive multispectral processors maintain uniform performance across all the wavelength channels, revealing a decent QPI performance at each target wavelength.
  arXiv  Detail & Related papers  (2023-08-05T21:13:25Z)
• Longwave infrared multispectral image sensor system using aluminum-germanium plasmonic filter arrays [0.8081564951955755]
  A multispectral camera records image data in various wavelengths across the electromagnetic spectrum to acquire additional information that a conventional camera fails to capture. We experimentally demonstrate an LWIR multispectral image sensor with three wavelength bands using optical elements made of an aluminum-based plasmonic filter array sandwiched in germanium. Our work demonstrates a versatile spectral thermography technique for detecting target signatures in the LWIR range and other advanced spectral analyses.
  arXiv  Detail & Related papers  (2023-03-03T01:47:32Z)
• Programmable Spectral Filter Arrays for Hyperspectral Imaging [23.742208436405534]
  Modulating the spectral dimension of light has numerous applications in computational dimension imaging. This paper provides an optical design for implementing such a capability. We show a number of unique operating points with our prototype including single- and multi-image hyperspectral imaging.
  arXiv  Detail & Related papers  (2021-09-29T14:30:55Z)
• Spectral Splitting and Aggregation Network for Hyperspectral Face Super-Resolution [82.59267937569213]
  High-resolution (HR) hyperspectral face image plays an important role in face related computer vision tasks under uncontrolled conditions. In this paper, we investigate how to adapt the deep learning techniques to hyperspectral face image super-resolution. We present a spectral splitting and aggregation network (SSANet) for HFSR with limited training samples.
  arXiv  Detail & Related papers  (2021-08-31T02:13:00Z)
• Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery [79.69449412334188]
  In this paper, we investigate how to adapt state-of-the-art residual learning based single gray/RGB image super-resolution approaches. We introduce a spatial-spectral prior network (SSPN) to fully exploit the spatial information and the correlation between the spectra of the hyperspectral data. Experimental results on some hyperspectral images demonstrate that the proposed SSPSR method enhances the details of the recovered high-resolution hyperspectral images.
  arXiv  Detail & Related papers  (2020-05-18T14:25:50Z)
• Spectrally-Encoded Single-Pixel Machine Vision Using Diffractive Networks [6.610893384480686]
  3D engineering of matter has opened up new avenues for designing systems that can perform various computational tasks through light-matter interaction. Here, we demonstrate the design of optical networks in the form of multiple diffractive layers that are trained using deep learning to transform and encode the spatial information of objects into the power spectrum of the diffracted light. We experimentally validated this machine vision framework at terahertz spectrum to optically classify the images of handwritten digits by detecting the spectral power of the diffracted light at ten distinct wavelengths.
  arXiv  Detail & Related papers  (2020-05-15T09:18:21Z)
• Hyperspectral-Multispectral Image Fusion with Weighted LASSO [68.04032419397677]
  We propose an approach for fusing hyperspectral and multispectral images to provide high-quality hyperspectral output. We demonstrate that the proposed sparse fusion and reconstruction provides quantitatively superior results when compared to existing methods on publicly available images.
  arXiv  Detail & Related papers  (2020-03-15T23:07:56Z)
• Frequency-Domain Quantum Interference with Correlated Photons from an Integrated Microresonator [96.25398432840109]
  We report frequency-domain Hong-Ou-Mandel interference with spectrally distinct photons generated from a chip-based microresonator. Our work establishes four-wave mixing as a tool for selective high-fidelity two-photon operations in the frequency domain.
  arXiv  Detail & Related papers  (2020-03-14T01:48:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.