Classification and reconstruction of spatially overlapping phase images using diffractive optical networks

• URL: http://arxiv.org/abs/2108.07977v1
• Date: Wed, 18 Aug 2021 05:15:05 GMT
• Title: Classification and reconstruction of spatially overlapping phase images using diffractive optical networks
• Authors: Deniz Mengu, Muhammed Veli, Yair Rivenson, Aydogan Ozcan
• Abstract summary: Diffractive optical networks unify wave optics and deep learning to all-optically compute a given machine learning or computational imaging task as the light propagates from the input to the output plane. We show that through a task-specific training process, diffractive networks can all-optically and simultaneously classify two different randomly-selected, spatially overlapping phase images at the input. In addition to all-optical classification of overlapping phase objects, we also demonstrate the reconstruction of these phase images based on a shallow electronic neural network.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Diffractive optical networks unify wave optics and deep learning to all-optically compute a given machine learning or computational imaging task as the light propagates from the input to the output plane. Here, we report the design of diffractive optical networks for the classification and reconstruction of spatially overlapping, phase-encoded objects. When two different phase-only objects spatially overlap, the individual object functions are perturbed since their phase patterns are summed up. The retrieval of the underlying phase images from solely the overlapping phase distribution presents a challenging problem, the solution of which is generally not unique. We show that through a task-specific training process, passive diffractive networks composed of successive transmissive layers can all-optically and simultaneously classify two different randomly-selected, spatially overlapping phase images at the input. After trained with ~550 million unique combinations of phase-encoded handwritten digits from the MNIST dataset, our blind testing results reveal that the diffractive network achieves an accuracy of >85.8% for all-optical classification of two overlapping phase images of new handwritten digits. In addition to all-optical classification of overlapping phase objects, we also demonstrate the reconstruction of these phase images based on a shallow electronic neural network that uses the highly compressed output of the diffractive network as its input (with e.g., ~20-65 times less number of pixels) to rapidly reconstruct both of the phase images, despite their spatial overlap and related phase ambiguity. The presented phase image classification and reconstruction framework might find applications in e.g., computational imaging, microscopy and quantitative phase imaging fields.

Related papers

• Spatial-frequency Dual-Domain Feature Fusion Network for Low-Light Remote Sensing Image Enhancement [49.15531684596958]
  We propose a Dual-Domain Feature Fusion Network (DFFN) for low-light remote sensing image enhancement. The first phase learns amplitude information to restore image brightness, and the second phase learns phase information to refine details. We have constructed two dark light remote sensing datasets to address the current lack of datasets in dark light remote sensing image enhancement.
  arXiv  Detail & Related papers  (2024-04-26T13:21:31Z)
• A Phase Transition in Diffusion Models Reveals the Hierarchical Nature of Data [55.748186000425996]
  Recent advancements show that diffusion models can generate high-quality images. We study this phenomenon in a hierarchical generative model of data. Our analysis characterises the relationship between time and scale in diffusion models.
  arXiv  Detail & Related papers  (2024-02-26T19:52:33Z)
• Image segmentation with traveling waves in an exactly solvable recurrent neural network [71.74150501418039]
  We show that a recurrent neural network can effectively divide an image into groups according to a scene's structural characteristics. We present a precise description of the mechanism underlying object segmentation in this network. We then demonstrate a simple algorithm for object segmentation that generalizes across inputs ranging from simple geometric objects in grayscale images to natural images.
  arXiv  Detail & Related papers  (2023-11-28T16:46:44Z)
• Time-lapse image classification using a diffractive neural network [0.0]
  We show for the first time a time-lapse image classification scheme using a diffractive network. We show a blind testing accuracy of 62.03% on the optical classification of objects from the CIFAR-10 dataset. This constitutes the highest inference accuracy achieved so far using a single diffractive network.
  arXiv  Detail & Related papers  (2022-08-23T08:16:30Z)
• All-optical image classification through unknown random diffusers using a single-pixel diffractive network [13.7472825798265]
  classification of an object behind a random and unknown scattering medium sets a challenging task for computational imaging and machine vision fields. Recent deep learning-based approaches demonstrated the classification of objects using diffuser-distorted patterns collected by an image sensor. Here, we present an all-optical processor to directly classify unknown objects through unknown, random phase diffusers using broadband illumination detected with a single pixel.
  arXiv  Detail & Related papers  (2022-08-08T08:26:08Z)
• Unfolding-Aided Bootstrapped Phase Retrieval in Optical Imaging [24.59954532409386]
  Phase retrieval in optical imaging refers to the recovery of a complex signal from phaseless data. The hybrid approach of model-driven network or deep unfolding has emerged as an effective alternative. This paper presents an overview of algorithms and applications of deep unfolding for bootstrapped - regardless of near, middle, and far zones.
  arXiv  Detail & Related papers  (2022-03-03T13:00:07Z)
• Deep Iterative Phase Retrieval for Ptychography [13.49645012479288]
  In order to reconstruct an object from its diffraction pattern, the inverse Fourier transform must be computed. In this work we consider ptychography, a sub-field of diffractive imaging, where objects are reconstructed from multiple overlapping diffraction images. We propose an augmentation of existing iterative phase retrieval algorithms with a neural network designed for refining the result of each iteration.
  arXiv  Detail & Related papers  (2022-02-17T09:13:35Z)
• Diffractive all-optical computing for quantitative phase imaging [0.0]
  We demonstrate a diffractive QPI network that can synthesize the quantitative phase image of an object. A diffractive QPI network is a specialized all-optical processor designed to perform a quantitative phase-to-intensity transformation.
  arXiv  Detail & Related papers  (2022-01-22T05:28:44Z)
• Learning optical flow from still images [53.295332513139925]
  We introduce a framework to generate accurate ground-truth optical flow annotations quickly and in large amounts from any readily available single real picture. We virtually move the camera in the reconstructed environment with known motion vectors and rotation angles. When trained with our data, state-of-the-art optical flow networks achieve superior generalization to unseen real data.
  arXiv  Detail & Related papers  (2021-04-08T17:59:58Z)
• Leveraging Spatial and Photometric Context for Calibrated Non-Lambertian Photometric Stereo [61.6260594326246]
  We introduce an efficient fully-convolutional architecture that can leverage both spatial and photometric context simultaneously. Using separable 4D convolutions and 2D heat-maps reduces the size and makes more efficient.
  arXiv  Detail & Related papers  (2021-03-22T18:06:58Z)
• Identity Enhanced Residual Image Denoising [61.75610647978973]
  We learn a fully-convolutional network model that consists of a Chain of Identity Mapping Modules and residual on the residual architecture for image denoising. The proposed network produces remarkably higher numerical accuracy and better visual image quality than the classical state-of-the-art and CNN algorithms.
  arXiv  Detail & Related papers  (2020-04-26T04:52:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.