DAD vision: opto-electronic co-designed computer vision with division adjoint method

• URL: http://arxiv.org/abs/2211.03576v1
• Date: Fri, 4 Nov 2022 07:31:44 GMT
• Title: DAD vision: opto-electronic co-designed computer vision with division adjoint method
• Authors: Zihan Zang, Haoqiang Wang, Yunpeng Xu
• Abstract summary: We propose to use a ultra-thin diffractive optical element to implement passive optical convolution. A division adjoint opto-electronic co-design method is also proposed.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The miniaturization and mobility of computer vision systems are limited by the heavy computational burden and the size of optical lenses. Here, we propose to use a ultra-thin diffractive optical element to implement passive optical convolution. A division adjoint opto-electronic co-design method is also proposed. In our simulation experiments, the first few convolutional layers of the neural network can be replaced by optical convolution in a classification task on the CIFAR-10 dataset with no power consumption, while similar performance can be obtained.

Related papers

• Computational metaoptics for imaging [3.105460926371459]
  "Computational metaoptics" combines the physical wavefront shaping ability of metasurfaces with advanced computational algorithms to enhance imaging performance beyond conventional limits. By treating metasurfaces as physical preconditioners and co-designing them with reconstruction algorithms through end-to-end (inverse) design, it is possible to jointly optimize the optical hardware and computational software. Advanced applications enabled by computational metaoptics are highlighted, including phase imaging and quantum state measurement.
  arXiv  Detail & Related papers  (2024-11-14T02:13:25Z)
• Transferable polychromatic optical encoder for neural networks [13.311727599288524]
  In this paper, we demonstrate an optical encoder that can perform convolution simultaneously in three color channels during the image capture. Such an optical encoding results in 24,000 times reduction in computational operations, with a state-of-the art classification accuracy (73.2%) in free-space optical system.
  arXiv  Detail & Related papers  (2024-11-05T00:49:47Z)
• Generalizable Non-Line-of-Sight Imaging with Learnable Physical Priors [52.195637608631955]
  Non-line-of-sight (NLOS) imaging has attracted increasing attention due to its potential applications. Existing NLOS reconstruction approaches are constrained by the reliance on empirical physical priors. We introduce a novel learning-based solution, comprising two key designs: Learnable Path Compensation (LPC) and Adaptive Phasor Field (APF)
  arXiv  Detail & Related papers  (2024-09-21T04:39:45Z)
• Optical training of large-scale Transformers and deep neural networks with direct feedback alignment [48.90869997343841]
  We experimentally implement a versatile and scalable training algorithm, called direct feedback alignment, on a hybrid electronic-photonic platform. An optical processing unit performs large-scale random matrix multiplications, which is the central operation of this algorithm, at speeds up to 1500 TeraOps. We study the compute scaling of our hybrid optical approach, and demonstrate a potential advantage for ultra-deep and wide neural networks.
  arXiv  Detail & Related papers  (2024-09-01T12:48:47Z)
• All-optical modulation with single-photons using electron avalanche [69.65384453064829]
  We demonstrate all-optical modulation using a beam with single-photon intensity. Our approach opens up the possibility of terahertz-speed optical switching at the single-photon level.
  arXiv  Detail & Related papers  (2023-12-18T20:14:15Z)
• High-performance real-world optical computing trained by in situ gradient-based model-free optimization [2.2407602847819827]
  We propose a gradient-based model-free optimization (G-MFO) method based on a Monte Carlo gradient estimation algorithm. G-MFO treats an optical computing system as a black box and back-propagates the loss directly to the optical computing weights' probability distributions. Our experiments on diffractive optical computing systems show that G-MFO outperforms hybrid training on the MNIST and FMNIST datasets.
  arXiv  Detail & Related papers  (2023-07-22T01:56:58Z)
• Characterization of multi-mode linear optical networks [0.0]
  We formulate efficient procedures for the characterization of optical circuits in the presence of imperfections. We show the viability of this approach in an experimentally relevant scenario, defined by a tunable integrated photonic circuit. Our findings can find application in a wide range of optical setups, based both on bulk and integrated configurations.
  arXiv  Detail & Related papers  (2023-04-13T13:09:14Z)
• All-optical graph representation learning using integrated diffractive photonic computing units [51.15389025760809]
  Photonic neural networks perform brain-inspired computations using photons instead of electrons. We propose an all-optical graph representation learning architecture, termed diffractive graph neural network (DGNN) We demonstrate the use of DGNN extracted features for node and graph-level classification tasks with benchmark databases and achieve superior performance.
  arXiv  Detail & Related papers  (2022-04-23T02:29:48Z)
• Photonic Differential Privacy with Direct Feedback Alignment [66.61196212740359]
  We show how to leverage the intrinsic noise of optical random projections to build a differentially private DFA mechanism. We conduct experiments demonstrating the ability of our learning procedure to achieve solid end-task performance.
  arXiv  Detail & Related papers  (2021-06-07T14:18:01Z)
• Rapid characterisation of linear-optical networks via PhaseLift [51.03305009278831]
  Integrated photonics offers great phase-stability and can rely on the large scale manufacturability provided by the semiconductor industry. New devices, based on such optical circuits, hold the promise of faster and energy-efficient computations in machine learning applications. We present a novel technique to reconstruct the transfer matrix of linear optical networks.
  arXiv  Detail & Related papers  (2020-10-01T16:04:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.