DAD vision: opto-electronic co-designed computer vision with division
adjoint method
- URL: http://arxiv.org/abs/2211.03576v1
- Date: Fri, 4 Nov 2022 07:31:44 GMT
- Title: DAD vision: opto-electronic co-designed computer vision with division
adjoint method
- Authors: Zihan Zang, Haoqiang Wang, Yunpeng Xu
- Abstract summary: We propose to use a ultra-thin diffractive optical element to implement passive optical convolution.
A division adjoint opto-electronic co-design method is also proposed.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: The miniaturization and mobility of computer vision systems are limited by
the heavy computational burden and the size of optical lenses. Here, we propose
to use a ultra-thin diffractive optical element to implement passive optical
convolution. A division adjoint opto-electronic co-design method is also
proposed. In our simulation experiments, the first few convolutional layers of
the neural network can be replaced by optical convolution in a classification
task on the CIFAR-10 dataset with no power consumption, while similar
performance can be obtained.
Related papers
- All-optical modulation with single-photons using electron avalanche [69.65384453064829]
We demonstrate all-optical modulation using a beam with single-photon intensity.
Our approach opens up the possibility of terahertz-speed optical switching at the single-photon level.
arXiv Detail & Related papers (2023-12-18T20:14:15Z) - High-performance real-world optical computing trained by in situ model-free optimization [2.2407602847819827]
We propose a gradient-based model-free optimization (G-MFO) method based on a Monte Carlo gradient estimation algorithm.
G-MFO treats an optical computing system as a black box and back-propagates the loss directly to the optical computing weights' probability distributions.
Our experiments on diffractive optical computing systems show that G-MFO outperforms hybrid training on the MNIST and FMNIST datasets.
arXiv Detail & Related papers (2023-07-22T01:56:58Z) - Windscreen Optical Quality for AI Algorithms: Refractive Power and MTF
not Sufficient [74.2843502619298]
Automotive mass production processes require measurement systems that characterize the optical quality of the windscreens in a meaningful way.
In this article we demonstrate that the main metric established in the industry - refractive power - is fundamentally not capable of capturing relevant optical properties of windscreens.
We propose a novel concept to determine the optical quality of windscreens and to use simulation to link this optical quality to the performance of AI algorithms.
arXiv Detail & Related papers (2023-05-23T20:41:04Z) - Characterization of multi-mode linear optical networks [0.0]
We formulate efficient procedures for the characterization of optical circuits in the presence of imperfections.
We show the viability of this approach in an experimentally relevant scenario, defined by a tunable integrated photonic circuit.
Our findings can find application in a wide range of optical setups, based both on bulk and integrated configurations.
arXiv Detail & Related papers (2023-04-13T13:09:14Z) - All-optical graph representation learning using integrated diffractive
photonic computing units [51.15389025760809]
Photonic neural networks perform brain-inspired computations using photons instead of electrons.
We propose an all-optical graph representation learning architecture, termed diffractive graph neural network (DGNN)
We demonstrate the use of DGNN extracted features for node and graph-level classification tasks with benchmark databases and achieve superior performance.
arXiv Detail & Related papers (2022-04-23T02:29:48Z) - Multi-Channel Convolutional Analysis Operator Learning for Dual-Energy
CT Reconstruction [108.06731611196291]
We develop a multi-channel convolutional analysis operator learning (MCAOL) method to exploit common spatial features within attenuation images at different energies.
We propose an optimization method which jointly reconstructs the attenuation images at low and high energies with a mixed norm regularization on the sparse features.
arXiv Detail & Related papers (2022-03-10T14:22:54Z) - Photonic Differential Privacy with Direct Feedback Alignment [66.61196212740359]
We show how to leverage the intrinsic noise of optical random projections to build a differentially private DFA mechanism.
We conduct experiments demonstrating the ability of our learning procedure to achieve solid end-task performance.
arXiv Detail & Related papers (2021-06-07T14:18:01Z) - Scalable Optical Learning Operator [0.2399911126932526]
The presented framework overcomes the energy scaling problem of existing systems without classifying speed.
We numerically and experimentally showed the ability of the method to execute several different tasks with accuracy comparable to a digital implementation.
Our results indicate that a powerful supercomputer would be required to duplicate the performance of the multimode fiber-based computer.
arXiv Detail & Related papers (2020-12-22T23:06:59Z) - Rapid characterisation of linear-optical networks via PhaseLift [51.03305009278831]
Integrated photonics offers great phase-stability and can rely on the large scale manufacturability provided by the semiconductor industry.
New devices, based on such optical circuits, hold the promise of faster and energy-efficient computations in machine learning applications.
We present a novel technique to reconstruct the transfer matrix of linear optical networks.
arXiv Detail & Related papers (2020-10-01T16:04:22Z) - Large-scale neuromorphic optoelectronic computing with a reconfigurable
diffractive processing unit [38.898230519968116]
We propose an optoelectronic reconfigurable computing paradigm by constructing a diffractive processing unit.
It can efficiently support different neural networks and achieve a high model complexity with millions of neurons.
Our prototype system built with off-the-shelf optoelectronic components surpasses the performance of state-of-the-art graphics processing units.
arXiv Detail & Related papers (2020-08-26T16:34:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.