Machine vision with small numbers of detected photons per inference

• URL: http://arxiv.org/abs/2603.23974v1
• Date: Wed, 25 Mar 2026 06:14:47 GMT
• Title: Machine vision with small numbers of detected photons per inference
• Abstract summary: Photon-aware neuromorphic sensing (PANS) is an approach for end-to-end optimization in highly photon-starved scenarios.<n>We report a proof-of-principle experimental demonstration in which we performed low-light image classification using PANS.<n>We also report simulation studies showing how PANS could be applied to other classification, event-detection, and image-reconstruction tasks.
• Score: 6.113660794276782
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Machine vision, including object recognition and image reconstruction, is a central technology in many consumer devices and scientific instruments. The design of machine-vision systems has been revolutionized by the adoption of end-to-end optimization, in which the optical front end and the post-processing back end are jointly optimized. However, while machine vision currently works extremely well in moderate-light or bright-light situations -- where a camera may detect thousands of photons per pixel and billions of photons per frame -- it is far more challenging in very low-light situations. We introduce photon-aware neuromorphic sensing (PANS), an approach for end-to-end optimization in highly photon-starved scenarios. The training incorporates knowledge of the low photon budget and the stochastic nature of light detection when the average number of photons per pixel is near or less than 1. We report a proof-of-principle experimental demonstration in which we performed low-light image classification using PANS, achieving 73% (82%) accuracy on FashionMNIST with an average of only 4.9 (17) detected photons in total per inference, and 86% (97%) on MNIST with 8.6 (29) detected photons -- orders of magnitude more photon-efficient than conventional approaches. We also report simulation studies showing how PANS could be applied to other classification, event-detection, and image-reconstruction tasks. By taking into account the statistics of measurement results for non-classical states or alternative sensing hardware, PANS could in principle be adapted to enable high-accuracy results in quantum and other photon-starved setups.

Related papers

• Quantum Optical Neuron for Image Classification via Multiphoton Interference [0.0]
  We experimentally demonstrate a camera-free quantum-optical images that performs inference directly at the measurement layer.<n>We realize both a single-perceptron quantum optical neuron and a two-neuron shallow network, achieving high accuracy on benchmark datasets.<n>This approach paves the way toward neuromorphic quantum photonic processors capable of extracting task-relevant information.
  arXiv  Detail & Related papers  (2026-03-30T18:01:45Z)
• Linear Optics to Scalable Photonic Quantum Computing [2.765106384328772]
  Recent advancements in quantum photonics have driven significant progress in photonic quantum computing (PQC)<n>These advances bridge the gap between theoretical potential and practical implementation, positioning PQC as a transformative technology for computing, communication, and quantum sensing.
  arXiv  Detail & Related papers  (2025-01-05T11:59:58Z)
• Spatially resolved photon statistics of general nanophotonic systems [0.0]
  We present a novel method that provides access to photon statistics resolved in space and frequency in arbitrary electromagnetic environments.<n>Within the macroscopic QED framework, we develop a practical tool to compute electric field correlations for complex quantum systems.<n>We demonstrate the effectiveness and robustness of the proposed technique by studying the photon correlations of one and two emitters in close proximity to a plasmonic nanoparticles.
  arXiv  Detail & Related papers  (2024-11-29T15:31:36Z)
• All-optical modulation with single-photons using electron avalanche [66.27103948750306]
  We demonstrate all-optical modulation enabled by electron avalanche process in silicon.<n>Our approach opens the possibility of gigahertz-speed, and potentially even faster, optical switching at the single-photon level.
  arXiv  Detail & Related papers  (2023-12-18T20:14:15Z)
• Design and simulation of a transmon qubit chip for Axion detection [103.69390312201169]
  Device based on superconducting qubits has been successfully applied in detecting few-GHz single photons via Quantum Non-Demolition measurement (QND) In this study, we present Qub-IT's status towards the realization of its first superconducting qubit device.
  arXiv  Detail & Related papers  (2023-10-08T17:11:42Z)
• Classification robustness to common optical aberrations [64.08840063305313]
  This paper proposes OpticsBench, a benchmark for investigating robustness to realistic, practically relevant optical blur effects. Experiments on ImageNet show that for a variety of different pre-trained DNNs, the performance varies strongly compared to disk-shaped kernels. We show on ImageNet-100 with OpticsAugment that can be increased by using optical kernels as data augmentation.
  arXiv  Detail & Related papers  (2023-08-29T08:36:00Z)
• Efficient Characterizations of Multiphoton States with an Ultra-thin Optical Device [8.471516713037156]
  We show that a single metasurface optical device would allow more efficient characterizations of multiphoton entangled states. We observe notable advantages in the reconstruction of multiphoton entanglement, including using fewer measurements, having higher accuracy, and being robust against experimental imperfections. Our work unveils the feasibility of metasurface as a favorable integrated optical device for efficient characterization of multiphoton entanglement, and sheds light on scalable photonic quantum technologies with ultra-thin optical devices.
  arXiv  Detail & Related papers  (2023-08-14T11:03:26Z)
• Photon discerner: Adaptive quantum optical sensing near the shot noise limit [0.0]
  We propose a novel detection approach, that we call photon discerning', for photon statistical estimation. Our photon discerner is motivated by the field of neural networks where tunable thresholds have proven efficient for isolating optimal decision boundaries. Our work suggests a new class of detectors for information-theory driven, compact, and learning-based quantum optical sensing.
  arXiv  Detail & Related papers  (2023-07-27T18:35:02Z)
• High-dimensional quantum correlation measurements with an adaptively gated hybrid single-photon camera [58.720142291102135]
  We propose an adaptively-gated hybrid intensified camera (HIC) that combines a high spatial resolution sensor and a high temporal resolution detector. With a spatial resolution of nearly 9 megapixels and nanosecond temporal resolution, this system allows for the realization of previously infeasible quantum optics experiments.
  arXiv  Detail & Related papers  (2023-05-25T16:59:27Z)
• On-chip quantum information processing with distinguishable photons [55.41644538483948]
  Multi-photon interference is at the heart of photonic quantum technologies. Here, we experimentally demonstrate that detection can be implemented with a temporal resolution sufficient to interfere photons detuned on the scales necessary for cavity-based integrated photon sources. We show how time-resolved detection of non-ideal photons can be used to improve the fidelity of an entangling operation and to mitigate the reduction of computational complexity in boson sampling experiments.
  arXiv  Detail & Related papers  (2022-10-14T18:16:49Z)
• Conditional preparation of non-Gaussian quantum optical states by mesoscopic measurement [62.997667081978825]
  Non-Gaussian states of an optical field are important as a proposed resource in quantum information applications. We propose a novel approach involving displacement of the ancilla field into the regime where mesoscopic detectors can be used. We conclude that states with strong Wigner negativity can be prepared at high rates by this technique under experimentally attainable conditions.
  arXiv  Detail & Related papers  (2021-03-29T16:59:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.