Deep Binarized Photonic Reservoir Computing for Ultrafast Multimedia Signal Processing

• URL: http://arxiv.org/abs/2605.30149v1
• Date: Thu, 28 May 2026 16:09:40 GMT
• Title: Deep Binarized Photonic Reservoir Computing for Ultrafast Multimedia Signal Processing
• Abstract summary: We present a deep photonic neural network architecture based on ultrafast binary optical modulation from a digital micro-mirror device (DMD)<n>We show that our system achieves state-of-the-art performance across various multimedia tasks, including video, image and speech recognition.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a deep photonic neural network architecture based on ultrafast binary optical modulation from a digital micro-mirror device (DMD), optical scattering in random medium, high-speed photodetection with a CMOS sensor, and time-multiplexed deep layer structure. Operating at Gigabit-per-second (Gb/s) processing rates, our system based on the reservoir computing (RC) framework achieves state-of-the-art performance across various multimedia tasks, including video, image and speech recognition. We show that the careful optimization of key physical intra- and inter-layer hyper-parameters can significantly enhance the deep photonic RC system ability to extract relevant temporal and spatial features via balancing memory retention and dynamical response of individual layers. This approach paves the way for highly scalable hierarchical photonic reservoir computing systems for high-throughput real-time multimedia signal processing.

Related papers

• High-Speed Full-Color HDR Imaging via Unwrapping Modulo-Encoded Spike Streams [83.83721273785281]
  We present a complete modulo-based HDR imaging system that enables high-speed, full-color HDR acquisition.<n>At the core of our approach is an exposure-decoupled formulation of modulo imaging that allows multiple measurements to be interleaved in time.<n>To validate the practical viability of our system, we demonstrate a proof-of-concept hardware implementation based on modulo-encoded spike streams.
  arXiv  Detail & Related papers  (2026-04-16T05:20:38Z)
• Compressive single-pixel imaging via a wavelength-multiplexed spatially incoherent diffractive optical processor [9.166592217185306]
  We propose a wavelength-multiplexed, spatially incoherent diffractive optical processor combined with a compact/shallow digital artificial neural network (ANN) to implement compressive SPI.<n>A single-pixel detector captures the output spectral power at each illumination band, which is then rapidly decoded by the jointly trained digital ANN to reconstruct the input image.<n>This work demonstrates a computational imaging framework for compressive SPI that can be useful in applications such as biomedical imaging, autonomous devices, and remote sensing.
  arXiv  Detail & Related papers  (2026-03-23T00:30:28Z)
• A 10 Megahertz Spatial Light Modulator [4.469758751844986]
  We introduce a new class of spatial light modulator that provides both 2D pixel geometry and high speed.<n>The device operates by encoding spatial information in frequency bins via a broadband optical phase modulator, and decoding them via a high-resolution 2D spectrometer.<n>We demonstrate site-resolved optical pulsing with a 44(1)ns rise time, corresponding to frame rates exceeding 10 million frames per second.
  arXiv  Detail & Related papers  (2026-01-13T19:00:00Z)
• S2ML: Spatio-Spectral Mutual Learning for Depth Completion [56.26679539288063]
  Raw depth images captured by RGB-D cameras often suffer from incomplete depth values due to weak reflections, boundary shadows, and artifacts.<n>Existing methods address this problem through depth completion in the image domain, but they overlook the physical characteristics of raw depth images.<n>We propose a Spatio-Spectral Mutual Learning framework (S2ML) to harmonize the advantages of both spatial and frequency domains for depth completion.
  arXiv  Detail & Related papers  (2025-11-08T15:01:55Z)
• A Plug-and-Play Framework for Volumetric Light-Sheet Image Reconstruction [7.8016751308289685]
  Traditional optical imaging is inadequate for capturing dynamic cellular structure in the beating heart.<n>We propose a high-performance imaging framework that integrates Compress Sensing with Light-Sheet Microscopy.<n>The proposed method successfully reconstructs cellular structures with excellent denoising performance and image clarity.
  arXiv  Detail & Related papers  (2025-11-05T00:49:00Z)
• Streamlined optical training of large-scale modern deep learning architectures with direct feedback alignment [48.90869997343841]
  We experimentally implement a versatile and scalable training algorithm, called direct feedback alignment, on a hybrid electronic-photonic platform.<n>An optical processing unit performs large-scale random matrix multiplications, at speeds up to 1500 TeraOPS under 30 Watts of power.<n>We study the scaling of the training time, and demonstrate a potential advantage of our hybrid opto-electronic approach for ultra-deep and wide neural networks.
  arXiv  Detail & Related papers  (2024-09-01T12:48:47Z)
• Ultrafast single-channel machine vision based on neuro-inspired photonic computing [0.0]
  Neuro-inspired photonic computing is a promising approach to speed-up machine vision processing with ultralow latency. Here, we propose an image-sensor-free machine vision framework, which optically processes real-world visual information with only a single input channel. We experimentally demonstrate that the proposed approach is capable of high-speed image recognition and anomaly detection, and furthermore, it can be used for high-speed imaging.
  arXiv  Detail & Related papers  (2023-02-15T10:08:04Z)
• Scattering-induced entropy boost for highly-compressed optical sensing and encryption [7.502671257653539]
  Image sensing often relies on a high-quality machine vision system with a large field of view and high resolution. We propose a novel image-free sensing framework for resource-efficient image classification. The proposed framework is shown to obtain over a 95% accuracy at sampling rates of 1% and 5% for classification on the MNIST dataset.
  arXiv  Detail & Related papers  (2022-12-16T09:00:42Z)
• TMM-Fast: A Transfer Matrix Computation Package for Multilayer Thin-Film Optimization [62.997667081978825]
  An advanced thin-film structure can consist of multiple materials with different thicknesses and numerous layers. Design and optimization of complex thin-film structures with multiple variables is a computationally heavy problem that is still under active research. We propose the Python package TMM-Fast which enables parallelized computation of reflection and transmission of light at different angles of incidence and wavelengths through the multilayer thin-film.
  arXiv  Detail & Related papers  (2021-11-24T14:47:37Z)
• Deep Learning for Ultrasound Beamforming [120.12255978513912]
  Beamforming, the process of mapping received ultrasound echoes to the spatial image domain, lies at the heart of the ultrasound image formation chain. Modern ultrasound imaging leans heavily on innovations in powerful digital receive channel processing. Deep learning methods can play a compelling role in the digital beamforming pipeline.
  arXiv  Detail & Related papers  (2021-09-23T15:15:21Z)
• 10-mega pixel snapshot compressive imaging with a hybrid coded aperture [48.95666098332693]
  High resolution images are widely used in our daily life, whereas high-speed video capture is challenging due to the low frame rate of cameras working at the high resolution mode. snapshot imaging (SCI) was proposed as a solution to the low throughput of existing imaging systems.
  arXiv  Detail & Related papers  (2021-06-30T01:09:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.