Efficient data transport over multimode light-pipes with Megapixel images using differentiable ray tracing and Machine-learning

• URL: http://arxiv.org/abs/2301.06496v3
• Date: Thu, 24 Aug 2023 16:39:42 GMT
• Title: Efficient data transport over multimode light-pipes with Megapixel images using differentiable ray tracing and Machine-learning
• Authors: Joowon Lim, Jannes Gladrow, Douglas Kelly, Greg O'Shea, Govert Verkes, Ioan Stefanovici, Sebastian Nowozin, and Benn Thomsen
• Abstract summary: We demonstrate machine-learning-based decoding of large-scale digital images (pages) We use a millimeter-sized square cross-section waveguide to image an 8-bit spatial light modulator, presenting data as a matrix of symbols. By combining a digital twin of the setup with a U-Net, we can retrieve up to 66 kB using efficient convolutional operations only.
• Score: 6.677278996379261
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Retrieving images transmitted through multi-mode fibers is of growing interest, thanks to their ability to confine and transport light efficiently in a compact system. Here, we demonstrate machine-learning-based decoding of large-scale digital images (pages), maximizing page capacity for optical storage applications. Using a millimeter-sized square cross-section waveguide, we image an 8-bit spatial light modulator, presenting data as a matrix of symbols. Normally, decoders will incur a prohibitive O(n^2) computational scaling to decode n symbols in spatially scrambled data. However, by combining a digital twin of the setup with a U-Net, we can retrieve up to 66 kB using efficient convolutional operations only. We compare trainable ray-tracing-based with eigenmode-based twins and show the former to be superior thanks to its ability to overcome the simulation-to-experiment gap by adjusting to optical imperfections. We train the pipeline end-to-end using a differentiable mutual-information estimator based on the von-Mises distribution, generally applicable to phase-coding channels.

Related papers

• Scaling on-chip photonic neural processors using arbitrarily programmable wave propagation [4.026285531740364]
  On-chip photonic processors for neural networks have potential benefits in both speed and energy efficiency but have not yet reached the scale at which they can outperform electronic processors. We present a device whose refractive index as a function of space, $n(x,z)$, can be rapidly reprogrammed, allowing arbitrary control over the wave propagation in the device. This is a scale beyond that of previous photonic chips relying on discrete components, illustrating the benefit of the continuous-waves paradigm.
  arXiv  Detail & Related papers  (2024-02-27T18:37:22Z)
• Reversible ternary logic with Laguerre-Gaussian modes [0.0]
  We propose an optical communication solution that could serve as a building block for future computing systems. The solution arises from Landauer principle and utilizes reversible logic, manifested as an optical logical gate with structured light, here represented as Laguerre-Gaussian modes.
  arXiv  Detail & Related papers  (2024-01-07T15:47:17Z)
• Filtering Pixel Latent Variables for Unmixing Noisy and Undersampled Volumetric Images [6.2916043414599]
  In experimental physics, enhancing the acquisition resolution or expanding the number of detection channels often leads to diminished sampling rate and signal-to-noise ratio. We propose applying band-pass filters to the latent space of a multi-dimensional convolutional neural network to disentangle overlapping signal components. Using multi-dimensional convolution kernels to process all dimensions simultaneously enhances the network's ability to extract information from adjacent pixels, time- or spectral-bins.
  arXiv  Detail & Related papers  (2023-12-08T20:34:37Z)
• Shaping Single Photons through Multimode Optical Fibers using Mechanical Perturbations [55.41644538483948]
  We show an all-fiber approach for controlling the shape of single photons and the spatial correlations between entangled photon pairs. We optimize these perturbations to localize the spatial distribution of a single photon or the spatial correlations of photon pairs in a single spot.
  arXiv  Detail & Related papers  (2023-06-04T07:33:39Z)
• Multi-scale Transformer Network with Edge-aware Pre-training for Cross-Modality MR Image Synthesis [52.41439725865149]
  Cross-modality magnetic resonance (MR) image synthesis can be used to generate missing modalities from given ones. Existing (supervised learning) methods often require a large number of paired multi-modal data to train an effective synthesis model. We propose a Multi-scale Transformer Network (MT-Net) with edge-aware pre-training for cross-modality MR image synthesis.
  arXiv  Detail & Related papers  (2022-12-02T11:40:40Z)
• {\mu}Split: efficient image decomposition for microscopy data [50.794670705085835]
  muSplit is a dedicated approach for trained image decomposition in the context of fluorescence microscopy images. We introduce lateral contextualization (LC), a novel meta-architecture that enables the memory efficient incorporation of large image-context. We apply muSplit to five decomposition tasks, one on a synthetic dataset, four others derived from real microscopy data.
  arXiv  Detail & Related papers  (2022-11-23T11:26:24Z)
• Nonorthogonal coding in spectrally-entangled photons [0.0]
  A fiber-based long-distance quantum communication can be feasible owing to its low transmission loss. With multiplexed photon pairs, we propose to implement a nonorthogonal coding scheme in their spectral modes.
  arXiv  Detail & Related papers  (2022-11-21T15:04:43Z)
• Simultaneously sorting overlapping quantum states of light [2.645971554595842]
  We realise simultaneous and efficient sorting of non-orthogonal, overlapping states of light encoded in the transverse spatial degree of freedom. Our results lay the groundwork for optimal image identification and classification via optical networks, with potential applications ranging from self-driving cars to quantum communication systems.
  arXiv  Detail & Related papers  (2022-07-08T16:14:28Z)
• Adaptive Machine Learning for Time-Varying Systems: Low Dimensional Latent Space Tuning [91.3755431537592]
  We present a recently developed method of adaptive machine learning for time-varying systems. Our approach is to map very high (N>100k) dimensional inputs into the low dimensional (N2) latent space at the output of the encoder section of an encoder-decoder CNN. This method allows us to learn correlations within and to track their evolution in real time based on feedback without interrupts.
  arXiv  Detail & Related papers  (2021-07-13T16:05:28Z)
• Interleaving: Modular architectures for fault-tolerant photonic quantum computing [50.591267188664666]
  Photonic fusion-based quantum computing (FBQC) uses low-loss photonic delays. We present a modular architecture for FBQC in which these components are combined to form "interleaving modules" Exploiting the multiplicative power of delays, each module can add thousands of physical qubits to the computational Hilbert space.
  arXiv  Detail & Related papers  (2021-03-15T18:00:06Z)
• Rapid characterisation of linear-optical networks via PhaseLift [51.03305009278831]
  Integrated photonics offers great phase-stability and can rely on the large scale manufacturability provided by the semiconductor industry. New devices, based on such optical circuits, hold the promise of faster and energy-efficient computations in machine learning applications. We present a novel technique to reconstruct the transfer matrix of linear optical networks.
  arXiv  Detail & Related papers  (2020-10-01T16:04:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.