Efficient data transport over multimode light-pipes with Megapixel
images using differentiable ray tracing and Machine-learning
- URL: http://arxiv.org/abs/2301.06496v3
- Date: Thu, 24 Aug 2023 16:39:42 GMT
- Title: Efficient data transport over multimode light-pipes with Megapixel
images using differentiable ray tracing and Machine-learning
- Authors: Joowon Lim, Jannes Gladrow, Douglas Kelly, Greg O'Shea, Govert Verkes,
Ioan Stefanovici, Sebastian Nowozin, and Benn Thomsen
- Abstract summary: We demonstrate machine-learning-based decoding of large-scale digital images (pages)
We use a millimeter-sized square cross-section waveguide to image an 8-bit spatial light modulator, presenting data as a matrix of symbols.
By combining a digital twin of the setup with a U-Net, we can retrieve up to 66 kB using efficient convolutional operations only.
- Score: 6.677278996379261
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Retrieving images transmitted through multi-mode fibers is of growing
interest, thanks to their ability to confine and transport light efficiently in
a compact system. Here, we demonstrate machine-learning-based decoding of
large-scale digital images (pages), maximizing page capacity for optical
storage applications. Using a millimeter-sized square cross-section waveguide,
we image an 8-bit spatial light modulator, presenting data as a matrix of
symbols. Normally, decoders will incur a prohibitive O(n^2) computational
scaling to decode n symbols in spatially scrambled data. However, by combining
a digital twin of the setup with a U-Net, we can retrieve up to 66 kB using
efficient convolutional operations only. We compare trainable ray-tracing-based
with eigenmode-based twins and show the former to be superior thanks to its
ability to overcome the simulation-to-experiment gap by adjusting to optical
imperfections. We train the pipeline end-to-end using a differentiable
mutual-information estimator based on the von-Mises distribution, generally
applicable to phase-coding channels.
Related papers
- Deterministic generation of frequency-bin-encoded microwave photons [2.696404891373769]
We experimentally demonstrate a frequency-bin encoding method of microwave photonic modes using superconducting circuits.
We deterministically encode the quantum information from a superconducting qubit by simultaneously emitting its information into two photonic modes at different frequencies.
The frequency-bin-encoded photonic modes can be used, at the receiver processor, to detect the occurrence of photon loss.
arXiv Detail & Related papers (2024-10-30T16:53:01Z) - Scaling on-chip photonic neural processors using arbitrarily
programmable wave propagation [4.026285531740364]
On-chip photonic processors for neural networks have potential benefits in both speed and energy efficiency but have not yet reached the scale at which they can outperform electronic processors.
We present a device whose refractive index as a function of space, $n(x,z)$, can be rapidly reprogrammed, allowing arbitrary control over the wave propagation in the device.
This is a scale beyond that of previous photonic chips relying on discrete components, illustrating the benefit of the continuous-waves paradigm.
arXiv Detail & Related papers (2024-02-27T18:37:22Z) - Reversible ternary logic with Laguerre-Gaussian modes [0.0]
We propose an optical communication solution that could serve as a building block for future computing systems.
The solution arises from Landauer principle and utilizes reversible logic, manifested as an optical logical gate with structured light, here represented as Laguerre-Gaussian modes.
arXiv Detail & Related papers (2024-01-07T15:47:17Z) - Shaping Single Photons through Multimode Optical Fibers using Mechanical
Perturbations [55.41644538483948]
We show an all-fiber approach for controlling the shape of single photons and the spatial correlations between entangled photon pairs.
We optimize these perturbations to localize the spatial distribution of a single photon or the spatial correlations of photon pairs in a single spot.
arXiv Detail & Related papers (2023-06-04T07:33:39Z) - Multi-scale Transformer Network with Edge-aware Pre-training for
Cross-Modality MR Image Synthesis [52.41439725865149]
Cross-modality magnetic resonance (MR) image synthesis can be used to generate missing modalities from given ones.
Existing (supervised learning) methods often require a large number of paired multi-modal data to train an effective synthesis model.
We propose a Multi-scale Transformer Network (MT-Net) with edge-aware pre-training for cross-modality MR image synthesis.
arXiv Detail & Related papers (2022-12-02T11:40:40Z) - {\mu}Split: efficient image decomposition for microscopy data [50.794670705085835]
muSplit is a dedicated approach for trained image decomposition in the context of fluorescence microscopy images.
We introduce lateral contextualization (LC), a novel meta-architecture that enables the memory efficient incorporation of large image-context.
We apply muSplit to five decomposition tasks, one on a synthetic dataset, four others derived from real microscopy data.
arXiv Detail & Related papers (2022-11-23T11:26:24Z) - Nonorthogonal coding in spectrally-entangled photons [0.0]
A fiber-based long-distance quantum communication can be feasible owing to its low transmission loss.
With multiplexed photon pairs, we propose to implement a nonorthogonal coding scheme in their spectral modes.
arXiv Detail & Related papers (2022-11-21T15:04:43Z) - Simultaneously sorting overlapping quantum states of light [2.645971554595842]
We realise simultaneous and efficient sorting of non-orthogonal, overlapping states of light encoded in the transverse spatial degree of freedom.
Our results lay the groundwork for optimal image identification and classification via optical networks, with potential applications ranging from self-driving cars to quantum communication systems.
arXiv Detail & Related papers (2022-07-08T16:14:28Z) - Adaptive Machine Learning for Time-Varying Systems: Low Dimensional
Latent Space Tuning [91.3755431537592]
We present a recently developed method of adaptive machine learning for time-varying systems.
Our approach is to map very high (N>100k) dimensional inputs into the low dimensional (N2) latent space at the output of the encoder section of an encoder-decoder CNN.
This method allows us to learn correlations within and to track their evolution in real time based on feedback without interrupts.
arXiv Detail & Related papers (2021-07-13T16:05:28Z) - Interleaving: Modular architectures for fault-tolerant photonic quantum
computing [50.591267188664666]
Photonic fusion-based quantum computing (FBQC) uses low-loss photonic delays.
We present a modular architecture for FBQC in which these components are combined to form "interleaving modules"
Exploiting the multiplicative power of delays, each module can add thousands of physical qubits to the computational Hilbert space.
arXiv Detail & Related papers (2021-03-15T18:00:06Z) - Rapid characterisation of linear-optical networks via PhaseLift [51.03305009278831]
Integrated photonics offers great phase-stability and can rely on the large scale manufacturability provided by the semiconductor industry.
New devices, based on such optical circuits, hold the promise of faster and energy-efficient computations in machine learning applications.
We present a novel technique to reconstruct the transfer matrix of linear optical networks.
arXiv Detail & Related papers (2020-10-01T16:04:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.