Random pattern and frequency generation using a photonic reservoir computer with output feedback

• URL: http://arxiv.org/abs/2012.10615v1
• Date: Sat, 19 Dec 2020 07:26:32 GMT
• Title: Random pattern and frequency generation using a photonic reservoir computer with output feedback
• Authors: Piotr Antonik, Michiel Hermans, Marc Haelterman, Serge Massar
• Abstract summary: Reservoir computing is a bio-inspired computing paradigm for processing time dependent signals. We demonstrate the first opto-electronic reservoir computer with output feedback and test it on two examples of time series generation tasks.
• Score: 3.0395687958102937
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reservoir computing is a bio-inspired computing paradigm for processing time dependent signals. The performance of its analogue implementations matches other digital algorithms on a series of benchmark tasks. Their potential can be further increased by feeding the output signal back into the reservoir, which would allow to apply the algorithm to time series generation. This requires, in principle, implementing a sufficiently fast readout layer for real-time output computation. Here we achieve this with a digital output layer driven by a FPGA chip. We demonstrate the first opto-electronic reservoir computer with output feedback and test it on two examples of time series generation tasks: frequency and random pattern generation. We obtain very good results on the first task, similar to idealised numerical simulations. The performance on the second one, however, suffers from the experimental noise. We illustrate this point with a detailed investigation of the consequences of noise on the performance of a physical reservoir computer with output feedback. Our work thus opens new possible applications for analogue reservoir computing and brings new insights on the impact of noise on the output feedback.

Related papers

• Multi-task Photonic Reservoir Computing: Wavelength Division Multiplexing for Parallel Computing with a Silicon Microring Resonator [0.0]
  We numerically show the use of time and wavelength division multiplexing (WDM) to solve four independent tasks at the same time in a single photonic chip. The footprint of the system is reduced by using time-division multiplexing of the nodes that act as the neurons of the studied neural network scheme.
  arXiv  Detail & Related papers  (2024-07-30T20:54:07Z)
• Resistive Memory-based Neural Differential Equation Solver for Score-based Diffusion Model [55.116403765330084]
  Current AIGC methods, such as score-based diffusion, are still deficient in terms of rapidity and efficiency. We propose a time-continuous and analog in-memory neural differential equation solver for score-based diffusion. We experimentally validate our solution with 180 nm resistive memory in-memory computing macros.
  arXiv  Detail & Related papers  (2024-04-08T16:34:35Z)
• Masked Audio Generation using a Single Non-Autoregressive Transformer [90.11646612273965]
  MAGNeT is a masked generative sequence modeling method that operates directly over several streams of audio tokens. We demonstrate the efficiency of MAGNeT for the task of text-to-music and text-to-audio generation. We shed light on the importance of each of the components comprising MAGNeT, together with pointing to the trade-offs between autoregressive and non-autoregressive modeling.
  arXiv  Detail & Related papers  (2024-01-09T14:29:39Z)
• Posterior Sampling with Delayed Feedback for Reinforcement Learning with Linear Function Approximation [62.969796245827006]
  Delayed-PSVI is an optimistic value-based algorithm that explores the value function space via noise perturbation with posterior sampling. We show our algorithm achieves $widetildeO(sqrtd3H3 T + d2H2 E[tau]$ worst-case regret in the presence of unknown delays. We incorporate a gradient-based approximate sampling scheme via Langevin dynamics for Delayed-LPSVI.
  arXiv  Detail & Related papers  (2023-10-29T06:12:43Z)
• Time-shift selection for reservoir computing using a rank-revealing QR algorithm [0.0]
  We present a technique to choose the time-shifts by maximizing the rank of the reservoir matrix using a rank-revealing QR algorithm. We find that our technique provides improved accuracy over random time-shift selection in essentially all cases.
  arXiv  Detail & Related papers  (2022-11-29T14:55:51Z)
• PARTIME: Scalable and Parallel Processing Over Time with Deep Neural Networks [68.96484488899901]
  We present PARTIME, a library designed to speed up neural networks whenever data is continuously streamed over time. PARTIME starts processing each data sample at the time in which it becomes available from the stream. Experiments are performed in order to empirically compare PARTIME with classic non-parallel neural computations in online learning.
  arXiv  Detail & Related papers  (2022-10-17T14:49:14Z)
• Win the Lottery Ticket via Fourier Analysis: Frequencies Guided Network Pruning [50.232218214751455]
  optimal network pruning is a non-trivial task which mathematically is an NP-hard problem. In this paper, we investigate the Magnitude-Based Pruning (MBP) scheme and analyze it from a novel perspective. We also propose a novel two-stage pruning approach, where one stage is to obtain the topological structure of the pruned network and the other stage is to retrain the pruned network to recover the capacity.
  arXiv  Detail & Related papers  (2022-01-30T03:42:36Z)
• Natural quantum reservoir computing for temporal information processing [4.785845498722406]
  Reservoir computing is a temporal information processing system that exploits artificial or physical dissipative dynamics. This paper proposes the use of real superconducting quantum computing devices as the reservoir, where the dissipative property is served by the natural noise added to the quantum bits.
  arXiv  Detail & Related papers  (2021-07-13T01:58:57Z)
• Online training for high-performance analogue readout layers in photonic reservoir computers [2.6104700758143666]
  Reservoir Computing is a bio-inspired computing paradigm for processing time-dependent signals. The major bottleneck of these implementation is the readout layer, based on slow offline post-processing. Here we propose the use of online training to solve these issues.
  arXiv  Detail & Related papers  (2020-12-19T07:12:26Z)
• Photonic reservoir computer based on frequency multiplexing [56.663315405998354]
  We report a photonic implementation of a reservoir computer that exploits frequency domain multiplexing to encode neuron states. The system processes 25 comb lines simultaneously (i.e. 25 neurons), at a rate of 20 MHz.
  arXiv  Detail & Related papers  (2020-08-25T19:30:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.