Reservoir Computing Generalized

• URL: http://arxiv.org/abs/2412.12104v1
• Date: Sat, 23 Nov 2024 05:02:47 GMT
• Title: Reservoir Computing Generalized
• Authors: Tomoyuki Kubota, Yusuke Imai, Sumito Tsunegi, Kohei Nakajima,
• Abstract summary: A physical neural network (PNN) has the strong potential to solve machine learning tasks and physical properties, such as high-speed computation and energy efficiency.<n> Reservoir computing (RC) is an excellent framework for implementing an information processing system with a dynamical system.<n>We propose a novel framework called reservoir computing (GRC) by turning this requirement on its head, making conventional RC a special case.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: A physical neural network (PNN) has both the strong potential to solve machine learning tasks and intrinsic physical properties, such as high-speed computation and energy efficiency. Reservoir computing (RC) is an excellent framework for implementing an information processing system with a dynamical system by attaching a trained readout, thus accelerating the wide use of unconventional materials for a PNN. However, RC requires the dynamics to reproducibly respond to input sequence, which limits the type of substance available for building information processors. Here we propose a novel framework called generalized reservoir computing (GRC) by turning this requirement on its head, making conventional RC a special case. Using substances that do not respond the same to identical inputs (e.g., a real spin-torque oscillator), we propose mechanisms aimed at obtaining a reliable output and show that processed inputs in the unconventional substance are retrievable. Finally, we demonstrate that, based on our framework, spatiotemporal chaos, which is thought to be unusable as a computational resource, can be used to emulate complex nonlinear dynamics, including large scale spatiotemporal chaos. Overall, our framework removes the limitation to building an information processing device and opens a path to constructing a computational system using a wider variety of physical dynamics.

Related papers

• Dynamics and Computational Principles of Echo State Networks: A Mathematical Perspective [13.135043580306224]
  Reservoir computing (RC) represents a class of state-space models (SSMs) characterized by a fixed state transition mechanism (the reservoir) and a flexible readout layer that maps from the state space. This work presents a systematic exploration of RC, addressing its foundational properties such as the echo state property, fading memory, and reservoir capacity through the lens of dynamical systems theory. We formalize the interplay between input signals and reservoir states, demonstrating the conditions under which reservoirs exhibit stability and expressive power.
  arXiv  Detail & Related papers  (2025-04-16T04:28:05Z)
• Reservoir Computing with a Single Oscillating Gas Bubble: Emphasizing the Chaotic Regime [0.0]
  We propose and theoretically validate a reservoir computing system based on a single bubble trapped within a bulk of liquid. By applying an external acoustic pressure wave to both encode input information and excite the complex nonlinear dynamics, we showcase the ability of this single-bubble reservoir computing system to forecast complex benchmarking time series.
  arXiv  Detail & Related papers  (2025-03-25T23:32:09Z)
• Hardware-Friendly Implementation of Physical Reservoir Computing with CMOS-based Time-domain Analog Spiking Neurons [0.26963330643873434]
  This paper introduces a spiking neural network (SNN) for a hardware-friendly physical reservoir computing (RC) on a complementary metal-oxide-semiconductor (CMOS) platform. We demonstrate RC through short-term memory and exclusive OR tasks, and the spoken digit recognition task with an accuracy of 97.7%.
  arXiv  Detail & Related papers  (2024-09-18T00:23:00Z)
• Informational Embodiment: Computational role of information structure in codes and robots [48.00447230721026]
  We address an information theory (IT) account on how the precision of sensors, the accuracy of motors, their placement, the body geometry, shape the information structure in robots and computational codes. We envision the robot's body as a physical communication channel through which information is conveyed, in and out, despite intrinsic noise and material limitations. We introduce a special class of efficient codes used in IT that reached the Shannon limits in terms of information capacity for error correction and robustness against noise, and parsimony.
  arXiv  Detail & Related papers  (2024-08-23T09:59:45Z)
• Reservoir Computing Using Measurement-Controlled Quantum Dynamics [0.0]
  We introduce a quantum RC system that employs the dynamics of a probed atom in a cavity. The proposed quantum reservoir can make fast and reliable forecasts using a small number of artificial neurons.
  arXiv  Detail & Related papers  (2024-03-01T22:59:41Z)
• Mechanistic Neural Networks for Scientific Machine Learning [58.99592521721158]
  We present Mechanistic Neural Networks, a neural network design for machine learning applications in the sciences. It incorporates a new Mechanistic Block in standard architectures to explicitly learn governing differential equations as representations. Central to our approach is a novel Relaxed Linear Programming solver (NeuRLP) inspired by a technique that reduces solving linear ODEs to solving linear programs.
  arXiv  Detail & Related papers  (2024-02-20T15:23:24Z)
• Physical Reservoir Computing Enabled by Solitary Waves and Biologically-Inspired Nonlinear Transformation of Input Data [0.0]
  Reservoir computing (RC) systems can efficiently forecast chaotic time series using nonlinear dynamical properties of an artificial neural network of random connections. Inspired by the nonlinear processes in a living biological brain, in this paper we experimentally validate a physical RC system that substitutes the effect of randomness for a nonlinear transformation of input data.
  arXiv  Detail & Related papers  (2024-01-03T06:22:36Z)
• Controlling dynamical systems to complex target states using machine learning: next-generation vs. classical reservoir computing [68.8204255655161]
  Controlling nonlinear dynamical systems using machine learning allows to drive systems into simple behavior like periodicity but also to more complex arbitrary dynamics. We show first that classical reservoir computing excels at this task. In a next step, we compare those results based on different amounts of training data to an alternative setup, where next-generation reservoir computing is used instead. It turns out that while delivering comparable performance for usual amounts of training data, next-generation RC significantly outperforms in situations where only very limited data is available.
  arXiv  Detail & Related papers  (2023-07-14T07:05:17Z)
• Machine learning at the mesoscale: a computation-dissipation bottleneck [77.34726150561087]
  We study a computation-dissipation bottleneck in mesoscopic systems used as input-output devices. Our framework sheds light on a crucial compromise between information compression, input-output computation and dynamic irreversibility induced by non-reciprocal interactions.
  arXiv  Detail & Related papers  (2023-07-05T15:46:07Z)
• Learnability with Time-Sharing Computational Resource Concerns [65.268245109828]
  We present a theoretical framework that takes into account the influence of computational resources in learning theory. This framework can be naturally applied to stream learning where the incoming data streams can be potentially endless. It may also provide a theoretical perspective for the design of intelligent supercomputing operating systems.
  arXiv  Detail & Related papers  (2023-05-03T15:54:23Z)
• Hybrid quantum physics-informed neural networks for simulating computational fluid dynamics in complex shapes [37.69303106863453]
  We present a hybrid quantum physics-informed neural network that simulates laminar fluid flows in 3D Y-shaped mixers. Our approach combines the expressive power of a quantum model with the flexibility of a physics-informed neural network, resulting in a 21% higher accuracy compared to a purely classical neural network.
  arXiv  Detail & Related papers  (2023-04-21T20:49:29Z)
• On Robust Numerical Solver for ODE via Self-Attention Mechanism [82.95493796476767]
  We explore training efficient and robust AI-enhanced numerical solvers with a small data size by mitigating intrinsic noise disturbances. We first analyze the ability of the self-attention mechanism to regulate noise in supervised learning and then propose a simple-yet-effective numerical solver, Attr, which introduces an additive self-attention mechanism to the numerical solution of differential equations.
  arXiv  Detail & Related papers  (2023-02-05T01:39:21Z)
• Information Processing Capacity of Spin-Based Quantum Reservoir Computing Systems [0.0]
  Quantum reservoir computing (QRC) with Ising spin networks was introduced as a quantum version of classical reservoir computing. We characterize the performance of the spin-based QRC model with the Information Processing Capacity (IPC) This work establishes a clear picture of the computational capabilities of a quantum network of spins for reservoir computing.
  arXiv  Detail & Related papers  (2020-10-13T13:26:34Z)
• Higher-Order Quantum Reservoir Computing [0.0]
  We propose a hybrid quantum-classical framework consisting of multiple but small quantum systems that are mutually communicated via classical connections like linear feedback. We demonstrate the effectiveness of our framework in emulating large-scale nonlinear dynamical systems.
  arXiv  Detail & Related papers  (2020-06-16T08:54:04Z)
• Combining Machine Learning with Knowledge-Based Modeling for Scalable Forecasting and Subgrid-Scale Closure of Large, Complex, Spatiotemporal Systems [48.7576911714538]
  We attempt to utilize machine learning as the essential tool for integrating pasttemporal data into predictions. We propose combining two approaches: (i) a parallel machine learning prediction scheme; and (ii) a hybrid technique, for a composite prediction system composed of a knowledge-based component and a machine-learning-based component. We demonstrate that not only can this method combining (i) and (ii) be scaled to give excellent performance for very large systems, but also that the length of time series data needed to train our multiple, parallel machine learning components is dramatically less than that necessary without parallelization.
  arXiv  Detail & Related papers  (2020-02-10T23:21:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.