Reservoir Computing with Magnetic Thin Films

• URL: http://arxiv.org/abs/2101.12700v2
• Date: Mon, 30 Oct 2023 15:23:42 GMT
• Title: Reservoir Computing with Magnetic Thin Films
• Authors: Matthew Dale, David Griffin, Richard F. L. Evans, Sarah Jenkins, Simon O'Keefe, Angelika Sebald, Susan Stepney, Fernando Torre, Martin Trefzer
• Abstract summary: New unconventional computing hardware has emerged with the potential to exploit natural phenomena and gain efficiency. Physical reservoir computing demonstrates this with a variety of unconventional systems. We perform an initial exploration of three magnetic materials in thin-film geometries via microscale simulation.
• Score: 35.32223849309764
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Advances in artificial intelligence are driven by technologies inspired by the brain, but these technologies are orders of magnitude less powerful and energy efficient than biological systems. Inspired by the nonlinear dynamics of neural networks, new unconventional computing hardware has emerged with the potential to exploit natural phenomena and gain efficiency, in a similar manner to biological systems. Physical reservoir computing demonstrates this with a variety of unconventional systems, from optical-based to memristive systems. Reservoir computers provide a nonlinear projection of the task input into a high-dimensional feature space by exploiting the system's internal dynamics. A trained readout layer then combines features to perform tasks, such as pattern recognition and time-series analysis. Despite progress, achieving state-of-the-art performance without external signal processing to the reservoir remains challenging. Here we perform an initial exploration of three magnetic materials in thin-film geometries via microscale simulation. Our results reveal that basic spin properties of magnetic films generate the required nonlinear dynamics and memory to solve machine learning tasks (although there would be practical challenges in exploiting these particular materials in physical implementations). The method of exploration can be applied to other materials, so this work opens up the possibility of testing different materials, from relatively simple (alloys) to significantly complex (antiferromagnetic reservoirs).

Related papers

• Mechanistic Neural Networks for Scientific Machine Learning [58.99592521721158]
  We present Mechanistic Neural Networks, a neural network design for machine learning applications in the sciences. It incorporates a new Mechanistic Block in standard architectures to explicitly learn governing differential equations as representations. Central to our approach is a novel Relaxed Linear Programming solver (NeuRLP) inspired by a technique that reduces solving linear ODEs to solving linear programs.
  arXiv  Detail & Related papers  (2024-02-20T15:23:24Z)
• Optical Extreme Learning Machines with Atomic Vapors [0.3069335774032178]
  Extreme learning machines explore nonlinear random projections to perform computing tasks on high-dimensional output spaces. This manuscript explores the possibility of using atomic gases in near-resonant conditions to implement an optical extreme learning machine. Our results suggest that these systems have the potential not only to work as an optical extreme learning machine but also to perform these computations at the few-photon level.
  arXiv  Detail & Related papers  (2024-01-08T10:19:28Z)
• Deep Photonic Reservoir Computer for Speech Recognition [49.1574468325115]
  Speech recognition is a critical task in the field of artificial intelligence and has witnessed remarkable advancements. Deep reservoir computing is energy efficient but exhibits limitations in performance when compared to more resource-intensive machine learning algorithms. We propose a photonic-based deep reservoir computer and evaluate its effectiveness on different speech recognition tasks.
  arXiv  Detail & Related papers  (2023-12-11T17:43:58Z)
• Brain-Inspired Computational Intelligence via Predictive Coding [89.6335791546526]
  Predictive coding (PC) has shown promising performance in machine intelligence tasks. PC can model information processing in different brain areas, can be used in cognitive control and robotics.
  arXiv  Detail & Related papers  (2023-08-15T16:37:16Z)
• Harnessing Synthetic Active Particles for Physical Reservoir Computing [0.0]
  Reservoir computing is a technique for stimulating a network of nodes with fading memory enabling computations and complex predictions. Here we demonstrate physical reservoir computing with a synthetic active microparticle system that self-organizes from an active and passive component into inherently noisy nonlinear dynamical units. Our results pave the way for the study of information processing in synthetic self-organized active particle systems.
  arXiv  Detail & Related papers  (2023-07-27T17:08:53Z)
• Neuromechanical Autoencoders: Learning to Couple Elastic and Neural Network Nonlinearity [15.47367187516723]
  We seek to develop machine learning analogs of. mechanical intelligence. We jointly learn the morphology of complex nonlinear elastic solids along with a. deep neural network to control it.
  arXiv  Detail & Related papers  (2023-01-31T19:04:28Z)
• Task Agnostic Metrics for Reservoir Computing [0.0]
  Physical reservoir computing is a computational paradigm that enables temporal pattern recognition in physical matter. The chosen dynamical system must have three desirable properties: non-linearity, complexity, and fading memory. We show that, in general, systems with lower damping reach higher values in all three performance metrics.
  arXiv  Detail & Related papers  (2021-08-03T13:58:11Z)
• Gradient Descent in Materio [3.756477173839499]
  We show an efficient and accurate homodyne gradient extraction method for performing gradient descent on the loss function directly in the material system. This shows that gradient descent can in principle be fully implemented in materio using simple electronics.
  arXiv  Detail & Related papers  (2021-05-15T12:18:31Z)
• Linear embedding of nonlinear dynamical systems and prospects for efficient quantum algorithms [74.17312533172291]
  We describe a method for mapping any finite nonlinear dynamical system to an infinite linear dynamical system (embedding) We then explore an approach for approximating the resulting infinite linear system with finite linear systems (truncation)
  arXiv  Detail & Related papers  (2020-12-12T00:01:10Z)
• Spiking Neural Networks Hardware Implementations and Challenges: a Survey [53.429871539789445]
  Spiking Neural Networks are cognitive algorithms mimicking neuron and synapse operational principles. We present the state of the art of hardware implementations of spiking neural networks. We discuss the strategies employed to leverage the characteristics of these event-driven algorithms at the hardware level.
  arXiv  Detail & Related papers  (2020-05-04T13:24:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.