Higher-Order Kuramoto Oscillator Network for Dense Associative Memory

• URL: http://arxiv.org/abs/2507.21984v1
• Date: Tue, 29 Jul 2025 16:35:52 GMT
• Title: Higher-Order Kuramoto Oscillator Network for Dense Associative Memory
• Authors: Jona Nagerl, Natalia G. Berloff,
• Abstract summary: We show that higher-order couplings achieve superlinear scaling of memory capacity with system size.<n>These results bridge the Kuramoto synchronization with modern Hopfield memories.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Networks of phase oscillators can serve as dense associative memories if they incorporate higher-order coupling beyond the classical Kuramoto model's pairwise interactions. Here we introduce a generalized Kuramoto model with combined second-harmonic (pairwise) and fourth-harmonic (quartic) coupling, inspired by dense Hopfield memory theory. Using mean-field theory and its dynamical approximation, we obtain a phase diagram for dense associative memory model that exhibits a tricritical point at which the continuous onset of memory retrieval is supplanted by a discontinuous, hysteretic transition. In the quartic-dominated regime, the system supports bistable phase-locked states corresponding to stored memory patterns, with a sizable energy barrier between memory and incoherent states. We analytically determine this bistable region and show that the escape time from a memory state (due to noise) grows exponentially with network size, indicating robust storage. Extending the theory to finite memory load, we show that higher-order couplings achieve superlinear scaling of memory capacity with system size, far exceeding the limit of pairwise-only oscillators. Large-scale simulations of the oscillator network confirm our theoretical predictions, demonstrating rapid pattern retrieval and robust storage of many phase patterns. These results bridge the Kuramoto synchronization with modern Hopfield memories, pointing toward experimental realization of high-capacity, analog associative memory in oscillator systems.

Related papers

• Latent Structured Hopfield Network for Semantic Association and Retrieval [52.634915010996835]
  Episodic memory enables humans to recall past experiences by associating semantic elements such as objects, locations, and time into coherent event representations.<n>We propose the Latent Structured Hopfield Network (LSHN), a framework that integrates continuous Hopfield attractor dynamics into an autoencoder architecture.<n>Unlike traditional Hopfield networks, our model is trained end-to-end with gradient descent, achieving scalable and robust memory retrieval.
  arXiv  Detail & Related papers  (2025-06-02T04:24:36Z)
• B'MOJO: Hybrid State Space Realizations of Foundation Models with Eidetic and Fading Memory [91.81390121042192]
  We develop a class of models called B'MOJO to seamlessly combine eidetic and fading memory within an composable module. B'MOJO's ability to modulate eidetic and fading memory results in better inference on longer sequences tested up to 32K tokens.
  arXiv  Detail & Related papers  (2024-07-08T18:41:01Z)
• Learning Associative Memories with Gradient Descent [21.182801606213495]
  This work focuses on the training dynamics of one associative memory module storing outer products of token embeddings. We show that imbalance in token frequencies and memory interferences due to correlated embeddings lead to transitory regimes.
  arXiv  Detail & Related papers  (2024-02-28T21:47:30Z)
• Long Sequence Hopfield Memory [32.28395813801847]
  Sequence memory enables agents to encode, store, and retrieve complex sequences of stimuli and actions. We introduce a nonlinear interaction term, enhancing separation between the patterns. We extend this model to store sequences with variable timing between states' transitions.
  arXiv  Detail & Related papers  (2023-06-07T15:41:03Z)
• Quantum associative memory with a single driven-dissipative nonlinear oscillator [0.0]
  We propose a realization of associative memory with a single driven-dissipative quantum oscillator. The model can improve the storage capacity of discrete neuron-based systems in a large regime. We show that the associative-memory capacity is inherently related to the existence of a spectral gap in the Liouvillian superoperator.
  arXiv  Detail & Related papers  (2022-05-19T12:00:35Z)
• Cross-Frequency Coupling Increases Memory Capacity in Oscillatory Neural Networks [69.42260428921436]
  Cross-frequency coupling (CFC) is associated with information integration across populations of neurons. We construct a model of CFC which predicts a computational role for observed $theta - gamma$ oscillatory circuits in the hippocampus and cortex. We show that the presence of CFC increases the memory capacity of a population of neurons connected by plastic synapses.
  arXiv  Detail & Related papers  (2022-04-05T17:13:36Z)
• Data-Driven Time Propagation of Quantum Systems with Neural Networks [0.0]
  We investigate the potential of supervised machine learning to propagate a quantum system in time. We show that neural networks can work as time propagators at any time in the future and that they can bed in time forming an autoregression.
  arXiv  Detail & Related papers  (2022-01-27T17:08:30Z)
• Kanerva++: extending The Kanerva Machine with differentiable, locally block allocated latent memory [75.65949969000596]
  Episodic and semantic memory are critical components of the human memory model. We develop a new principled Bayesian memory allocation scheme that bridges the gap between episodic and semantic memory. We demonstrate that this allocation scheme improves performance in memory conditional image generation.
  arXiv  Detail & Related papers  (2021-02-20T18:40:40Z)
• Continuous and time-discrete non-Markovian system-reservoir interactions: Dissipative coherent quantum feedback in Liouville space [62.997667081978825]
  We investigate a quantum system simultaneously exposed to two structured reservoirs. We employ a numerically exact quasi-2D tensor network combining both diagonal and off-diagonal system-reservoir interactions with a twofold memory for continuous and discrete retardation effects. As a possible example, we study the non-Markovian interplay between discrete photonic feedback and structured acoustic phononovian modes, resulting in emerging inter-reservoir correlations and long-living population trapping within an initially-excited two-level system.
  arXiv  Detail & Related papers  (2020-11-10T12:38:35Z)
• Enhancing associative memory recall and storage capacity using confocal cavity QED [15.696215759892052]
  We introduce a near-term experimental platform for realizing an associative memory. It can simultaneously store many memories by using spinful bosons coupled to a multimode optical cavity. We show that this nonequilibrium quantum-optical scheme has significant advantages for associative memory over Glauber dynamics.
  arXiv  Detail & Related papers  (2020-09-02T17:59:15Z)
• Memory-Critical Dynamical Buildup of Phonon-Dressed Majorana Fermions [72.46695228124449]
  We study a one-dimensional polaronic topological superconductor with phonon-dressed $p$-wave pairing. We show that when the memory depth increases, the Majorana edge dynamics transits from relaxing monotonically to a plateau of substantial value into a collapse-and-buildup behavior.
  arXiv  Detail & Related papers  (2020-06-24T07:32:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.