Back to the Continuous Attractor

• URL: http://arxiv.org/abs/2408.00109v3
• Date: Fri, 17 Jan 2025 23:36:25 GMT
• Title: Back to the Continuous Attractor
• Authors: Ábel Ságodi, Guillermo Martín-Sánchez, Piotr Sokół, Il Memming Park,
• Abstract summary: Continuous attractors offer a unique class of solutions for storing continuous-valued variables in recurrent system states for indefinitely long time intervals.<n>Unfortunately, continuous attractors suffer from severe structural instability in general--they are destroyed by most infinitesimal changes of the dynamical law that defines them.<n>We observe that the bifurcations from continuous attractors in theoretical neuroscience models display various structurally stable forms.<n>We build on the persistent manifold theory to explain the commonalities between bifurcations from and approximations of continuous attractors.
• Score: 4.866486451835401
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Continuous attractors offer a unique class of solutions for storing continuous-valued variables in recurrent system states for indefinitely long time intervals. Unfortunately, continuous attractors suffer from severe structural instability in general--they are destroyed by most infinitesimal changes of the dynamical law that defines them. This fragility limits their utility especially in biological systems as their recurrent dynamics are subject to constant perturbations. We observe that the bifurcations from continuous attractors in theoretical neuroscience models display various structurally stable forms. Although their asymptotic behaviors to maintain memory are categorically distinct, their finite-time behaviors are similar. We build on the persistent manifold theory to explain the commonalities between bifurcations from and approximations of continuous attractors. Fast-slow decomposition analysis uncovers the persistent manifold that survives the seemingly destructive bifurcation. Moreover, recurrent neural networks trained on analog memory tasks display approximate continuous attractors with predicted slow manifold structures. Therefore, continuous attractors are functionally robust and remain useful as a universal analogy for understanding analog memory.

Related papers

• Learning Discrete Successor Transitions in Continuous Attractor Networks: Emergence, Limits, and Topological Constraints [0.0]
  Continuous attractor networks (CANs) represent low-dimensional continuous variables such as head direction, spatial position, and phase.<n>In canonical spatial domains, transitions along the attractor manifold are driven by continuous displacement signals.<n>We present an experimental framework for training CANs to perform successor-like transitions between stable attractor states.
  arXiv  Detail & Related papers  (2026-01-20T10:41:18Z)
• Unleashing Temporal Capacity of Spiking Neural Networks through Spatiotemporal Separation [67.69345363409835]
  Spiking Neural Networks (SNNs) are considered naturally suited for temporal processing, with membrane potential propagation widely regarded as the core temporal modeling mechanism.<n>We design Non-Stateful (NS) models progressively removing membrane propagation to its stage-wise role. Experiments reveal a counterintuitive phenomenon: moderate removal in shallow layers improves performance, while excessive removal causes collapse.
  arXiv  Detail & Related papers  (2025-12-05T07:05:53Z)
• Foundations of Diffusion Models in General State Spaces: A Self-Contained Introduction [54.95522167029998]
  This article is a self-contained primer on diffusion over general state spaces.<n>We develop the discrete-time view (forward noising via Markov kernels and learned reverse dynamics) alongside its continuous-time limits.<n>A common variational treatment yields the ELBO that underpins standard training losses.
  arXiv  Detail & Related papers  (2025-12-04T18:55:36Z)
• Asymptotic Behavior of Random Time-Inhomogeneous Markovian Quantum Dynamics [0.0]
  We study continuous-time, time-inhomogeneous Markovian quantum dynamics in a random environment.<n> normalized evolution converges almost surely to a stationary family of full-rank states.<n> convergences occur at exponential rates that may depend on the disorder.
  arXiv  Detail & Related papers  (2025-09-10T18:35:52Z)
• Memory as Structured Trajectories: Persistent Homology and Contextual Sheaves [5.234742752529437]
  We introduce the delta-homology analogy, which formalizes memory as a set of sparse, topologically irreducible attractors.<n>A Dirac delta-like memory trace is identified with a nontrivial homology generator on a latent manifold of cognitive states.<n>We interpret these delta-homology generators as the low-entropy content variable, while the high-entropy context variable is represented dually as a filtration, cohomology class, or sheaf.
  arXiv  Detail & Related papers  (2025-08-01T23:03:13Z)
• Generative System Dynamics in Recurrent Neural Networks [56.958984970518564]
  We investigate the continuous time dynamics of Recurrent Neural Networks (RNNs) We show that skew-symmetric weight matrices are fundamental to enable stable limit cycles in both linear and nonlinear configurations. Numerical simulations showcase how nonlinear activation functions not only maintain limit cycles, but also enhance the numerical stability of the system integration process.
  arXiv  Detail & Related papers  (2025-04-16T10:39:43Z)
• Opening Krylov space to access all-time dynamics via dynamical symmetries [0.0]
  We numerically and analytically derive some dynamical symmetries in infinite closed systems by introducing a naturally emergent open boundary condition on the Krylov chain. Our approach lets us directly relate the operator growth hypothesis to thermalization and exponential decay of observables in chaotic systems.
  arXiv  Detail & Related papers  (2025-03-10T14:52:45Z)
• Attractor Memory for Long-Term Time Series Forecasting: A Chaos Perspective [63.60312929416228]
  textbftextitAttraos incorporates chaos theory into long-term time series forecasting. We show that Attraos outperforms various LTSF methods on mainstream datasets and chaotic datasets with only one-twelfth of the parameters compared to PatchTST.
  arXiv  Detail & Related papers  (2024-02-18T05:35:01Z)
• Persistent learning signals and working memory without continuous attractors [6.135577623169029]
  We show that quasi-periodic attractors can support learning arbitrarily long temporal relationships. Our theory has broad implications for the design of artificial learning systems.
  arXiv  Detail & Related papers  (2023-08-24T06:12:41Z)
• Universal stability of coherently diffusive 1D systems with respect to decoherence [0.0]
  We show that transport is exceptionally stable against decoherent noise when coherent diffusion is present. Our results might shed new light on the functionality of many biological systems, which often operate at the border between the ballistic and localized regimes.
  arXiv  Detail & Related papers  (2023-07-11T15:49:51Z)
• Decay and revival dynamics of a quantum state embedded in regularly spaced band of states [0.0]
  The dynamics of a single quantum state embedded in one or several (quasi-)continua is one of the most studied phenomena in quantum mechanics. In this work we investigate its discrete analogue and consider short and long time dynamics based on numerical and analytical solutions of the Schr"odinger equation.
  arXiv  Detail & Related papers  (2023-06-05T08:30:47Z)
• What is Memory? A Homological Perspective [6.0044467881527614]
  We introduce the delta-homology model of memory, in which recall, learning, and prediction emerge from cycle closure.<n>A Dirac-like memory trace corresponds to a nontrivial homology generator, representing a sparse, irreducible attractor.<n>We formalize this mechanism through the Context-Content Uncertainty Principle (CCUP), which states that cognition minimizes joint uncertainty between a high-entropy context variable and a low-entropy content variable.
  arXiv  Detail & Related papers  (2023-03-07T19:47:01Z)
• Anomalous multifractality in quantum chains with strongly correlated disorder [68.8204255655161]
  We show that a robust and unusual multifractal regime can emerge in a one-dimensional quantum chain with maximally correlated disorder. This regime is preceded by a mixed and an extended regime at weaker disorder strengths, with the former hosting both extended and multifractal eigenstates.
  arXiv  Detail & Related papers  (2021-12-18T06:31:51Z)
• Discrete time-crystalline response stabilized by domain-wall confinement [0.0]
  In this work, we establish the effectiveness of a different mechanism arising in quantum spin chains: the confinement of domain walls into mesonic bound states. We consider translationally invariant quantum Ising chains periodically kicked at arbitrary frequency, and discuss two possible routes to domain-wall confinement. We point out the experimental relevance of this new mechanism for stabilizing a long-lived time-temporal response in Rydberg-crystalline spin chains.
  arXiv  Detail & Related papers  (2021-10-27T18:46:16Z)
• Long-lived period-doubled edge modes of interacting and disorder-free Floquet spin chains [68.8204255655161]
  We show that even in the absence of disorder, and in the presence of bulk heating, $pi$ edge modes are long lived. A tunneling estimate for the lifetime is obtained by mapping the stroboscopic time-evolution to dynamics of a single particle in Krylov subspace.
  arXiv  Detail & Related papers  (2021-05-28T12:13:14Z)
• Localisation in quasiperiodic chains: a theory based on convergence of local propagators [68.8204255655161]
  We present a theory of localisation in quasiperiodic chains with nearest-neighbour hoppings, based on the convergence of local propagators. Analysing the convergence of these continued fractions, localisation or its absence can be determined, yielding in turn the critical points and mobility edges. Results are exemplified by analysing the theory for three quasiperiodic models covering a range of behaviour.
  arXiv  Detail & Related papers  (2021-02-18T16:19:52Z)
• Self-consistent theory of mobility edges in quasiperiodic chains [62.997667081978825]
  We introduce a self-consistent theory of mobility edges in nearest-neighbour tight-binding chains with quasiperiodic potentials. mobility edges are generic in quasiperiodic systems which lack the energy-independent self-duality of the commonly studied Aubry-Andr'e-Harper model.
  arXiv  Detail & Related papers  (2020-12-02T19:00:09Z)
• Dynamical obstruction to localization in a disordered spin chain [0.0]
  We analyze a one-dimensional XXZ spin chain in a disordered magnetic field. A region of maximal chaos separates the many-body localized phase from the diffusive ergodic phase. Instead of localizing, the system appears to enter a universal subdiffusive relaxation regime at moderate values of disorder.
  arXiv  Detail & Related papers  (2020-09-09T18:18:06Z)
• Supporting Optimal Phase Space Reconstructions Using Neural Network Architecture for Time Series Modeling [68.8204255655161]
  We propose an artificial neural network with a mechanism to implicitly learn the phase spaces properties. Our approach is either as competitive as or better than most state-of-the-art strategies.
  arXiv  Detail & Related papers  (2020-06-19T21:04:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.