Joint sparse coding and temporal dynamics support context reconfiguration

• URL: http://arxiv.org/abs/2605.10178v1
• Date: Mon, 11 May 2026 08:29:00 GMT
• Title: Joint sparse coding and temporal dynamics support context reconfiguration
• Abstract summary: We identify joint sparse coding and temporal dynamics as mechanisms that help preserve prior representations during context transitions.<n>Strikingly, networks endowed with both properties, such as spiking neural networks, exhibit improved retention during lifelong learning without auxiliarys.<n>These findings establish joint sparse coding and temporal dynamics as a core mechanism supporting flexible context reconfiguration in lifelong learning.
• Score: 12.88300604235618
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Adaptive behavior requires the brain to transition between distinct contexts while maintaining representations of prior experience. The ability to reconfigure neural representations without erasing previously acquired knowledge is central to learning in dynamic environments, yet the neural mechanisms that support this balance remain unclear. Understanding these mechanisms is also critical for addressing catastrophic forgetting in artificial systems designed for lifelong learning. Here, we identify joint sparse coding and temporal dynamics in both the mouse medial prefrontal cortex (mPFC) and computational networks as mechanisms that help preserve prior representations during context transitions. Specifically, sparsity in context-dependent representations reduces cross-context interference, whereas temporal dynamics within the network activity further enhance context separability across time. Strikingly, networks endowed with both properties, such as spiking neural networks, exhibit improved retention during lifelong learning without auxiliary heuristics. These findings establish joint sparse coding and temporal dynamics as a core mechanism supporting flexible context reconfiguration in lifelong learning and, through their activity constraining nature, as an energy-efficient architectural principle for stable adaptation. Together, they provide a mechanistic framework for understanding how the brain preserves prior knowledge while flexibly adapting to new contexts.

Related papers

• The Forward-Backward Disconnect: State Dynamics, Credit Assignment, and Biological Grounding in Neural Computation [0.3695480271934741]
  We develop a taxonomy spanning neural model families along three axes: state-dynamics structure, credit-assignment mechanism, and biological grounding.<n>Across static, recurrent, attention-based, state-space, continuous-time, implicit, spiking, biologically plausible, and neuromorphic families, forward dynamics have diversified.<n>Highest demonstrated scales remain concentrated in global or closely gradient-derived error-propagation mechanisms.
  arXiv  Detail & Related papers  (2026-08-20T13:09:10Z)
• Kirchhoff-Inspired Neural Networks for Evolving High-Order Perception [51.28469959548178]
  We propose the Kirchhoff-Inspired Neural Network (KINN), a state-variable-based network architecture constructed based on Kirchhoff's current law.<n>KINN derives numerically stable state updates from fundamental ordinary differential equations, enabling the explicit decoupling and encoding of higher-order evolutionary components.
  arXiv  Detail & Related papers  (2026-03-25T06:17:31Z)
• A Backpropagation-Free Feedback-Hebbian Network for Continual Learning Dynamics [0.0]
  We show that a compact feedback pathway trained with local plasticity can support regeneration and continual-learning--relevant dynamics.<n>Results show that a compact feedback pathway trained with local plasticity can support regeneration and continual-learning--relevant dynamics.
  arXiv  Detail & Related papers  (2026-01-11T03:25:38Z)
• T3former: Temporal Graph Classification with Topological Machine Learning [4.4924444466378555]
  Temporal graph classification plays a critical role in applications such as cybersecurity, brain connectivity analysis, and traffic monitoring.<n>We introduce T3former, a novel Topological Temporal Transformer that leverages sliding-window topological and spectral descriptors as first-class tokens, integrated via a specialized Descriptor-Attention mechanism.<n>T3former achieves state-of-the-art performance across multiple benchmarks, including dynamic social networks, brain functional connectivity datasets, and traffic networks.
  arXiv  Detail & Related papers  (2025-10-15T17:46:32Z)
• Rhythmic sharing: A bio-inspired paradigm for zero-shot adaptive learning in neural networks [0.0]
  The brain rapidly adapts to new contexts and learns from limited data, a coveted characteristic that artificial intelligence (AI) algorithms struggle to mimic.<n>We developed a learning paradigm utilizing link strength oscillations, where learning is associated with the coordination of these oscillations.<n>Link oscillations can rapidly change coordination, allowing the network to sense and adapt to subtle contextual changes without supervision.
  arXiv  Detail & Related papers  (2025-02-12T18:58:34Z)
• Neuron: Learning Context-Aware Evolving Representations for Zero-Shot Skeleton Action Recognition [64.56321246196859]
  We propose a novel dyNamically Evolving dUal skeleton-semantic syneRgistic framework.<n>We first construct the spatial-temporal evolving micro-prototypes and integrate dynamic context-aware side information.<n>We introduce the spatial compression and temporal memory mechanisms to guide the growth of spatial-temporal micro-prototypes.
  arXiv  Detail & Related papers  (2024-11-18T05:16:11Z)
• Exploring neural oscillations during speech perception via surrogate gradient spiking neural networks [59.38765771221084]
  We present a physiologically inspired speech recognition architecture compatible and scalable with deep learning frameworks. We show end-to-end gradient descent training leads to the emergence of neural oscillations in the central spiking neural network. Our findings highlight the crucial inhibitory role of feedback mechanisms, such as spike frequency adaptation and recurrent connections, in regulating and synchronising neural activity to improve recognition performance.
  arXiv  Detail & Related papers  (2024-04-22T09:40:07Z)
• Disentangling the Causes of Plasticity Loss in Neural Networks [55.23250269007988]
  We show that loss of plasticity can be decomposed into multiple independent mechanisms. We show that a combination of layer normalization and weight decay is highly effective at maintaining plasticity in a variety of synthetic nonstationary learning tasks.
  arXiv  Detail & Related papers  (2024-02-29T00:02:33Z)
• Persistent learning signals and working memory without continuous attractors [6.135577623169029]
  We show that quasi-periodic attractors can support learning arbitrarily long temporal relationships. Our theory has broad implications for the design of artificial learning systems.
  arXiv  Detail & Related papers  (2023-08-24T06:12:41Z)
• Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits [61.94533459151743]
  This work addresses the challenge of designing neurobiologically-motivated schemes for adjusting the synapses of spiking networks. Our experimental simulations demonstrate a consistent advantage over other biologically-plausible approaches when training recurrent spiking networks.
  arXiv  Detail & Related papers  (2023-03-30T02:40:28Z)
• Critical Learning Periods for Multisensory Integration in Deep Networks [112.40005682521638]
  We show that the ability of a neural network to integrate information from diverse sources hinges critically on being exposed to properly correlated signals during the early phases of training. We show that critical periods arise from the complex and unstable early transient dynamics, which are decisive of final performance of the trained system and their learned representations.
  arXiv  Detail & Related papers  (2022-10-06T23:50:38Z)
• Complementary Structure-Learning Neural Networks for Relational Reasoning [3.528645587678267]
  We show that pattern separation in the hippocampus allows rapid learning in novel environments. slower learning in neocortex accumulates small weight changes to extract systematic structure from well-learned environments.
  arXiv  Detail & Related papers  (2021-05-19T06:25:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.