NeuMoSync: End-to-End Neuromodulatory Control for Plasticity and Adaptability in Continual Learning

• URL: http://arxiv.org/abs/2608.04358v1
• Date: Wed, 05 Aug 2026 02:01:09 GMT
• Title: NeuMoSync: End-to-End Neuromodulatory Control for Plasticity and Adaptability in Continual Learning
• Abstract summary: Continual learning (CL) requires models to learn tasks sequentially, yet deep neural networks often suffer from plasticity loss and poor knowledge transfer.<n>We introduce Neuromodulation and Synchronization (NeuMoSync), a novel architecture that integrates dynamic, neuron-specific modulation into deep neural networks.<n>NeuMoSync extends standard neural network architectures with learnable feature vectors for each neuron that track network-wide historical context.
• Score: 2.850721641556094
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Continual learning (CL) requires models to learn tasks sequentially, yet deep neural networks often suffer from plasticity loss and poor knowledge transfer, which can impede their long-term adaptability. Drawing high-level inspiration from global neuromodulatory mechanisms in the brain, we introduce Neuromodulation and Synchronization (NeuMoSync), a novel architecture that integrates dynamic, neuron-specific modulation into deep neural networks to enhance their adaptability and plasticity. NeuMoSync extends standard neural network architectures with learnable feature vectors for each neuron that track network-wide historical context and with a module operating at a higher level of abstraction. This module synthesizes neuron-specific signals, conditioned on both current inputs and the network's evolving state, to adaptively regulate activation dynamics and synaptic plasticity. Evaluated on diverse CL benchmarks, including memorization (Random Label CIFAR-10 and Random Label MNIST), concept drift (Shuffle CIFAR-10 and Shuffle Mini-ImageNet), class-incremental learning (Class Split ImageNet and Class Split CIFAR-100), and domain-incremental learning (Permuted MNIST), NeuMoSync demonstrates strong performance in retaining plasticity and achieves improvements in both forward and backward adaptation compared with existing methods. Ablation studies validate the necessity of each component, while analysis of the learned modulatory signals reveals interpretable coordination patterns across tasks. Our work underscores the potential of integrating global coordination mechanisms into deep learning systems to advance robust, adaptive continual learning. The code is publicly available at https://github.com/RoozbehRazavi/NeuMoSync.

Related papers

• Topological Neural Dynamics: A Neuron-wise Framework for Sequence Modeling [55.07411490538404]
  Topological Neural Dynamics (TND) is a sequence modeling framework that shifts from layer-wise to neuron-wise dynamics.<n>TND represents a neural system as a directed neuron graph, an interaction operator, and a local dynamics function.<n>We evaluate TND as a case study on a behavior cloning task in single-player Pong.
  arXiv  Detail & Related papers  (2026-06-19T10:18:24Z)
• Kirchhoff-Inspired Neural Networks for Evolving High-Order Perception [51.28469959548178]
  We propose the Kirchhoff-Inspired Neural Network (KINN), a state-variable-based network architecture constructed based on Kirchhoff's current law.<n>KINN derives numerically stable state updates from fundamental ordinary differential equations, enabling the explicit decoupling and encoding of higher-order evolutionary components.
  arXiv  Detail & Related papers  (2026-03-25T06:17:31Z)
• A feedback control optimizer for online and hardware-aware training of Spiking Neural Networks [0.5512626046125358]
  We present a novel learning algorithm for Spiking Neural Networks (SNNs) on mixed-signal devices that integrates spike-based weight updates with feedback control signals.<n>In our framework, a spiking controller generates feedback signals to guide SNN activity and drive weight updates, enabling scalable and local on-chip learning.
  arXiv  Detail & Related papers  (2026-02-03T10:08:21Z)
• Connectome-Guided Automatic Learning Rates for Deep Networks [3.2228025627337864]
  We propose Connectome-Guided Automatic Learning Rate (CG-ALR) that adjusts learning rates online as this connectome reconfigures.<n>This connectomics-inspired mechanism adapts step sizes to the network's dynamic functional organization, slowing learning during unstable reconfiguration and accelerating it when stable organization emerges.<n>Our results demonstrate that principles inspired by brain connectomes can inform the design of adaptive learning rates in deep learning, generally outperforming traditional SGD-based schedules and recent methods.
  arXiv  Detail & Related papers  (2025-10-27T19:11:49Z)
• Neuronal Group Communication for Efficient Neural representation [85.36421257648294]
  This paper addresses the question of how to build large neural systems that learn efficient, modular, and interpretable representations.<n>We propose Neuronal Group Communication (NGC), a theory-driven framework that reimagines a neural network as a dynamical system of interacting neuronal groups.<n>NGC treats weights as transient interactions between embedding-like neuronal states, with neural computation unfolding through iterative communication among groups of neurons.
  arXiv  Detail & Related papers  (2025-10-19T14:23:35Z)
• Multi-Plasticity Synergy with Adaptive Mechanism Assignment for Training Spiking Neural Networks [10.519687559399623]
  Spiking Neural Networks (SNNs) are promising brain-inspired models known for low power consumption and superior potential for temporal processing.<n>We propose a biologically inspired training framework that incorporates multiple synergistic plasticity mechanisms for more effective SNN training.
  arXiv  Detail & Related papers  (2025-08-19T09:18:35Z)
• Improving the adaptive and continuous learning capabilities of artificial neural networks: Lessons from multi-neuromodulatory dynamics [37.015600422825855]
  Biological organisms excel in acquiring, transferring, and retaining knowledge while adapting to dynamic environments.<n>This study explores how neuromodulation, a fundamental feature of biological learning systems, can help address challenges such as catastrophic forgetting.<n>By integrating multi-scale neuromodulation, we aim to bridge the gap between biological learning and artificial systems.
  arXiv  Detail & Related papers  (2025-01-12T10:10:01Z)
• Contrastive Learning in Memristor-based Neuromorphic Systems [55.11642177631929]
  Spiking neural networks have become an important family of neuron-based models that sidestep many of the key limitations facing modern-day backpropagation-trained deep networks. In this work, we design and investigate a proof-of-concept instantiation of contrastive-signal-dependent plasticity (CSDP), a neuromorphic form of forward-forward-based, backpropagation-free learning.
  arXiv  Detail & Related papers  (2024-09-17T04:48:45Z)
• Single Neuromorphic Memristor closely Emulates Multiple Synaptic Mechanisms for Energy Efficient Neural Networks [71.79257685917058]
  We demonstrate memristive nano-devices based on SrTiO3 that inherently emulate all these synaptic functions. These memristors operate in a non-filamentary, low conductance regime, which enables stable and energy efficient operation.
  arXiv  Detail & Related papers  (2024-02-26T15:01:54Z)
• Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits [61.94533459151743]
  This work addresses the challenge of designing neurobiologically-motivated schemes for adjusting the synapses of spiking networks. Our experimental simulations demonstrate a consistent advantage over other biologically-plausible approaches when training recurrent spiking networks.
  arXiv  Detail & Related papers  (2023-03-30T02:40:28Z)
• SpikePropamine: Differentiable Plasticity in Spiking Neural Networks [0.0]
  We introduce a framework for learning the dynamics of synaptic plasticity and neuromodulated synaptic plasticity in Spiking Neural Networks (SNNs) We show that SNNs augmented with differentiable plasticity are sufficient for solving a set of challenging temporal learning tasks. These networks are also shown to be capable of producing locomotion on a high-dimensional robotic learning task.
  arXiv  Detail & Related papers  (2021-06-04T19:29:07Z)
• Incremental Training of a Recurrent Neural Network Exploiting a Multi-Scale Dynamic Memory [79.42778415729475]
  We propose a novel incrementally trained recurrent architecture targeting explicitly multi-scale learning. We show how to extend the architecture of a simple RNN by separating its hidden state into different modules. We discuss a training algorithm where new modules are iteratively added to the model to learn progressively longer dependencies.
  arXiv  Detail & Related papers  (2020-06-29T08:35:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.