Theories of synaptic memory consolidation and intelligent plasticity for continual learning

• URL: http://arxiv.org/abs/2405.16922v2
• Date: Fri, 18 Oct 2024 06:15:42 GMT
• Title: Theories of synaptic memory consolidation and intelligent plasticity for continual learning
• Authors: Friedemann Zenke, Axel Laborieux,
• Abstract summary: synaptic plasticity mechanisms must maintain and evolve an internal state. plasticity algorithms must leverage the internal state to intelligently regulate plasticity at individual synapses.
• Score: 7.573586022424398
• License:
• Abstract: Humans and animals learn throughout life. Such continual learning is crucial for intelligence. In this chapter, we examine the pivotal role plasticity mechanisms with complex internal synaptic dynamics could play in enabling this ability in neural networks. By surveying theoretical research, we highlight two fundamental enablers for continual learning. First, synaptic plasticity mechanisms must maintain and evolve an internal state over several behaviorally relevant timescales. Second, plasticity algorithms must leverage the internal state to intelligently regulate plasticity at individual synapses to facilitate the seamless integration of new memories while avoiding detrimental interference with existing ones. Our chapter covers successful applications of these principles to deep neural networks and underscores the significance of synaptic metaplasticity in sustaining continual learning capabilities. Finally, we outline avenues for further research to understand the brain's superb continual learning abilities and harness similar mechanisms for artificial intelligence systems.

Related papers

• Artificial Kuramoto Oscillatory Neurons [65.16453738828672]
  We introduce Artificial Kuramotoy Neurons (AKOrN) as a dynamical alternative to threshold units. We show that this idea provides performance improvements across a wide spectrum of tasks. We believe that these empirical results show the importance of our assumptions at the most basic neuronal level of neural representation.
  arXiv  Detail & Related papers  (2024-10-17T17:47:54Z)
• Brain-inspired continual pre-trained learner via silent synaptic consolidation [2.872028467114491]
  Artsy is inspired by the activation mechanisms of silent synapses via spike-timing-dependent plasticity observed in mature brains. It mimics mature brain dynamics by maintaining memory stability for previously learned knowledge within the pre-trained network. During inference, artificial silent and functional synapses are utilized to establish precise connections between the pre-trained network and the sub-networks.
  arXiv  Detail & Related papers  (2024-10-08T10:56:19Z)
• Enhancing learning in spiking neural networks through neuronal heterogeneity and neuromodulatory signaling [52.06722364186432]
  We propose a biologically-informed framework for enhancing artificial neural networks (ANNs) Our proposed dual-framework approach highlights the potential of spiking neural networks (SNNs) for emulating diverse spiking behaviors. We outline how the proposed approach integrates brain-inspired compartmental models and task-driven SNNs, bioinspiration and complexity.
  arXiv  Detail & Related papers  (2024-07-05T14:11:28Z)
• Brain-Inspired Machine Intelligence: A Survey of Neurobiologically-Plausible Credit Assignment [65.268245109828]
  We examine algorithms for conducting credit assignment in artificial neural networks that are inspired or motivated by neurobiology. We organize the ever-growing set of brain-inspired learning schemes into six general families and consider these in the context of backpropagation of errors. The results of this review are meant to encourage future developments in neuro-mimetic systems and their constituent learning processes.
  arXiv  Detail & Related papers  (2023-12-01T05:20:57Z)
• Learning the Plasticity: Plasticity-Driven Learning Framework in Spiking Neural Networks [9.25919593660244]
  New paradigm for Spiking Neural Networks (SNNs) Plasticity-Driven Learning Framework (PDLF) PDLF redefines concepts of functional and Presynaptic-Dependent Plasticity.
  arXiv  Detail & Related papers  (2023-08-23T11:11:31Z)
• Incremental procedural and sensorimotor learning in cognitive humanoid robots [52.77024349608834]
  This work presents a cognitive agent that can learn procedures incrementally. We show the cognitive functions required in each substage and how adding new functions helps address tasks previously unsolved by the agent. Results show that this approach is capable of solving complex tasks incrementally.
  arXiv  Detail & Related papers  (2023-04-30T22:51:31Z)
• A Study of Biologically Plausible Neural Network: The Role and Interactions of Brain-Inspired Mechanisms in Continual Learning [13.041607703862724]
  Humans excel at continually acquiring, consolidating, and retaining information from an ever-changing environment, whereas artificial neural networks (ANNs) exhibit catastrophic forgetting. We consider a biologically plausible framework that constitutes separate populations of exclusively excitatory and inhibitory neurons that adhere to Dale's principle. We then conduct a comprehensive study on the role and interactions of different mechanisms inspired by the brain, including sparse non-overlapping representations, Hebbian learning, synaptic consolidation, and replay of past activations that accompanied the learning event.
  arXiv  Detail & Related papers  (2023-04-13T16:34:12Z)
• Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits [61.94533459151743]
  This work addresses the challenge of designing neurobiologically-motivated schemes for adjusting the synapses of spiking networks. Our experimental simulations demonstrate a consistent advantage over other biologically-plausible approaches when training recurrent spiking networks.
  arXiv  Detail & Related papers  (2023-03-30T02:40:28Z)
• Control of synaptic plasticity via the fusion of reinforcement learning and unsupervised learning in neural networks [0.0]
  In cognitive neuroscience, it is widely accepted that synaptic plasticity plays an essential role in our amazing learning capability. With this inspiration, a new learning rule is proposed via the fusion of reinforcement learning and unsupervised learning. In the proposed computational model, the nonlinear optimal control theory is used to resemble the error feedback loop systems.
  arXiv  Detail & Related papers  (2023-03-26T12:18:03Z)
• Memory-Augmented Theory of Mind Network [59.9781556714202]
  Social reasoning requires the capacity of theory of mind (ToM) to contextualise and attribute mental states to others. Recent machine learning approaches to ToM have demonstrated that we can train the observer to read the past and present behaviours of other agents. We tackle the challenges by equipping the observer with novel neural memory mechanisms to encode, and hierarchical attention to selectively retrieve information about others. This results in ToMMY, a theory of mind model that learns to reason while making little assumptions about the underlying mental processes.
  arXiv  Detail & Related papers  (2023-01-17T14:48:58Z)
• From Biological Synapses to Intelligent Robots [0.0]
  Hebbian synaptic learning is discussed as a functionally relevant model for machine learning and intelligence. The potential for adaptive learning and control without supervision is brought forward. The insights collected here point toward the Hebbian model as a choice solution for intelligent robotics and sensor systems.
  arXiv  Detail & Related papers  (2022-02-25T12:39:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.