Meta-learning three-factor plasticity rules for structured credit assignment with sparse feedback

• URL: http://arxiv.org/abs/2512.09366v2
• Date: Thu, 11 Dec 2025 05:38:49 GMT
• Title: Meta-learning three-factor plasticity rules for structured credit assignment with sparse feedback
• Authors: Dimitra Maoutsa,
• Abstract summary: We present a meta-learning framework that discovers local learning rules for structured credit assignment in recurrent networks trained with sparse feedback.<n>The resulting three-factor learning rules enable long-timescale credit assignment using only local information and delayed rewards.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Biological neural networks learn complex behaviors from sparse, delayed feedback using local synaptic plasticity, yet the mechanisms enabling structured credit assignment remain elusive. In contrast, artificial recurrent networks solving similar tasks typically rely on biologically implausible global learning rules or hand-crafted local updates. The space of local plasticity rules capable of supporting learning from delayed reinforcement remains largely unexplored. Here, we present a meta-learning framework that discovers local learning rules for structured credit assignment in recurrent networks trained with sparse feedback. Our approach interleaves local neo-Hebbian-like updates during task execution with an outer loop that optimizes plasticity parameters via \textbf{tangent-propagation through learning}. The resulting three-factor learning rules enable long-timescale credit assignment using only local information and delayed rewards, offering new insights into biologically grounded mechanisms for learning in recurrent circuits.

Related papers

• A Backpropagation-Free Feedback-Hebbian Network for Continual Learning Dynamics [0.0]
  We show that a compact feedback pathway trained with local plasticity can support regeneration and continual-learning--relevant dynamics.<n>Results show that a compact feedback pathway trained with local plasticity can support regeneration and continual-learning--relevant dynamics.
  arXiv  Detail & Related papers  (2026-01-11T03:25:38Z)
• A Unified Framework for Neural Computation and Learning Over Time [56.44910327178975]
  Hamiltonian Learning is a novel unified framework for learning with neural networks "over time" It is based on differential equations that: (i) can be integrated without the need of external software solvers; (ii) generalize the well-established notion of gradient-based learning in feed-forward and recurrent networks; (iii) open to novel perspectives.
  arXiv  Detail & Related papers  (2024-09-18T14:57:13Z)
• Oja's plasticity rule overcomes several challenges of training neural networks under biological constraints [0.0]
  We show that incorporating Oja's plasticity rule into error-driven training yields stable, efficient learning in feedforward and recurrent architectures.<n>Our results show that Oja's rule preserves richer activation subspaces, mitigates exploding or vanishing signals, and improves short-term memory in recurrent networks.
  arXiv  Detail & Related papers  (2024-08-15T20:26:47Z)
• Network bottlenecks and task structure control the evolution of interpretable learning rules in a foraging agent [0.0]
  We study meta-learning via evolutionary optimization of simple reward-modulated plasticity rules in embodied agents. We show that unconstrained meta-learning leads to the emergence of diverse plasticity rules. Our findings indicate that the meta-learning of plasticity rules is very sensitive to various parameters, with this sensitivity possibly reflected in the learning rules found in biological networks.
  arXiv  Detail & Related papers  (2024-03-20T14:57:02Z)
• Disentangling the Causes of Plasticity Loss in Neural Networks [55.23250269007988]
  We show that loss of plasticity can be decomposed into multiple independent mechanisms. We show that a combination of layer normalization and weight decay is highly effective at maintaining plasticity in a variety of synthetic nonstationary learning tasks.
  arXiv  Detail & Related papers  (2024-02-29T00:02:33Z)
• A General Framework for Interpretable Neural Learning based on Local Information-Theoretic Goal Functions [1.5236380958983644]
  We introduce 'infomorphic' neural networks to perform tasks from supervised, unsupervised and memory learning.<n>By leveraging the interpretable nature of the PID framework, infomorphic networks represent a valuable tool to advance our understanding of the intricate structure of local learning.
  arXiv  Detail & Related papers  (2023-06-03T16:34:25Z)
• ETLP: Event-based Three-factor Local Plasticity for online learning with neuromorphic hardware [105.54048699217668]
  We show a competitive performance in accuracy with a clear advantage in the computational complexity for Event-Based Three-factor Local Plasticity (ETLP) We also show that when using local plasticity, threshold adaptation in spiking neurons and a recurrent topology are necessary to learntemporal patterns with a rich temporal structure.
  arXiv  Detail & Related papers  (2023-01-19T19:45:42Z)
• Critical Learning Periods for Multisensory Integration in Deep Networks [112.40005682521638]
  We show that the ability of a neural network to integrate information from diverse sources hinges critically on being exposed to properly correlated signals during the early phases of training. We show that critical periods arise from the complex and unstable early transient dynamics, which are decisive of final performance of the trained system and their learned representations.
  arXiv  Detail & Related papers  (2022-10-06T23:50:38Z)
• Minimizing Control for Credit Assignment with Strong Feedback [65.59995261310529]
  Current methods for gradient-based credit assignment in deep neural networks need infinitesimally small feedback signals. We combine strong feedback influences on neural activity with gradient-based learning and show that this naturally leads to a novel view on neural network optimization. We show that the use of strong feedback in DFC allows learning forward and feedback connections simultaneously, using a learning rule fully local in space and time.
  arXiv  Detail & Related papers  (2022-04-14T22:06:21Z)
• Learning Fast and Slow for Online Time Series Forecasting [76.50127663309604]
  Fast and Slow learning Networks (FSNet) is a holistic framework for online time-series forecasting. FSNet balances fast adaptation to recent changes and retrieving similar old knowledge. Our code will be made publicly available.
  arXiv  Detail & Related papers  (2022-02-23T18:23:07Z)
• Learning to Learn with Feedback and Local Plasticity [9.51828574518325]
  We employ meta-learning to discover networks that learn using feedback connections and local, biologically inspired learning rules. Our experiments show that meta-trained networks effectively use feedback connections to perform online credit assignment in multi-layer architectures.
  arXiv  Detail & Related papers  (2020-06-16T22:49:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.