A thermodynamically consistent chemical spiking neuron capable of
autonomous Hebbian learning
- URL: http://arxiv.org/abs/2009.13207v1
- Date: Mon, 28 Sep 2020 10:43:13 GMT
- Title: A thermodynamically consistent chemical spiking neuron capable of
autonomous Hebbian learning
- Authors: Jakub Fil and Dominique Chu
- Abstract summary: We propose a fully autonomous, thermodynamically consistent set of chemical reactions that implements a spiking neuron.
This chemical neuron is able to learn input patterns in a Hebbian fashion.
In addition to the thermodynamically consistent model of the CN, we also propose a biologically plausible version that could be engineered in a synthetic biology context.
- Score: 0.5874142059884521
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose a fully autonomous, thermodynamically consistent set of chemical
reactions that implements a spiking neuron. This chemical neuron is able to
learn input patterns in a Hebbian fashion. The system is scalable to
arbitrarily many input channels. We demonstrate its performance in learning
frequency biases in the input as well as correlations between different input
channels. Efficient computation of time-correlations requires a highly
non-linear activation function. The resource requirements of a non-linear
activation function are discussed. In addition to the thermodynamically
consistent model of the CN, we also propose a biologically plausible version
that could be engineered in a synthetic biology context.
Related papers
- Neural Pfaffians: Solving Many Many-Electron Schrödinger Equations [58.130170155147205]
Neural wave functions accomplished unprecedented accuracies in approximating the ground state of many-electron systems, though at a high computational cost.
Recent works proposed amortizing the cost by learning generalized wave functions across different structures and compounds instead of solving each problem independently.
This work tackles the problem by defining overparametrized, fully learnable neural wave functions suitable for generalization across molecules.
arXiv Detail & Related papers (2024-05-23T16:30:51Z) - Single Neuromorphic Memristor closely Emulates Multiple Synaptic
Mechanisms for Energy Efficient Neural Networks [71.79257685917058]
We demonstrate memristive nano-devices based on SrTiO3 that inherently emulate all these synaptic functions.
These memristors operate in a non-filamentary, low conductance regime, which enables stable and energy efficient operation.
arXiv Detail & Related papers (2024-02-26T15:01:54Z) - Learning dynamic representations of the functional connectome in
neurobiological networks [41.94295877935867]
We introduce an unsupervised approach to learn the dynamic affinities between neurons in live, behaving animals.
We show that our method is able to robustly predict causal interactions between neurons to generate behavior.
arXiv Detail & Related papers (2024-02-21T19:54:25Z) - Modeling Non-Covalent Interatomic Interactions on a Photonic Quantum
Computer [50.24983453990065]
We show that the cQDO model lends itself naturally to simulation on a photonic quantum computer.
We calculate the binding energy curve of diatomic systems by leveraging Xanadu's Strawberry Fields photonics library.
Remarkably, we find that two coupled bosonic QDOs exhibit a stable bond.
arXiv Detail & Related papers (2023-06-14T14:44:12Z) - The Expressive Leaky Memory Neuron: an Efficient and Expressive Phenomenological Neuron Model Can Solve Long-Horizon Tasks [64.08042492426992]
We introduce the Expressive Memory (ELM) neuron model, a biologically inspired model of a cortical neuron.
Our ELM neuron can accurately match the aforementioned input-output relationship with under ten thousand trainable parameters.
We evaluate it on various tasks with demanding temporal structures, including the Long Range Arena (LRA) datasets.
arXiv Detail & Related papers (2023-06-14T13:34:13Z) - Programming molecular systems to emulate a learning spiking neuron [1.2707050104493216]
Hebbian theory seeks to explain how the neurons in the brain adapt to stimuli, to enable learning.
This paper explores how molecular systems can be designed to show such proto-intelligent behaviours.
We propose the first chemical reaction network that can exhibit autonomous Hebbian learning across arbitrarily many input channels.
arXiv Detail & Related papers (2022-05-09T09:21:40Z) - Mapping and Validating a Point Neuron Model on Intel's Neuromorphic
Hardware Loihi [77.34726150561087]
We investigate the potential of Intel's fifth generation neuromorphic chip - Loihi'
Loihi is based on the novel idea of Spiking Neural Networks (SNNs) emulating the neurons in the brain.
We find that Loihi replicates classical simulations very efficiently and scales notably well in terms of both time and energy performance as the networks get larger.
arXiv Detail & Related papers (2021-09-22T16:52:51Z) - Continuous Learning and Adaptation with Membrane Potential and
Activation Threshold Homeostasis [91.3755431537592]
This paper presents the Membrane Potential and Activation Threshold Homeostasis (MPATH) neuron model.
The model allows neurons to maintain a form of dynamic equilibrium by automatically regulating their activity when presented with input.
Experiments demonstrate the model's ability to adapt to and continually learn from its input.
arXiv Detail & Related papers (2021-04-22T04:01:32Z) - Neuromorphic Algorithm-hardware Codesign for Temporal Pattern Learning [11.781094547718595]
We derive an efficient training algorithm for Leaky Integrate and Fire neurons, which is capable of training a SNN to learn complex spatial temporal patterns.
We have developed a CMOS circuit implementation for a memristor-based network of neuron and synapses which retains critical neural dynamics with reduced complexity.
arXiv Detail & Related papers (2021-04-21T18:23:31Z) - Efficient Inference of Flexible Interaction in Spiking-neuron Networks [41.83710212492543]
We use the nonlinear Hawkes process to model excitatory or inhibitory interactions among neurons.
We show our algorithm can estimate the temporal dynamics of interaction and reveal the interpretable functional connectivity underlying neural spike trains.
arXiv Detail & Related papers (2020-06-23T09:10:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.