Neuromorphic Online Clustering and Classification
- URL: http://arxiv.org/abs/2310.17797v1
- Date: Thu, 26 Oct 2023 21:59:19 GMT
- Title: Neuromorphic Online Clustering and Classification
- Authors: J. E. Smith
- Abstract summary: Two layers of a neuromorphic architecture are designed and shown to be capable of online clustering and supervised classification.
Active spiking dendrite model is used, and a single dendritic segment performs essentially the same function as a classic integrate-and-fire point neuron.
A single dendrite is then composed of multiple segments and is capable of online clustering.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: The bottom two layers of a neuromorphic architecture are designed and shown
to be capable of online clustering and supervised classification. An active
spiking dendrite model is used, and a single dendritic segment performs
essentially the same function as a classic integrate-and-fire point neuron. A
single dendrite is then composed of multiple segments and is capable of online
clustering. Although this work focuses primarily on dendrite functionality, a
multi-point neuron can be formed by combining multiple dendrites. To
demonstrate its clustering capability, a dendrite is applied to spike sorting,
an important component of brain-computer interface applications. Supervised
online classification is implemented as a network composed of multiple
dendrites and a simple voting mechanism. The dendrites operate independently
and in parallel. The network learns in an online fashion and can adapt to
macro-level changes in the input stream. Achieving brain-like capabilities,
efficiencies, and adaptability will require a significantly different approach
than conventional deep networks that learn via compute-intensive back
propagation. The model described herein may serve as the foundation for such an
approach.
Related papers
- Neuromorphic Online Clustering and Its Application to Spike Sorting [0.783218941317936]
We develop neuromorphic dendrites as basic neural building blocks capable of dynamic online clustering.<n>Features and capabilities of neuromorphic dendrites are demonstrated via a benchmark drawn from experimental neuroscience: spike sorting.<n>The accuracy of the proposed dendrite is compared with the more compute-intensive, offline k-means clustering approach.
arXiv Detail & Related papers (2025-06-14T15:53:55Z) - Convolutional Neural Networks for Automated Cellular Automaton Classification [0.0]
We implement computer vision techniques to perform an automated classification of elementary cellular automata into the five Li-Packard classes.
We first show that previously developed deep learning approaches have in fact been trained to identify the local update rule.
We then present a convolutional neural network that performs nearly perfectly at identifying the behavioural class.
arXiv Detail & Related papers (2024-09-04T14:21:00Z) - CoLaNET -- A Spiking Neural Network with Columnar Layered Architecture for Classification [0.0]
I describe a spiking neural network (SNN) architecture which, can be used in wide range of supervised learning classification tasks.
It is assumed, that all participating signals (the classified object description, correct class label and SNN decision) have spiking nature.
I illustrate the high performance of my network on a task related to model-based reinforcement learning.
arXiv Detail & Related papers (2024-09-02T13:04:54Z) - Coding schemes in neural networks learning classification tasks [52.22978725954347]
We investigate fully-connected, wide neural networks learning classification tasks.
We show that the networks acquire strong, data-dependent features.
Surprisingly, the nature of the internal representations depends crucially on the neuronal nonlinearity.
arXiv Detail & Related papers (2024-06-24T14:50:05Z) - Unsupervised representation learning with Hebbian synaptic and structural plasticity in brain-like feedforward neural networks [0.0]
We introduce and evaluate a brain-like neural network model capable of unsupervised representation learning.
The model was tested on a diverse set of popular machine learning benchmarks.
arXiv Detail & Related papers (2024-06-07T08:32:30Z) - A versatile circuit for emulating active biological dendrites applied to
sound localisation and neuron imitation [0.0]
We introduce a versatile circuit that emulates a segment of a dendrite which exhibits gain, introduces delays, and performs integration.
We also find that dendrites can form bursting neurons.
This significant discovery suggests the potential to fabricate neural networks solely comprised of dendrite circuits.
arXiv Detail & Related papers (2023-10-25T09:42:24Z) - POPPINS : A Population-Based Digital Spiking Neuromorphic Processor with
Integer Quadratic Integrate-and-Fire Neurons [50.591267188664666]
We propose a population-based digital spiking neuromorphic processor in 180nm process technology with two hierarchy populations.
The proposed approach enables the developments of biomimetic neuromorphic system and various low-power, and low-latency inference processing applications.
arXiv Detail & Related papers (2022-01-19T09:26:34Z) - Self-Supervised Graph Representation Learning for Neuronal Morphologies [75.38832711445421]
We present GraphDINO, a data-driven approach to learn low-dimensional representations of 3D neuronal morphologies from unlabeled datasets.
We show, in two different species and across multiple brain areas, that this method yields morphological cell type clusterings on par with manual feature-based classification by experts.
Our method could potentially enable data-driven discovery of novel morphological features and cell types in large-scale datasets.
arXiv Detail & Related papers (2021-12-23T12:17:47Z) - Epigenetic evolution of deep convolutional models [81.21462458089142]
We build upon a previously proposed neuroevolution framework to evolve deep convolutional models.
We propose a convolutional layer layout which allows kernels of different shapes and sizes to coexist within the same layer.
The proposed layout enables the size and shape of individual kernels within a convolutional layer to be evolved with a corresponding new mutation operator.
arXiv Detail & Related papers (2021-04-12T12:45:16Z) - IC Neuron: An Efficient Unit to Construct Neural Networks [8.926478245654703]
We propose a new neuron model that can represent more complex distributions.
The Inter-layer collision (IC) neuron divides the input space into multiple subspaces used to represent different linear transformations.
We build the IC networks by integrating the IC neurons into the fully-connected (FC), convolutional, and recurrent structures.
arXiv Detail & Related papers (2020-11-23T08:36:48Z) - Towards Efficient Processing and Learning with Spikes: New Approaches
for Multi-Spike Learning [59.249322621035056]
We propose two new multi-spike learning rules which demonstrate better performance over other baselines on various tasks.
In the feature detection task, we re-examine the ability of unsupervised STDP with its limitations being presented.
Our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied.
arXiv Detail & Related papers (2020-05-02T06:41:20Z) - Non-linear Neurons with Human-like Apical Dendrite Activations [81.18416067005538]
We show that a standard neuron followed by our novel apical dendrite activation (ADA) can learn the XOR logical function with 100% accuracy.
We conduct experiments on six benchmark data sets from computer vision, signal processing and natural language processing.
arXiv Detail & Related papers (2020-02-02T21:09:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.