SPAIC: A Spike-based Artificial Intelligence Computing Framework
- URL: http://arxiv.org/abs/2207.12750v1
- Date: Tue, 26 Jul 2022 08:57:42 GMT
- Title: SPAIC: A Spike-based Artificial Intelligence Computing Framework
- Authors: Chaofei Hong, Mengwen Yuan, Mengxiao Zhang, Xiao Wang, Chegnjun Zhang,
Jiaxin Wang, Gang Pan, Zhaohui Wu, Huajin Tang
- Abstract summary: We present a Python based spiking neural network (SNN) simulation and training framework, aka SPAIC.
It aims to support brain-inspired model and algorithm researches integrated with features from both deep learning and neuroscience.
We provide a range of examples including neural circuits, deep SNN learning and neuromorphic applications.
- Score: 22.133585707508963
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Neuromorphic computing is an emerging research field that aims to develop new
intelligent systems by integrating theories and technologies from
multi-disciplines such as neuroscience and deep learning. Currently, there have
been various software frameworks developed for the related fields, but there is
a lack of an efficient framework dedicated for spike-based computing models and
algorithms. In this work, we present a Python based spiking neural network
(SNN) simulation and training framework, aka SPAIC that aims to support
brain-inspired model and algorithm researches integrated with features from
both deep learning and neuroscience. To integrate different methodologies from
the two overwhelming disciplines, and balance between flexibility and
efficiency, SPAIC is designed with neuroscience-style frontend and deep
learning backend structure. We provide a wide range of examples including
neural circuits Simulation, deep SNN learning and neuromorphic applications,
demonstrating the concise coding style and wide usability of our framework. The
SPAIC is a dedicated spike-based artificial intelligence computing platform,
which will significantly facilitate the design, prototype and validation of new
models, theories and applications. Being user-friendly, flexible and
high-performance, it will help accelerate the rapid growth and wide
applicability of neuromorphic computing research.
Related papers
- Enhancing learning in spiking neural networks through neuronal heterogeneity and neuromodulatory signaling [52.06722364186432]
We propose a biologically-informed framework for enhancing artificial neural networks (ANNs)
Our proposed dual-framework approach highlights the potential of spiking neural networks (SNNs) for emulating diverse spiking behaviors.
We outline how the proposed approach integrates brain-inspired compartmental models and task-driven SNNs, bioinspiration and complexity.
arXiv Detail & Related papers (2024-07-05T14:11:28Z) - Mechanistic Neural Networks for Scientific Machine Learning [58.99592521721158]
We present Mechanistic Neural Networks, a neural network design for machine learning applications in the sciences.
It incorporates a new Mechanistic Block in standard architectures to explicitly learn governing differential equations as representations.
Central to our approach is a novel Relaxed Linear Programming solver (NeuRLP) inspired by a technique that reduces solving linear ODEs to solving linear programs.
arXiv Detail & Related papers (2024-02-20T15:23:24Z) - SpikingJelly: An open-source machine learning infrastructure platform
for spike-based intelligence [51.6943465041708]
Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency.
We contribute a full-stack toolkit for pre-processing neuromorphic datasets, building deep SNNs, optimizing their parameters, and deploying SNNs on neuromorphic chips.
arXiv Detail & Related papers (2023-10-25T13:15:17Z) - A Hybrid Neural Coding Approach for Pattern Recognition with Spiking
Neural Networks [53.31941519245432]
Brain-inspired spiking neural networks (SNNs) have demonstrated promising capabilities in solving pattern recognition tasks.
These SNNs are grounded on homogeneous neurons that utilize a uniform neural coding for information representation.
In this study, we argue that SNN architectures should be holistically designed to incorporate heterogeneous coding schemes.
arXiv Detail & Related papers (2023-05-26T02:52:12Z) - Implementing Spiking Neural Networks on Neuromorphic Architectures: A
Review [0.19573380763700707]
We highlight challenges and opportunities that the future holds in the area of system software technology for neuromorphic computing.
We provide a comprehensive overview of such frameworks proposed for both, platform-based design and hardware-software co-design.
arXiv Detail & Related papers (2022-02-17T21:00:59Z) - Mapping and Validating a Point Neuron Model on Intel's Neuromorphic
Hardware Loihi [77.34726150561087]
We investigate the potential of Intel's fifth generation neuromorphic chip - Loihi'
Loihi is based on the novel idea of Spiking Neural Networks (SNNs) emulating the neurons in the brain.
We find that Loihi replicates classical simulations very efficiently and scales notably well in terms of both time and energy performance as the networks get larger.
arXiv Detail & Related papers (2021-09-22T16:52:51Z) - NeuroXplorer 1.0: An Extensible Framework for Architectural Exploration
with Spiking Neural Networks [3.9121275263540087]
We present NeuroXplorer, a framework that is based on a generalized template for modeling a neuromorphic architecture.
NeuroXplorer can perform both low-level cycle-accurate architectural simulations and high-level analysis with data-flow abstractions.
We demonstrate the architectural exploration capabilities of NeuroXplorer through case studies with many state-of-the-art machine learning models.
arXiv Detail & Related papers (2021-05-04T23:31:11Z) - A deep learning theory for neural networks grounded in physics [2.132096006921048]
We argue that building large, fast and efficient neural networks on neuromorphic architectures requires rethinking the algorithms to implement and train them.
Our framework applies to a very broad class of models, namely systems whose state or dynamics are described by variational equations.
arXiv Detail & Related papers (2021-03-18T02:12:48Z) - Brain-Inspired Learning on Neuromorphic Substrates [5.279475826661643]
This article provides a mathematical framework for the design of practical online learning algorithms for neuromorphic substrates.
Specifically, we show a direct connection between Real-Time Recurrent Learning (RTRL) and biologically plausible learning rules for training Spiking Neural Networks (SNNs)
We motivate a sparse approximation based on block-diagonal Jacobians, which reduces the algorithm's computational complexity.
arXiv Detail & Related papers (2020-10-22T17:56:59Z) - Spiking Neural Networks Hardware Implementations and Challenges: a
Survey [53.429871539789445]
Spiking Neural Networks are cognitive algorithms mimicking neuron and synapse operational principles.
We present the state of the art of hardware implementations of spiking neural networks.
We discuss the strategies employed to leverage the characteristics of these event-driven algorithms at the hardware level.
arXiv Detail & Related papers (2020-05-04T13:24:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.