Neurosim: A Fast Simulator for Neuromorphic Robot Perception

• URL: http://arxiv.org/abs/2602.15018v1
• Date: Mon, 16 Feb 2026 18:57:04 GMT
• Title: Neurosim: A Fast Simulator for Neuromorphic Robot Perception
• Authors: Richeek Das, Pratik Chaudhari,
• Abstract summary: Neurosim is a high-performance library for simulating sensors.<n>It can achieve frame rates as high as FPS on a desktop GPU.<n>It integrates with a ZeroMQ-based communication library called Cortex.
• Score: 18.380205726829356
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Neurosim is a fast, real-time, high-performance library for simulating sensors such as dynamic vision sensors, RGB cameras, depth sensors, and inertial sensors. It can also simulate agile dynamics of multi-rotor vehicles in complex and dynamic environments. Neurosim can achieve frame rates as high as ~2700 FPS on a desktop GPU. Neurosim integrates with a ZeroMQ-based communication library called Cortex to facilitate seamless integration with machine learning and robotics workflows. Cortex provides a high-throughput, low-latency message-passing system for Python and C++ applications, with native support for NumPy arrays and PyTorch tensors. This paper discusses the design philosophy behind Neurosim and Cortex. It demonstrates how they can be used to (i) train neuromorphic perception and control algorithms, e.g., using self-supervised learning on time-synchronized multi-modal data, and (ii) test real-time implementations of these algorithms in closed-loop. Neurosim and Cortex are available at https://github.com/grasp-lyrl/neurosim .

Related papers

• GaussGym: An open-source real-to-sim framework for learning locomotion from pixels [78.05453137978132]
  We present a novel approach for photorealistic robot simulation that integrates 3D Gaussian Splatting as a drop-in within vectorized physics simulators.<n>This enables unprecedented speed -- exceeding 100,000 steps per second on consumer GPU.<n>We additionally demonstrate its applicability in a sim-to-real robotics setting.
  arXiv  Detail & Related papers  (2025-10-17T06:34:52Z)
• Neuroprobe: Evaluating Intracranial Brain Responses to Naturalistic Stimuli [13.536940903353768]
  High-resolution neural datasets enable foundation models for the next generation of brain-computer interfaces and neurological treatments.<n>Neuroprobe is a suite of decoding tasks for studying multi-modal language processing in the brain.<n>Neuroprobe is built on the BrainTreebank dataset, which consists of 40 hours of iEEG recordings from 10 human subjects performing a naturalistic movie viewing task.
  arXiv  Detail & Related papers  (2025-09-25T22:38:53Z)
• An Integrated Toolbox for Creating Neuromorphic Edge Applications [3.671692919685993]
  Spiking Neural Networks (SNNs) and neuromorphic models are more efficient and have more biological realism. CARLsim++ is an integrated toolbox that enables fast and easy creation of neuromorphic applications.
  arXiv  Detail & Related papers  (2024-04-12T16:34:55Z)
• Single Neuromorphic Memristor closely Emulates Multiple Synaptic Mechanisms for Energy Efficient Neural Networks [71.79257685917058]
  We demonstrate memristive nano-devices based on SrTiO3 that inherently emulate all these synaptic functions. These memristors operate in a non-filamentary, low conductance regime, which enables stable and energy efficient operation.
  arXiv  Detail & Related papers  (2024-02-26T15:01:54Z)
• SuperNeuro: A Fast and Scalable Simulator for Neuromorphic Computing [0.0]
  SuperNeuro is a fast and scalable simulator for neuromorphic computing. We demonstrate that SuperNeuro can be approximately 10--300 times faster than some of the other simulators for small sparse networks.
  arXiv  Detail & Related papers  (2023-05-04T02:43:01Z)
• Visual Odometry with Neuromorphic Resonator Networks [9.903137966539898]
  Visual Odometry (VO) is a method to estimate self-motion of a mobile robot using visual sensors. Neuromorphic hardware offers low-power solutions to many vision and AI problems. We present a modular neuromorphic algorithm that achieves state-of-the-art performance on two-dimensional VO tasks.
  arXiv  Detail & Related papers  (2022-09-05T14:57:03Z)
• Neuromorphic Artificial Intelligence Systems [58.1806704582023]
  Modern AI systems, based on von Neumann architecture and classical neural networks, have a number of fundamental limitations in comparison with the brain. This article discusses such limitations and the ways they can be mitigated. It presents an overview of currently available neuromorphic AI projects in which these limitations are overcome.
  arXiv  Detail & Related papers  (2022-05-25T20:16:05Z)
• Mapping and Validating a Point Neuron Model on Intel's Neuromorphic Hardware Loihi [77.34726150561087]
  We investigate the potential of Intel's fifth generation neuromorphic chip - Loihi' Loihi is based on the novel idea of Spiking Neural Networks (SNNs) emulating the neurons in the brain. We find that Loihi replicates classical simulations very efficiently and scales notably well in terms of both time and energy performance as the networks get larger.
  arXiv  Detail & Related papers  (2021-09-22T16:52:51Z)
• A toolbox for neuromorphic sensing in robotics [4.157415305926584]
  We introduce a ROS (Robot Operating System) toolbox to encode and decode input signals coming from any type of sensor available on a robot. This initiative is meant to stimulate and facilitate robotic integration of neuromorphic AI.
  arXiv  Detail & Related papers  (2021-03-03T23:22:05Z)
• Neuroevolution of a Recurrent Neural Network for Spatial and Working Memory in a Simulated Robotic Environment [57.91534223695695]
  We evolved weights in a biologically plausible recurrent neural network (RNN) using an evolutionary algorithm to replicate the behavior and neural activity observed in rats. Our method demonstrates how the dynamic activity in evolved RNNs can capture interesting and complex cognitive behavior.
  arXiv  Detail & Related papers  (2021-02-25T02:13:52Z)
• Nengo and low-power AI hardware for robust, embedded neurorobotics [6.574517227976925]
  We identify four primary challenges in building robust, embedded neurorobotic systems. We present two examples using Nengo to develop neural networks that run on CPU, GPU, and Intel's neuromorphic chip, Loihi.
  arXiv  Detail & Related papers  (2020-07-20T16:17:27Z)
• Non-linear Neurons with Human-like Apical Dendrite Activations [81.18416067005538]
  We show that a standard neuron followed by our novel apical dendrite activation (ADA) can learn the XOR logical function with 100% accuracy. We conduct experiments on six benchmark data sets from computer vision, signal processing and natural language processing.
  arXiv  Detail & Related papers  (2020-02-02T21:09:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.