Closed-loop spiking control on a neuromorphic processor implemented on the iCub

• URL: http://arxiv.org/abs/2009.09081v1
• Date: Tue, 1 Sep 2020 14:17:48 GMT
• Title: Closed-loop spiking control on a neuromorphic processor implemented on the iCub
• Authors: Jingyue Zhao, Nicoletta Risi, Marco Monforte, Chiara Bartolozzi, Giacomo Indiveri, and Elisa Donati
• Abstract summary: We present a closed-loop motor controller implemented on mixed-signal analog-digital neuromorphic hardware. The network performs a proportional control action by encoding target, feedback, and error signals. We optimize the network structure to make it more robust to noisy inputs and device mismatch.
• Score: 4.1388807795505365
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite neuromorphic engineering promises the deployment of low latency, adaptive and low power systems that can lead to the design of truly autonomous artificial agents, the development of a fully neuromorphic artificial agent is still missing. While neuromorphic sensing and perception, as well as decision-making systems, are now mature, the control and actuation part is lagging behind. In this paper, we present a closed-loop motor controller implemented on mixed-signal analog-digital neuromorphic hardware using a spiking neural network. The network performs a proportional control action by encoding target, feedback, and error signals using a spiking relational network. It continuously calculates the error through a connectivity pattern, which relates the three variables by means of feed-forward connections. Recurrent connections within each population are used to speed up the convergence, decrease the effect of mismatch and improve selectivity. The neuromorphic motor controller is interfaced with the iCub robot simulator. We tested our spiking P controller in a single joint control task, specifically for the robot head yaw. The spiking controller sends the target positions, reads the motor state from its encoder, and sends back the motor commands to the joint. The performance of the spiking controller is tested in a step response experiment and in a target pursuit task. In this work, we optimize the network structure to make it more robust to noisy inputs and device mismatch, which leads to better control performances.

Related papers

• Function Approximation for Reinforcement Learning Controller for Energy from Spread Waves [69.9104427437916]
  Multi-generator Wave Energy Converters (WEC) must handle multiple simultaneous waves coming from different directions called spread waves. These complex devices need controllers with multiple objectives of energy capture efficiency, reduction of structural stress to limit maintenance, and proactive protection against high waves. In this paper, we explore different function approximations for the policy and critic networks in modeling the sequential nature of the system dynamics.
  arXiv  Detail & Related papers  (2024-04-17T02:04:10Z)
• Leveraging Low-Rank and Sparse Recurrent Connectivity for Robust Closed-Loop Control [63.310780486820796]
  We show how a parameterization of recurrent connectivity influences robustness in closed-loop settings. We find that closed-form continuous-time neural networks (CfCs) with fewer parameters can outperform their full-rank, fully-connected counterparts.
  arXiv  Detail & Related papers  (2023-10-05T21:44:18Z)
• Neuromorphic Control using Input-Weighted Threshold Adaptation [13.237124392668573]
  It is still challenging to replicate even basic low-level controllers such as proportional-integral-derivative (PID) controllers. We propose a neuromorphic controller that incorporates proportional, integral, and derivative pathways during learning. We demonstrate the stability of our bio-inspired algorithm with flights in the presence of disturbances.
  arXiv  Detail & Related papers  (2023-04-18T07:21:24Z)
• Active Predicting Coding: Brain-Inspired Reinforcement Learning for Sparse Reward Robotic Control Problems [79.07468367923619]
  We propose a backpropagation-free approach to robotic control through the neuro-cognitive computational framework of neural generative coding (NGC) We design an agent built completely from powerful predictive coding/processing circuits that facilitate dynamic, online learning from sparse rewards. We show that our proposed ActPC agent performs well in the face of sparse (extrinsic) reward signals and is competitive with or outperforms several powerful backprop-based RL approaches.
  arXiv  Detail & Related papers  (2022-09-19T16:49:32Z)
• Neural optimal feedback control with local learning rules [67.5926699124528]
  A major problem in motor control is understanding how the brain plans and executes proper movements in the face of delayed and noisy stimuli. We introduce a novel online algorithm which combines adaptive Kalman filtering with a model free control approach.
  arXiv  Detail & Related papers  (2021-11-12T20:02:00Z)
• Design and implementation of a parsimonious neuromorphic PID for onboard altitude control for MAVs using neuromorphic processors [3.7384509727711923]
  Low-level controllers are often neglected and remain outside of the neuromorphic loop. We propose a parsimonious and adjustable neuromorphic PID controller, endowed with a minimal number of 93 neurons. Our results confirm the suitability of such low-level neuromorphic controllers, ultimately with a very high update frequency.
  arXiv  Detail & Related papers  (2021-09-21T14:27:11Z)
• Online-Learning Deep Neuro-Adaptive Dynamic Inversion Controller for Model Free Control [1.3764085113103217]
  A neuro-adaptive controller is implemented featuring a deep neural network trained on a new weight update law. The controller is able to learn the nonlinear plant quickly and displays good performance in the tracking control problem.
  arXiv  Detail & Related papers  (2021-07-21T22:46:03Z)
• Neuromorphic adaptive spiking CPG towards bio-inspired locomotion of legged robots [58.720142291102135]
  Spiking Central Pattern Generator generates different locomotion patterns driven by an external stimulus. The locomotion of the end robotic platform (any-legged robot) can be adapted to the terrain by using any sensor as input.
  arXiv  Detail & Related papers  (2021-01-24T12:44:38Z)
• Robust trajectory generation for robotic control on the neuromorphic research chip Loihi [0.0]
  We exploit a recently developed spiking neural network model, the so-called anisotropic network. We show that the anisotropic network on Loihi reliably encodes sequential patterns of neural activity. Taken together, our study presents a new algorithm that allows the generation of complex robotic movements.
  arXiv  Detail & Related papers  (2020-08-26T16:02:39Z)
• Populations of Spiking Neurons for Reservoir Computing: Closed Loop Control of a Compliant Quadruped [64.64924554743982]
  We present a framework for implementing central pattern generators with spiking neural networks to obtain closed loop robot control. We demonstrate the learning of predefined gait patterns, speed control and gait transition on a simulated model of a compliant quadrupedal robot.
  arXiv  Detail & Related papers  (2020-04-09T14:32:49Z)
• On robot compliance. A cerebellar control approach [0.0]
  The work presented here is a novel biological approach for the compliant control of a robotic arm in real time (RT) We integrate a spiking cerebellar network at the core of a feedback control loop performing torque-driven control. We prove that our compliant approach outperforms the accuracy of the default factory-installed position control in a set of tasks used for addressing cerebellar motor behavior.
  arXiv  Detail & Related papers  (2020-03-02T17:06:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.