Collective control of modular soft robots via embodied Spiking Neural Cellular Automata

• URL: http://arxiv.org/abs/2204.02099v1
• Date: Tue, 5 Apr 2022 10:42:57 GMT
• Title: Collective control of modular soft robots via embodied Spiking Neural Cellular Automata
• Authors: Giorgia Nadizar, Eric Medvet, Stefano Nichele, Sidney Pontes-Filho
• Abstract summary: Voxel-based Soft Robots (VSRs) are a form of modular soft robots, composed of several deformable cubes, i.e., voxels. We propose a novel form of collective control, influenced by Neural Cellular Automata (NCA) and based on the bio-inspired Spiking Neural Networks: the embodied Spiking NCA.
• Score: 1.0323063834827415
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Voxel-based Soft Robots (VSRs) are a form of modular soft robots, composed of several deformable cubes, i.e., voxels. Each VSR is thus an ensemble of simple agents, namely the voxels, which must cooperate to give rise to the overall VSR behavior. Within this paradigm, collective intelligence plays a key role in enabling the emerge of coordination, as each voxel is independently controlled, exploiting only the local sensory information together with some knowledge passed from its direct neighbors (distributed or collective control). In this work, we propose a novel form of collective control, influenced by Neural Cellular Automata (NCA) and based on the bio-inspired Spiking Neural Networks: the embodied Spiking NCA (SNCA). We experiment with different variants of SNCA, and find them to be competitive with the state-of-the-art distributed controllers for the task of locomotion. In addition, our findings show significant improvement with respect to the baseline in terms of adaptability to unforeseen environmental changes, which could be a determining factor for physical practicability of VSRs.

Related papers

• Spiking Neural Networks as a Controller for Emergent Swarm Agents [8.816729033097868]
  Existing research explores the possible emergent behaviors in swarms of robots with only a binary sensor and a simple but hand-picked controller structure. This paper investigates the feasibility of training spiking neural networks to find those local interaction rules that result in particular emergent behaviors.
  arXiv  Detail & Related papers  (2024-10-21T16:41:35Z)
• Exploring Latent Pathways: Enhancing the Interpretability of Autonomous Driving with a Variational Autoencoder [79.70947339175572]
  A bio-inspired neural circuit policy model has emerged as an innovative control module. We take a leap forward by integrating a variational autoencoder with the neural circuit policy controller. In addition to the architectural shift toward a variational autoencoder, this study introduces the automatic latent perturbation tool.
  arXiv  Detail & Related papers  (2024-04-02T09:05:47Z)
• Leveraging Low-Rank and Sparse Recurrent Connectivity for Robust Closed-Loop Control [63.310780486820796]
  We show how a parameterization of recurrent connectivity influences robustness in closed-loop settings. We find that closed-form continuous-time neural networks (CfCs) with fewer parameters can outperform their full-rank, fully-connected counterparts.
  arXiv  Detail & Related papers  (2023-10-05T21:44:18Z)
• Decentralized Motor Skill Learning for Complex Robotic Systems [5.669790037378093]
  We propose a Decentralized motor skill (DEMOS) learning algorithm to automatically discover motor groups that can be decoupled from each other. Our method improves the robustness and generalization of the policy without sacrificing performance. Experiments on quadruped and humanoid robots demonstrate that the learned policy is robust against local motor malfunctions and can be transferred to new tasks.
  arXiv  Detail & Related papers  (2023-06-30T05:55:34Z)
• Low-Rank Modular Reinforcement Learning via Muscle Synergy [25.120547719120765]
  Modular Reinforcement Learning (RL) decentralizes the control of multi-joint robots by learning policies for each actuator. We propose a Synergy-Oriented LeARning (SOLAR) framework that exploits the redundant nature of DoF in robot control.
  arXiv  Detail & Related papers  (2022-10-26T16:01:31Z)
• DMAP: a Distributed Morphological Attention Policy for Learning to Locomote with a Changing Body [126.52031472297413]
  We introduce DMAP, a biologically-inspired, attention-based policy network architecture. We show that a control policy based on the proprioceptive state performs poorly with highly variable body configurations. DMAP can be trained end-to-end in all the considered environments, overall matching or surpassing the performance of an oracle agent.
  arXiv  Detail & Related papers  (2022-09-28T16:45:35Z)
• The Sensory Neuron as a Transformer: Permutation-Invariant Neural Networks for Reinforcement Learning [11.247894240593691]
  We build systems that feed each sensory input from the environment into distinct, but identical neural networks. We show that these sensory networks can be trained to integrate information received locally, and through communication via an attention mechanism, can collectively produce a globally coherent policy.
  arXiv  Detail & Related papers  (2021-09-07T05:12:50Z)
• Neuromorphic adaptive spiking CPG towards bio-inspired locomotion of legged robots [58.720142291102135]
  Spiking Central Pattern Generator generates different locomotion patterns driven by an external stimulus. The locomotion of the end robotic platform (any-legged robot) can be adapted to the terrain by using any sensor as input.
  arXiv  Detail & Related papers  (2021-01-24T12:44:38Z)
• Deep Imitation Learning for Bimanual Robotic Manipulation [70.56142804957187]
  We present a deep imitation learning framework for robotic bimanual manipulation. A core challenge is to generalize the manipulation skills to objects in different locations. We propose to (i) decompose the multi-modal dynamics into elemental movement primitives, (ii) parameterize each primitive using a recurrent graph neural network to capture interactions, and (iii) integrate a high-level planner that composes primitives sequentially and a low-level controller to combine primitive dynamics and inverse kinematics control.
  arXiv  Detail & Related papers  (2020-10-11T01:40:03Z)
• Closed-loop spiking control on a neuromorphic processor implemented on the iCub [4.1388807795505365]
  We present a closed-loop motor controller implemented on mixed-signal analog-digital neuromorphic hardware. The network performs a proportional control action by encoding target, feedback, and error signals. We optimize the network structure to make it more robust to noisy inputs and device mismatch.
  arXiv  Detail & Related papers  (2020-09-01T14:17:48Z)
• Populations of Spiking Neurons for Reservoir Computing: Closed Loop Control of a Compliant Quadruped [64.64924554743982]
  We present a framework for implementing central pattern generators with spiking neural networks to obtain closed loop robot control. We demonstrate the learning of predefined gait patterns, speed control and gait transition on a simulated model of a compliant quadrupedal robot.
  arXiv  Detail & Related papers  (2020-04-09T14:32:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.