A Spiking Neural Architecture for Coordinating Arm and Locomotor Control

• URL: http://arxiv.org/abs/2606.11034v1
• Date: Tue, 09 Jun 2026 16:05:27 GMT
• Title: A Spiking Neural Architecture for Coordinating Arm and Locomotor Control
• Abstract summary: We present a spiking architecture that coordinates force-based arm control and bipedal locomotion in a simulated humanoid.<n>High-level action selection between locomotor and arm control is mediated by a biologically grounded spiking basal ganglia model.<n>To our knowledge, this is the first integrated spiking controller to combine bipedal locomotion and arm control on a full-scale humanoid platform.
• Score: 1.9980707252644898
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Spiking Neural Networks (SNNs) coupled with neuromorphic hardware offer energy-efficient solutions for humanoid robot control. However, existing SNN-based motor control systems address bipedal locomotion and arm control in isolation, leaving integrated control of both unaddressed. We present a spiking architecture that coordinates force-based arm control and bipedal locomotion in a simulated humanoid, using the Neural Engineering Framework (NEF) and Semantic Pointer Architecture (SPA). High-level action selection between locomotor and arm control is mediated by a biologically grounded spiking basal ganglia model. We validate the system through co-simulation of Nengo, for the neural control, and Isaac Sim, demonstrating successful target reaching, continuous digit drawing, path-following locomotion, and finally, switching between walking and arm control via basal ganglia disinhibition. To our knowledge, this is the first integrated spiking controller to combine bipedal locomotion and arm control on a full-scale humanoid platform. The full spike-based implementation enables future deployment on low-power neuromorphic hardware.

Related papers

• Learning Whole-Body Control for a Salamander Robot [1.321203201549798]
  Amphibious legged robots inspired by salamanders are promising in applications in complex amphibious environments.<n>Most salamander robots relied on central-pattern-generator (CPG)-based and model-based coordination strategies for locomotion control.<n>We employ Reinforcement Learning to map proprioceptive observations and commanded velocities to joint-level actions, allowing coordinated locomotor behaviors to emerge.
  arXiv  Detail & Related papers  (2026-03-17T15:43:15Z)
• ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation [55.467742403416175]
  We introduce a physics-driven neural algorithm that translates large-scale motion capture to humanoid embodiments.<n>We learn a unified multimodal controller that supports both dense references and sparse task specifications.<n>Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception.
  arXiv  Detail & Related papers  (2026-03-03T18:59:29Z)
• Safe Whole-Body Loco-Manipulation via Combined Model and Learning-based Control [46.47619556874003]
  We propose a whole-body controller that combines a model-based admittance control for the manipulator arm with a Reinforcement Learning policy for legged locomotion.<n>The admittance controller maps external wrenches--such as those applied by a human during physical interaction--into desired end-effector velocities, allowing for compliant behavior.<n>We validate our approach in both simulation and hardware using the Unitree Go2 quadruped robot with a 6-DoF arm and wrist-mounted 6-DoF Force/Torque sensor.
  arXiv  Detail & Related papers  (2026-03-02T22:31:12Z)
• Whole-Brain Connectomic Graph Model Enables Whole-Body Locomotion Control in Fruit Fly [12.303046979087192]
  We investigate using the exact neural architecture of an adult fruit fly's brain for the control of its body movement.<n>We develop Fly-connectomic Graph Model (FlyGM), whose static structure is identical to the complete connectome of an adult Drosophila.
  arXiv  Detail & Related papers  (2026-02-20T05:09:28Z)
• Towards spiking analog hardware implementation of a trajectory interpolation mechanism for smooth closed-loop control of a spiking robot arm [41.54924235047016]
  We propose a closed-loop neuromorphic control system for an event-based robotic arm.<n>The proposed system consists of a shifted Winner-Take-All spiking network and a spiking comparator network.<n>To evaluate the system, we implemented and deployed the model on a mixed-signal analog-digital neuromorphic platform.
  arXiv  Detail & Related papers  (2025-01-23T14:11:32Z)
• Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control [106.32794844077534]
  This paper presents a study on using deep reinforcement learning to create dynamic locomotion controllers for bipedal robots. We develop a general control solution that can be used for a range of dynamic bipedal skills, from periodic walking and running to aperiodic jumping and standing. This work pushes the limits of agility for bipedal robots through extensive real-world experiments.
  arXiv  Detail & Related papers  (2024-01-30T10:48:43Z)
• Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots [121.42930679076574]
  We present a model-free reinforcement learning framework for training robust locomotion policies in simulation. domain randomization is used to encourage the policies to learn behaviors that are robust across variations in system dynamics. We demonstrate this on versatile walking behaviors such as tracking a target walking velocity, walking height, and turning yaw.
  arXiv  Detail & Related papers  (2021-03-26T07:14:01Z)
• Learning Quadrupedal Locomotion over Challenging Terrain [68.51539602703662]
  Legged locomotion can dramatically expand the operational domains of robotics. Conventional controllers for legged locomotion are based on elaborate state machines that explicitly trigger the execution of motion primitives and reflexes. Here we present a radically robust controller for legged locomotion in challenging natural environments.
  arXiv  Detail & Related papers  (2020-10-21T19:11:20Z)
• Closed-loop spiking control on a neuromorphic processor implemented on the iCub [4.1388807795505365]
  We present a closed-loop motor controller implemented on mixed-signal analog-digital neuromorphic hardware. The network performs a proportional control action by encoding target, feedback, and error signals. We optimize the network structure to make it more robust to noisy inputs and device mismatch.
  arXiv  Detail & Related papers  (2020-09-01T14:17:48Z)
• Populations of Spiking Neurons for Reservoir Computing: Closed Loop Control of a Compliant Quadruped [64.64924554743982]
  We present a framework for implementing central pattern generators with spiking neural networks to obtain closed loop robot control. We demonstrate the learning of predefined gait patterns, speed control and gait transition on a simulated model of a compliant quadrupedal robot.
  arXiv  Detail & Related papers  (2020-04-09T14:32:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.