Reflex-Informed Neuromuscular Reinforcement Learning for Muscle-Driven Locomotion

• URL: http://arxiv.org/abs/2609.11733v1
• Date: Thu, 10 Sep 2026 15:47:26 GMT
• Title: Reflex-Informed Neuromuscular Reinforcement Learning for Muscle-Driven Locomotion
• Abstract summary: We propose a Reflex-Informed Neuromuscular Reinforcement Learning framework for muscle-driven locomotion.<n> Experimental results demonstrate that the proposed framework generates physiologically plausible locomotion.
• Score: 14.483874273316728
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Muscle-driven locomotion provides a physically grounded approach to generating realistic human movement. However, achieving both physiological plausibility and adaptability to changes in musculoskeletal capacity and external disturbances remains a fundamental challenge. To address this limitation, we propose a Reflex-Informed Neuromuscular Reinforcement Learning framework for muscle-driven locomotion. Within this framework, a fixed phase-dependent reflex controller serves as the underlying neuromuscular control mechanism, while the reinforcement learning policy produces four biomechanically meaningful residual parameters to modulate key reflex gains and thresholds associated with hip swing, knee support, and ankle propulsion according to the current state. Experimental results demonstrate that the proposed framework generates physiologically plausible locomotion with improved kinematic accuracy and dynamic consistency, as well as better bilateral symmetry and stride-to-stride consistency under nominal walking conditions. The learned policy remains robust under muscle weakness and external perturbations without retraining.

Related papers

• MyoChallenge 2025: A New Benchmark for Human Athletic Intelligence [57.70335388371609]
  MyoChallenge at NeurIPS 2025 established a pioneering benchmark for motor control intelligence in sports.<n>High-fidelity musculoskeletal models within physics simulation combined with machine learning-driven algorithms.<n>Challenge attracted almost 70 teams and over 560 submissions globally.
  arXiv  Detail & Related papers  (2026-05-15T06:09:44Z)
• Learn Weightlessness: Imitate Non-Self-Stabilizing Motions on Humanoid Robot [56.377161933570335]
  Humans naturally exploit a "weightless" state during non-self-stabilizing (NSS) motions.<n>Inspired by this biological mechanism, we propose a weightlessness-state auto-labeling strategy for dataset annotation.<n>Our work bridges the gap between precise trajectory tracking and adaptive environmental interaction, offering a biologically-inspired solution for contact-rich humanoid control.
  arXiv  Detail & Related papers  (2026-04-23T07:10:05Z)
• Musculoskeletal Motion Imitation for Learning Personalized Exoskeleton Control Policy in Impaired Gait [1.224954637705144]
  We introduce a device-agnostic framework to enable scalable personalized exoskeleton assistance for both able-bodied and clinical populations.<n>Our control policies generate physiologically plausible locomotion dynamics and capture clinically observed compensatory strategies under targeted muscular deficits.<n>Without task-specific tuning, the resulting exoskeleton control policies produce assistive torque profiles at the hip and ankle that align with state-of-the-art profiles validated in human experiments.
  arXiv  Detail & Related papers  (2026-04-10T15:49:24Z)
• Muscle Synergy Priors Enhance Biomechanical Fidelity in Predictive Musculoskeletal Locomotion Simulation [0.0]
  Human locomotion emerges from high-dimensional neuromuscular control, making predictive musculoskeletal simulation challenging.<n>We present a physiology-informed reinforcement-learning framework that constrains control using muscle synergies.<n>These results show that embedding neurophysiological structure into reinforcement learning can improve biomechanical fidelity and generalization in predictive human locomotion simulation with limited experimental data.
  arXiv  Detail & Related papers  (2026-03-11T06:48:15Z)
• Safe Whole-Body Loco-Manipulation via Combined Model and Learning-based Control [46.47619556874003]
  We propose a whole-body controller that combines a model-based admittance control for the manipulator arm with a Reinforcement Learning policy for legged locomotion.<n>The admittance controller maps external wrenches--such as those applied by a human during physical interaction--into desired end-effector velocities, allowing for compliant behavior.<n>We validate our approach in both simulation and hardware using the Unitree Go2 quadruped robot with a 6-DoF arm and wrist-mounted 6-DoF Force/Torque sensor.
  arXiv  Detail & Related papers  (2026-03-02T22:31:12Z)
• Coordinating Spinal and Limb Dynamics for Enhanced Sprawling Robot Mobility [0.047116288835793156]
  A flexible spine enables undulation of the body through a wavelike motion along the spine, aiding navigation over uneven terrains and obstacles.<n>Environmental uncertainties, such as surface irregularities and variations in friction, can significantly disrupt body-limb coordination.<n>Deep reinforcement learning offers a promising framework for handling non-deterministic environments.<n>We comparatively examine learning-based control strategies and biologically inspired gait design methods on a salamander-like robot.
  arXiv  Detail & Related papers  (2025-04-18T23:08:48Z)
• Reinforcement learning-based motion imitation for physiologically plausible musculoskeletal motor control [47.423243831156285]
  We present a model-free motion imitation framework (KINESIS) to advance the understanding of muscle-based motor control.<n>We demonstrate that KINESIS achieves strong imitation performance on 1.9 hours of motion capture data.<n>KINESIS generates muscle activity patterns that correlate well with human EMG activity.
  arXiv  Detail & Related papers  (2025-03-18T18:37:49Z)
• Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning [54.26816599309778]
  We propose a novel whole-body locomotion algorithm based on dynamic balance and Reinforcement Learning (RL)<n> Specifically, we introduce a dynamic balance mechanism by leveraging an extended measure of Zero-Moment Point (ZMP)-driven rewards and task-driven rewards in a whole-body actor-critic framework.<n> Experiments conducted on a full-sized Unitree H1-2 robot verify the ability of our method to maintain balance on extremely narrow terrains.
  arXiv  Detail & Related papers  (2025-02-24T14:53:45Z)
• Natural and Robust Walking using Reinforcement Learning without Demonstrations in High-Dimensional Musculoskeletal Models [29.592874007260342]
  Humans excel at robust bipedal walking in complex natural environments. It is still not fully understood how the nervous system resolves the musculoskeletal redundancy to solve the multi-objective control problem.
  arXiv  Detail & Related papers  (2023-09-06T13:20:31Z)
• Skeleton2Humanoid: Animating Simulated Characters for Physically-plausible Motion In-betweening [59.88594294676711]
  Modern deep learning based motion synthesis approaches barely consider the physical plausibility of synthesized motions. We propose a system Skeleton2Humanoid'' which performs physics-oriented motion correction at test time. Experiments on the challenging LaFAN1 dataset show our system can outperform prior methods significantly in terms of both physical plausibility and accuracy.
  arXiv  Detail & Related papers  (2022-10-09T16:15:34Z)
• Learning Control Policies for Imitating Human Gaits [2.28438857884398]
  Humans exhibit movements like walking, running, and jumping in the most efficient manner, which served as the source of motivation for this project. Skeletal and Musculoskeletal human models were considered for motions in the sagittal plane. Model-free reinforcement learning algorithms were used to optimize inverse dynamics control actions.
  arXiv  Detail & Related papers  (2021-05-15T16:33:24Z)
• Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots [121.42930679076574]
  We present a model-free reinforcement learning framework for training robust locomotion policies in simulation. domain randomization is used to encourage the policies to learn behaviors that are robust across variations in system dynamics. We demonstrate this on versatile walking behaviors such as tracking a target walking velocity, walking height, and turning yaw.
  arXiv  Detail & Related papers  (2021-03-26T07:14:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.