Towards Embodied AI with MuscleMimic: Unlocking full-body musculoskeletal motor learning at scale

• URL: http://arxiv.org/abs/2603.25544v1
• Date: Thu, 26 Mar 2026 15:18:37 GMT
• Title: Towards Embodied AI with MuscleMimic: Unlocking full-body musculoskeletal motor learning at scale
• Abstract summary: MuscleMimic is an open-source framework for motion imitation learning with physiologically realistic, muscle-driven models.<n>By lowering the computational and data barriers to musculoskeletal simulation, MuscleMimic enables systematic model validation across diverse dynamic movements.
• Score: 38.15316304510102
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Learning motor control for muscle-driven musculoskeletal models is hindered by the computational cost of biomechanically accurate simulation and the scarcity of validated, open full-body models. Here we present MuscleMimic, an open-source framework for scalable motion imitation learning with physiologically realistic, muscle-actuated humanoids. MuscleMimic provides two validated musculoskeletal embodiments - a fixed-root upper-body model (126 muscles) for bimanual manipulation and a full-body model (416 muscles) for locomotion - together with a retargeting pipeline that maps SMPL-format motion capture data onto musculoskeletal structures while preserving kinematic and dynamic consistency. Leveraging massively parallel GPU simulation, the framework achieves order-of-magnitude training speedups over prior CPU-based approaches while maintaining comprehensive collision handling, enabling a single generalist policy to be trained on hundreds of diverse motions within days. The resulting policy faithfully reproduces a broad repertoire of human movements under full muscular control and can be fine-tuned to novel motions within hours. Biomechanical validation against experimental walking and running data demonstrates strong agreement in joint kinematics (mean correlation r = 0.90), while muscle activation analysis reveals both the promise and fundamental challenges of achieving physiological fidelity through kinematic imitation alone. By lowering the computational and data barriers to musculoskeletal simulation, MuscleMimic enables systematic model validation across diverse dynamic movements and broader participation in neuromuscular control research. Code, models, checkpoints, and retargeted datasets are available at: https://github.com/amathislab/musclemimic

Related papers

• SOMA: From Surface Observations to Muscle Anatomy [55.23576061150391]
  We present SOMA, a person-specific model that infers bio-temporal muscle behavior from surface signals obtained using RGB cameras.<n>We show how our method provides anatomically grounded animations without the complexity of traditional simulations.
  arXiv  Detail & Related papers  (2026-06-08T09:20:46Z)
• MyoChallenge 2025: A New Benchmark for Human Athletic Intelligence [57.70335388371609]
  MyoChallenge at NeurIPS 2025 established a pioneering benchmark for motor control intelligence in sports.<n>High-fidelity musculoskeletal models within physics simulation combined with machine learning-driven algorithms.<n>Challenge attracted almost 70 teams and over 560 submissions globally.
  arXiv  Detail & Related papers  (2026-05-15T06:09:44Z)
• Scaling Whole-Body Human Musculoskeletal Behavior Emulation for Specificity and Diversity [11.002363474183683]
  We introduce a large-scale parallel musculoskeletal computation framework for biomechanically grounded whole-body motion reproduction.<n>It achieves high joint angle accuracy and body position alignment for highly dynamic tasks such as dance, cartwheel, and backflip.<n>This work establishes a tractable computational route to analyzing the specificity and diversity underlying human embodied control of movement.
  arXiv  Detail & Related papers  (2026-03-31T06:55:10Z)
• Learning Physics from Pretrained Video Models: A Multimodal Continuous and Sequential World Interaction Models for Robotic Manipulation [63.04810454548667]
  We introduce PhysGen, a scalable continuous and sequential world interaction framework to solve robotic manipulation tasks.<n>By treating the pretrained video model as a proxy for a physics simulator, PhysGen models the dynamic interplay between the external environment and robot actions.<n>We introduce a multimodal continuous representation that unifies video and action into shared physical tokens, bridging the gap between discrete video generation and continuous robotic control.
  arXiv  Detail & Related papers  (2026-02-18T14:58:18Z)
• Massively Parallel Imitation Learning of Mouse Forelimb Musculoskeletal Reaching Dynamics [0.5487412578664687]
  We present a pipeline for taking kinematics data from the neuroscience lab and creating a pipeline for recapitulating those natural movements in a biomechanical model.<n>We implement a imitation learning framework to perform a dexterous forelimb reaching task with a musculoskeletal model in a simulated physics environment.
  arXiv  Detail & Related papers  (2025-11-26T19:23:14Z)
• Musculoskeletal simulation of limb movement biomechanics in Drosophila melanogaster [32.89880065783502]
  We introduce the first 3D, data-driven musculoskeletal model of Drosophila legs.<n>Our model incorporates a Hill-type muscle representation based on high-resolution X-ray scans from multiple fixed specimens.<n>Our model enables the investigation of motor control in an experimentally tractable model organism.
  arXiv  Detail & Related papers  (2025-09-08T08:21:14Z)
• Reinforcement learning-based motion imitation for physiologically plausible musculoskeletal motor control [47.423243831156285]
  We present a model-free motion imitation framework (KINESIS) to advance the understanding of muscle-based motor control.<n>We demonstrate that KINESIS achieves strong imitation performance on 1.9 hours of motion capture data.<n>KINESIS generates muscle activity patterns that correlate well with human EMG activity.
  arXiv  Detail & Related papers  (2025-03-18T18:37:49Z)
• Muscles in Time: Learning to Understand Human Motion by Simulating Muscle Activations [64.98299559470503]
  Muscles in Time (MinT) is a large-scale synthetic muscle activation dataset. It contains over nine hours of simulation data covering 227 subjects and 402 simulated muscle strands. We show results on neural network-based muscle activation estimation from human pose sequences.
  arXiv  Detail & Related papers  (2024-10-31T18:28:53Z)
• MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraints [50.61346764110482]
  We integrate a musculoskeletal system with a learnable parametric hand model, MANO, to create MS-MANO. This model emulates the dynamics of muscles and tendons to drive the skeletal system, imposing physiologically realistic constraints on the resulting torque trajectories. We also propose a simulation-in-the-loop pose refinement framework, BioPR, that refines the initial estimated pose through a multi-layer perceptron network.
  arXiv  Detail & Related papers  (2024-04-16T02:18:18Z)
• Conditional Generative Models for Simulation of EMG During Naturalistic Movements [45.698312905115955]
  We present a conditional generative neural network trained adversarially to generate motor unit activation potential waveforms. We demonstrate the ability of such a model to predictively interpolate between a much smaller number of numerical model's outputs with a high accuracy.
  arXiv  Detail & Related papers  (2022-11-03T14:49:02Z)
• Reinforcement Learning of Musculoskeletal Control from Functional Simulations [3.94716580540538]
  In this work, a deep reinforcement learning (DRL) based inverse dynamics controller is trained to control muscle activations of a biomechanical model of the human shoulder. Results are presented for a single-axis motion control of shoulder abduction for the task of following randomly generated angular trajectories.
  arXiv  Detail & Related papers  (2020-07-13T20:20:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.