Massively Parallel Imitation Learning of Mouse Forelimb Musculoskeletal Reaching Dynamics

• URL: http://arxiv.org/abs/2511.21848v1
• Date: Wed, 26 Nov 2025 19:23:14 GMT
• Title: Massively Parallel Imitation Learning of Mouse Forelimb Musculoskeletal Reaching Dynamics
• Authors: Eric Leonardis, Akira Nagamori, Ayesha Thanawalla, Yuanjia Yang, Joshua Park, Hutton Saunders, Eiman Azim, Talmo Pereira,
• Abstract summary: We present a pipeline for taking kinematics data from the neuroscience lab and creating a pipeline for recapitulating those natural movements in a biomechanical model.<n>We implement a imitation learning framework to perform a dexterous forelimb reaching task with a musculoskeletal model in a simulated physics environment.
• Score: 0.5487412578664687
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The brain has evolved to effectively control the body, and in order to understand the relationship we need to model the sensorimotor transformations underlying embodied control. As part of a coordinated effort, we are developing a general-purpose platform for behavior-driven simulation modeling high fidelity behavioral dynamics, biomechanics, and neural circuit architectures underlying embodied control. We present a pipeline for taking kinematics data from the neuroscience lab and creating a pipeline for recapitulating those natural movements in a biomechanical model. We implement a imitation learning framework to perform a dexterous forelimb reaching task with a musculoskeletal model in a simulated physics environment. The mouse arm model is currently training at faster than 1 million training steps per second due to GPU acceleration with JAX and Mujoco-MJX. We present results that indicate that adding naturalistic constraints on energy and velocity lead to simulated musculoskeletal activity that better predict real EMG signals. This work provides evidence to suggest that energy and control constraints are critical to modeling musculoskeletal motor control.

Related papers

• MIMIC-MJX: Neuromechanical Emulation of Animal Behavior [4.293092689005449]
  MIMIC-MJX is a framework for learning biologically-plausible neural control policies from kinematics.<n>Our implementation is accurate, fast, data-efficient, and generalizable to diverse animal body models.
  arXiv  Detail & Related papers  (2025-11-25T17:34:38Z)
• Musculoskeletal simulation of limb movement biomechanics in Drosophila melanogaster [32.89880065783502]
  We introduce the first 3D, data-driven musculoskeletal model of Drosophila legs.<n>Our model incorporates a Hill-type muscle representation based on high-resolution X-ray scans from multiple fixed specimens.<n>Our model enables the investigation of motor control in an experimentally tractable model organism.
  arXiv  Detail & Related papers  (2025-09-08T08:21:14Z)
• Langevin Flows for Modeling Neural Latent Dynamics [81.81271685018284]
  We introduce LangevinFlow, a sequential Variational Auto-Encoder where the time evolution of latent variables is governed by the underdamped Langevin equation.<n>Our approach incorporates physical priors -- such as inertia, damping, a learned potential function, and forces -- to represent both autonomous and non-autonomous processes in neural systems.<n>Our method outperforms state-of-the-art baselines on synthetic neural populations generated by a Lorenz attractor.
  arXiv  Detail & Related papers  (2025-07-15T17:57:48Z)
• Reinforcement learning-based motion imitation for physiologically plausible musculoskeletal motor control [47.423243831156285]
  We present a model-free motion imitation framework (KINESIS) to advance the understanding of muscle-based motor control.<n>We demonstrate that KINESIS achieves strong imitation performance on 1.9 hours of motion capture data.<n>KINESIS generates muscle activity patterns that correlate well with human EMG activity.
  arXiv  Detail & Related papers  (2025-03-18T18:37:49Z)
• Spatial-Temporal Graph Diffusion Policy with Kinematic Modeling for Bimanual Robotic Manipulation [88.83749146867665]
  Existing approaches learn a policy to predict a distant next-best end-effector pose.<n>They then compute the corresponding joint rotation angles for motion using inverse kinematics.<n>We propose Kinematics enhanced Spatial-TemporAl gRaph diffuser.
  arXiv  Detail & Related papers  (2025-03-13T17:48:35Z)
• Muscles in Time: Learning to Understand Human Motion by Simulating Muscle Activations [64.98299559470503]
  Muscles in Time (MinT) is a large-scale synthetic muscle activation dataset. It contains over nine hours of simulation data covering 227 subjects and 402 simulated muscle strands. We show results on neural network-based muscle activation estimation from human pose sequences.
  arXiv  Detail & Related papers  (2024-10-31T18:28:53Z)
• MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraints [50.61346764110482]
  We integrate a musculoskeletal system with a learnable parametric hand model, MANO, to create MS-MANO. This model emulates the dynamics of muscles and tendons to drive the skeletal system, imposing physiologically realistic constraints on the resulting torque trajectories. We also propose a simulation-in-the-loop pose refinement framework, BioPR, that refines the initial estimated pose through a multi-layer perceptron network.
  arXiv  Detail & Related papers  (2024-04-16T02:18:18Z)
• A Multi-Grained Symmetric Differential Equation Model for Learning Protein-Ligand Binding Dynamics [73.35846234413611]
  In drug discovery, molecular dynamics (MD) simulation provides a powerful tool for predicting binding affinities, estimating transport properties, and exploring pocket sites. We propose NeuralMD, the first machine learning (ML) surrogate that can facilitate numerical MD and provide accurate simulations in protein-ligand binding dynamics. We demonstrate the efficiency and effectiveness of NeuralMD, achieving over 1K$times$ speedup compared to standard numerical MD simulations.
  arXiv  Detail & Related papers  (2024-01-26T09:35:17Z)
• Conditional Generative Models for Simulation of EMG During Naturalistic Movements [45.698312905115955]
  We present a conditional generative neural network trained adversarially to generate motor unit activation potential waveforms. We demonstrate the ability of such a model to predictively interpolate between a much smaller number of numerical model's outputs with a high accuracy.
  arXiv  Detail & Related papers  (2022-11-03T14:49:02Z)
• OstrichRL: A Musculoskeletal Ostrich Simulation to Study Bio-mechanical Locomotion [8.849771760994273]
  We release a 3D musculoskeletal simulation of an ostrich based on the MuJoCo simulator. The model is based on CT scans and dissections used to gather actual muscle data. We also provide a set of reinforcement learning tasks, including reference motion tracking and a reaching task with the neck.
  arXiv  Detail & Related papers  (2021-12-11T19:58:11Z)
• Reinforcement Learning of Musculoskeletal Control from Functional Simulations [3.94716580540538]
  In this work, a deep reinforcement learning (DRL) based inverse dynamics controller is trained to control muscle activations of a biomechanical model of the human shoulder. Results are presented for a single-axis motion control of shoulder abduction for the task of following randomly generated angular trajectories.
  arXiv  Detail & Related papers  (2020-07-13T20:20:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.