Data-Driven Physics Embedded Dynamics with Predictive Control and Reinforcement Learning for Quadrupeds

• URL: http://arxiv.org/abs/2603.14333v1
• Date: Sun, 15 Mar 2026 11:52:14 GMT
• Title: Data-Driven Physics Embedded Dynamics with Predictive Control and Reinforcement Learning for Quadrupeds
• Abstract summary: State of the art quadrupedal approaches integrate Model Predictive Control (MPC) with Reinforcement Learning (RL)<n>We address these issues by integrating Lagrangian Neural Networks (LNNs) into an RL MPC framework.<n>We show improved sample efficiency, reduced long-horizon error, and faster real time planning compared to unstructured neural dynamics.
• Score: 2.85987101794478
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: State of the art quadrupedal locomotion approaches integrate Model Predictive Control (MPC) with Reinforcement Learning (RL), enabling complex motion capabilities with planning and terrain adaptive behaviors. However, they often face compounding errors over long horizons and have limited interpretability due to the absence of physical inductive biases. We address these issues by integrating Lagrangian Neural Networks (LNNs) into an RL MPC framework, enabling physically consistent dynamics learning. At deployment, our inverse dynamics infinite horizon MPC scheme avoids costly matrix inversions, improving computational efficiency by up to 4x with minimal loss of task performance. We validate our framework through multiple ablations of the proposed LNN and its variants. We show improved sample efficiency, reduced long-horizon error, and faster real time planning compared to unstructured neural dynamics. Lastly, we also test our framework on the Unitree Go1 robot to show real world viability.

Related papers

• A Neural Network Based Teleoperation for Remote Controlled Vehicles [98.38733381483934]
  Direct teleoperation of vehicles faces critical technical bottlenecks.<n> communication latency and the operator's inability to physically perceive unmodeled environmental disturbances.<n>We propose a tailored unilateral teleoperation framework.
  arXiv  Detail & Related papers  (2026-08-11T01:51:08Z)
• Steering Robustness into World Action Models via Mechanistic Interpretability and Optimal Control [3.3394856680250284]
  We study how robustness-relevant perturbations are represented in World Action Models (WAMs) activation space.<n> Comparing activations across successful and unsuccessful rollouts, we find some WAM architectures exhibit low-dimensional linear separability for robustness-critical features.<n>This motivates the use of contrastive activation directions for training-free WAM steering.<n>We also show that local linearity in WAM activation dynamics enables efficient feedback steering via model-based optimal control.
  arXiv  Detail & Related papers  (2026-07-16T12:52:49Z)
• TIDE: Asymmetric Neural Circuits for Stabilized Temporal Inhibitory-Excitatory Dynamics [51.37317469455798]
  Recent Continuous Thought Machine architecture decouples internal computation from external inputs via neural dynamics.<n>We propose to model neural dynamics using asymmetric Excitatory-Inhibitory (E-I) networks.<n>We introduce Temporal Inhibitory-Excitatory Dynamic Engine (TIDE), a neuro-inspired architecture that computes internal representations through neural dynamics stabilized.
  arXiv  Detail & Related papers  (2026-05-19T05:59:13Z)
• Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racing [73.88859384645264]
  Out-Of-Distribution (OOD) generalization to various racetracks utilizes Machine Learning (ML) to encode the mathematical relation between sensor data and vehicle actuation for end-to-end control.<n>This paper presents a DRL method that parameterizes nonlinear vehicle dynamics from the spectral distribution of depth measurements with a non-geometric, physics-informed reward, to infer vehicle time-optimal and overtaking racing controls with an Artificial Neural Network (ANN)<n>The policy outperforms human demonstrations by 12% in OOD tracks on proportionally scaled hardware, by maximizing the friction circle with tire dynamics that resemble an empirical Pacejka tire model.
  arXiv  Detail & Related papers  (2026-04-10T17:12:07Z)
• Make Tracking Easy: Neural Motion Retargeting for Humanoid Whole-body Control [43.01629060165596]
  We propose a Neural Motion Retargeting framework to group heterogeneous movements into latent motifs.<n>This strategy significantly reduces the computational massively parallel learning experts.<n> references accelerate the convergence of whole-body control policies.
  arXiv  Detail & Related papers  (2026-03-23T16:59:00Z)
• Investigating Lagrangian Neural Networks for Infinite Horizon Planning in Quadrupedal Locomotion [1.3167173258708438]
  Lagrangian Neural Networks (LNNs) present a principled and interpretable framework for learning the system dynamics by utilizing inductive biases.<n>This work evaluates LNNs for infinite horizon planning in quadrupedal robots through four dynamics models.<n>Experiments demonstrate that LNNs bring improvements in sample efficiency (10x) and superior prediction accuracy (up to 2-10x) compared to baseline methods.
  arXiv  Detail & Related papers  (2025-06-19T07:04:24Z)
• PIP-Loco: A Proprioceptive Infinite Horizon Planning Framework for Quadrupedal Robot Locomotion [1.123472110161393]
  A core strength of Model Predictive Control (MPC) for quadrupedal locomotion has been its ability to enforce constraints.<n>We propose a framework that integrates proprioceptive planning with Reinforcement Learning (RL)<n>During deployment, the Dreamer module solves an infinite-horizon MPC problem, adapting actions and velocity commands to respect the constraints.
  arXiv  Detail & Related papers  (2024-09-14T13:51:37Z)
• Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch [72.26822499434446]
  Auto-Train-Once (ATO) is an innovative network pruning algorithm designed to automatically reduce the computational and storage costs of DNNs. We provide a comprehensive convergence analysis as well as extensive experiments, and the results show that our approach achieves state-of-the-art performance across various model architectures.
  arXiv  Detail & Related papers  (2024-03-21T02:33:37Z)
• Complex Locomotion Skill Learning via Differentiable Physics [30.868690308658174]
  Differentiable physics enables efficient-based optimizations of neural network (NN) controllers. We present a practical learning framework that outputs unified NN controllers capable of tasks with significantly improved complexity and diversity.
  arXiv  Detail & Related papers  (2022-06-06T04:01:12Z)
• Gradient-Based Trajectory Optimization With Learned Dynamics [80.41791191022139]
  We use machine learning techniques to learn a differentiable dynamics model of the system from data. We show that a neural network can model highly nonlinear behaviors accurately for large time horizons. In our hardware experiments, we demonstrate that our learned model can represent complex dynamics for both the Spot and Radio-controlled (RC) car.
  arXiv  Detail & Related papers  (2022-04-09T22:07:34Z)
• Real-time Neural-MPC: Deep Learning Model Predictive Control for Quadrotors and Agile Robotic Platforms [59.03426963238452]
  We present Real-time Neural MPC, a framework to efficiently integrate large, complex neural network architectures as dynamics models within a model-predictive control pipeline. We show the feasibility of our framework on real-world problems by reducing the positional tracking error by up to 82% when compared to state-of-the-art MPC approaches without neural network dynamics.
  arXiv  Detail & Related papers  (2022-03-15T09:38:15Z)
• Efficient Learning of Control Policies for Robust Quadruped Bounding using Pretrained Neural Networks [15.09037992110481]
  Bounding is one of the important gaits in quadrupedal locomotion for negotiating obstacles. The authors proposed an effective approach that can learn robust bounding gaits more efficiently. The authors approach shows efficient computing and good locomotion results by the Jueying Mini quadrupedal robot bounding over uneven terrain.
  arXiv  Detail & Related papers  (2020-11-01T08:06:46Z)
• First Steps: Latent-Space Control with Semantic Constraints for Quadruped Locomotion [73.37945453998134]
  Traditional approaches to quadruped control employ simplified, hand-derived models. This significantly reduces the capability of the robot since its effective kinematic range is curtailed. In this work, these challenges are addressed by framing quadruped control as optimisation in a structured latent space. A deep generative model captures a statistical representation of feasible joint configurations, whilst complex dynamic and terminal constraints are expressed via high-level, semantic indicators. We validate the feasibility of locomotion trajectories optimised using our approach both in simulation and on a real-worldmal quadruped.
  arXiv  Detail & Related papers  (2020-07-03T07:04:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.