Constrained Whole-Body Tracking for Humanoid Robots

• URL: http://arxiv.org/abs/2606.00374v1
• Date: Fri, 29 May 2026 21:33:03 GMT
• Title: Constrained Whole-Body Tracking for Humanoid Robots
• Abstract summary: We present ConstrainedMimic, a control framework that leverages whole-body kinematics and dynamics for real-time constraint enforcement.<n>Our method is fully differentiable, runs on CPU, GPU, and TPU, and can be deployed at up to 300-500 Hz.
• Score: 19.577922315321228
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advances in reinforcement learning (RL) have demonstrated impressive whole-body agility for humanoid robots, yet ensuring safety and satisfying constraints -- particularly those specified after training -- remains a challenge. Towards this goal, we present ConstrainedMimic, a control framework that leverages whole-body kinematics and dynamics for real-time constraint enforcement within RL tracking policies. By integrating principles from operational space control and control barrier functions (CBFs), we enable the satisfaction of arbitrary runtime constraints on both the kinematic reference motion and the underlying dynamics. In whole-body motion-tracking and teleoperation experiments on a (simulated) Unitree G1 with a learned policy, we demonstrate collision avoidance (both with the robot body and external obstacles), joint limits, and center of mass stability constraints. By remaining consistent with the current contact mode and tracking objectives, we minimally restrict the capabilities of the policy when constraints are active. Our method is fully differentiable, runs on CPU, GPU, and TPU, and can be deployed at up to 300-500 Hz. All software will be freely available upon publication.

Related papers

• Safe Polytope-in-Polytope Motion Planning and Control with Control Barrier Functions [45.68209588239261]
  This work proposes a safe local motion planning and control method that guarantees that a polytopic robot footprint stays inside a convex free-space region.<n>The proposed free-space formulation does not need any obstacle detection or segmentation.<n>The approach is validated in simulation with an autonomous surface vehicle and on hardware with a non-holonomic mobile robot.
  arXiv  Detail & Related papers  (2026-06-08T16:44:28Z)
• ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation [55.467742403416175]
  We introduce a physics-driven neural algorithm that translates large-scale motion capture to humanoid embodiments.<n>We learn a unified multimodal controller that supports both dense references and sparse task specifications.<n>Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception.
  arXiv  Detail & Related papers  (2026-03-03T18:59:29Z)
• Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching [77.28042137892943]
  We present Perceptive Humanoid Parkour (PHP), a modular framework that enables humanoid robots to autonomously perform long-horizon, vision-based parkour.<n>We train motion-tracking reinforcement learning expert policies for these composed motions, and distill them into a single depth-based, multi-skill student policy.<n>We validate our framework with extensive real-world experiments on a Unitree G1 humanoid robot.
  arXiv  Detail & Related papers  (2026-02-17T18:59:11Z)
• HAIC: Humanoid Agile Object Interaction Control via Dynamics-Aware World Model [56.4392302336014]
  We present HAIC, a framework for robust interaction across diverse object dynamics without external state estimation.<n>Our key contribution is a dynamics predictor that estimates high-order object states (velocity, acceleration) solely from proprioceptive history.<n> Experiments on a humanoid robot show HAIC achieves high success rates in agile tasks.
  arXiv  Detail & Related papers  (2026-02-12T09:34:35Z)
• CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbation [70.5382178207975]
  hIsight Perturbation (CHIP) is a plug-and-play module that enables controllable end-effector stiffness.<n>CHIP is easy to implement and requires neither data augmentation nor additional reward tuning.<n>We show that a generalist motion-tracking controller trained with CHIP can perform a diverse set of forceful manipulation tasks.
  arXiv  Detail & Related papers  (2025-12-16T18:56:04Z)
• KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skills [58.73043119128804]
  This paper presents a physics-based humanoid control framework, aiming to master highly-dynamic human behaviors such as Kungfu and dancing.<n>For motion processing, we design a pipeline to extract, filter out, correct, and retarget motions, while ensuring compliance with physical constraints.<n>For motion imitation, we formulate a bi-level optimization problem to dynamically adjust the tracking accuracy tolerance.<n>In experiments, we train whole-body control policies to imitate a set of highly-dynamic motions.
  arXiv  Detail & Related papers  (2025-06-15T13:58:53Z)
• FACET: Force-Adaptive Control via Impedance Reference Tracking for Legged Robots [23.645867340878574]
  We present emphForce-Adaptive Control via Impedance Reference Tracking (FACET)<n>Inspired by impedance control, we use RL to train a control policy to imitate a virtual mass-spring-damper system.<n>In simulation, we demonstrate that our quadruped robot achieves improved robustness to large impulses and exhibits controllable compliance.
  arXiv  Detail & Related papers  (2025-05-11T07:23:26Z)
• Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning [54.26816599309778]
  We propose a novel whole-body locomotion algorithm based on dynamic balance and Reinforcement Learning (RL)<n> Specifically, we introduce a dynamic balance mechanism by leveraging an extended measure of Zero-Moment Point (ZMP)-driven rewards and task-driven rewards in a whole-body actor-critic framework.<n> Experiments conducted on a full-sized Unitree H1-2 robot verify the ability of our method to maintain balance on extremely narrow terrains.
  arXiv  Detail & Related papers  (2025-02-24T14:53:45Z)
• Learning Humanoid Standing-up Control across Diverse Postures [27.79222176982376]
  Standing-up control is crucial for humanoid robots, with the potential for integration into current locomotion and loco-manipulation systems.<n>We present HoST (Humanoid Standing-up Control), a reinforcement learning framework that learns standing-up control from scratch.<n>Our experimental results demonstrate that the controllers achieve smooth, stable, and robust standing-up motions across a wide range of laboratory and outdoor environments.
  arXiv  Detail & Related papers  (2025-02-12T13:10:09Z)
• Agile and versatile bipedal robot tracking control through reinforcement learning [12.831810518025309]
  This paper proposes a versatile controller for bipedal robots. It achieves ankle and body trajectory tracking across a wide range of gaits using a single small-scale neural network. Highly flexible gait control can be achieved by combining minimal control units with high-level policy.
  arXiv  Detail & Related papers  (2024-04-12T05:25:03Z)
• Constrained Dynamic Movement Primitives for Safe Learning of Motor Skills [25.06692536893836]
  We present constrained dynamic movement primitives (CDMP) which can allow for constraint satisfaction in the robot workspace. A video showing the implementation of the proposed algorithm using different manipulators in different environments could be found here.
  arXiv  Detail & Related papers  (2022-09-28T22:59:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.