Predictive Style Matching: Natural and Robust Humanoid Locomotion

• URL: http://arxiv.org/abs/2606.07083v1
• Date: Fri, 05 Jun 2026 09:21:20 GMT
• Title: Predictive Style Matching: Natural and Robust Humanoid Locomotion
• Abstract summary: Predictive Style Matching maps the robot's lower-body state history and velocity commands to interpretable upper-body joint and gait targets.<n>On the Unitree G1, in both simulation and hardware, PSM reduces upper-body style error by roughly an order of magnitude over task-only RL.
• Score: 0.2348805691644085
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reinforcement learning has become the prevailing approach to humanoid locomotion control: policies transfer reliably from simulation to hardware and recover gracefully from disturbances. Motion quality, however, still lags behind: task-only rewards often converge to stiff, asymmetric gaits, while motion imitation methods improve appearance but become more sensitive to external disturbances because reference signals can oppose the transient poses needed to regain balance. We propose Predictive Style Matching, in which an offline predictor maps the robot's lower-body state history and velocity commands to interpretable upper-body joint and gait targets that shape the rewards during training. Because the targets are state-conditioned rather than time-indexed and the predictor is used only at training time, the deployed controller inherits the proprioceptive interface and inference cost of a task-only RL baseline. On the Unitree G1, in both simulation and hardware, PSM reduces upper-body style error by roughly an order of magnitude over task-only RL while preserving its fall-recovery rate, whereas the motion-imitation baseline attains the lowest style error but fails to recover from disturbances about five times as often.

Related papers

• Learning Fault-Tolerant Locomotion with Adaptive Gait Timing [1.1156827035309405]
  Hardware failures require legged robots to reorganize coordination and gait timing to maintain stability and mobility.<n>We propose a deep reinforcement learning approach for fault-tolerant locomotion under actuator power loss.<n>The approach is validated in high-fidelity simulation on uneven terrain and real-world experiments on flat ground using a 68 kg quadruped robot.
  arXiv  Detail & Related papers  (2026-08-07T15:27:03Z)
• Predictive Training with Latent Imagination for Visual Quadruped Navigation [2.687590979817173]
  Reinforcement-learning navigation policies for legged robots select actions reactively from current observations and short-term memory.<n>Lightweight predictive supervision applied to the policy's recurrent state during training can encode anticipatory obstacle dynamics without modifying the inference-time controller.<n>On simulated and real-world navigation benchmarks with dynamic obstacles, our method substantially improves navigation success while reducing collision rates through the predictive training signal alone.
  arXiv  Detail & Related papers  (2026-07-20T05:33:22Z)
• ReactiveBFM: Reactive Closed-Loop Motion Planning Towards Universal Humanoid Whole-Body Control [54.267632784131415]
  ReactiveBFM is a real-time-loop planning-control framework for humanoids.<n>It mitigates fatal cumulative exposure bias via a scheduled prefix sampling curriculum.<n>It demonstrates unprecedented physical agility across a vast repertoire of text-conditioned closed-loop motions.
  arXiv  Detail & Related papers  (2026-06-29T14:27:27Z)
• MorFiC: Fixing Value Miscalibration for Zero-Shot Quadruped Transfer [50.54752207285298]
  Generalizing learned locomotion policies across quadrupedal robots with different morphologies remains a challenge.<n>We present MorFiC, a reinforcement learning approach for zero-shot cross-morphology locomotion using a single shared policy.<n>We show that MorFiC reduces the value-prediction error variance across morphologies and stabilizes the advantage estimates.
  arXiv  Detail & Related papers  (2026-03-15T19:03:34Z)
• Embedding Classical Balance Control Principles in Reinforcement Learning for Humanoid Recovery [1.0883174135300417]
  Humans are vulnerable to falls and unrecoverable failure states, limiting their practical utility in unstructured environments.<n>We present a unified RL policy that addresses this limitation by embedding classical balance metrics.<n>The policy achieves a 93.4% recovery rate across randomized initial poses and unscripted fall configurations.
  arXiv  Detail & Related papers  (2026-03-09T17:02:30Z)
• ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation [55.467742403416175]
  We introduce a physics-driven neural algorithm that translates large-scale motion capture to humanoid embodiments.<n>We learn a unified multimodal controller that supports both dense references and sparse task specifications.<n>Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception.
  arXiv  Detail & Related papers  (2026-03-03T18:59:29Z)
• Robust and Generalized Humanoid Motion Tracking [17.58241987932198]
  Learning a general humanoid whole-body controller is challenging because practical reference motions can exhibit noise and inconsistencies after being transferred to the robot domain.<n>We propose a dynamics-conditioned command aggregation framework that uses a causal temporal encoder to summarize recent proprioception and a multi-head cross-attention command encoder to selectively aggregate a context window.<n>The proposed method is evaluated under diverse reference inputs and challenging motion regimes, demonstrating zero-shot transfer to unseen motions as well as robust sim-to-real transfer on a physical humanoid robot.
  arXiv  Detail & Related papers  (2026-01-30T15:27:43Z)
• Task-Centric Policy Optimization from Misaligned Motion Priors [5.008550719179743]
  We propose a task-priority adversarial imitation framework that treats imitation as a conditional regularizer rather than a co-equal objective.<n>We provide theoretical analysis of gradient conflict and task-priority stationary points, and validate our claims through humanoid control experiments.
  arXiv  Detail & Related papers  (2026-01-27T09:46:34Z)
• Walk the PLANC: Physics-Guided RL for Agile Humanoid Locomotion on Constrained Footholds [20.44610499489492]
  Bipedal humanoid robots must coordinate balance, timing, and contact decisions when locomoting on constrained footholds.<n>We introduce a locomotion framework in which a reduced-order stepping planner supplies dynamically consistent motion targets.<n>This combination of structured footstep planning and data-driven adaptation produces accurate, agile, and hardware-validated stepping-stone locomotion on a humanoid robot.
  arXiv  Detail & Related papers  (2026-01-09T19:56:42Z)
• RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Tracking [50.200035833530876]
  RobotDancing is a simple, scalable framework that predicts residual joint targets to explicitly correct dynamics discrepancies.<n>It can track multi-minute, high-energy behaviors (jumps, spins, cartwheels) and deploys zero-shot to hardware with high motion tracking quality.
  arXiv  Detail & Related papers  (2025-09-25T03:30:34Z)
• Game-Theoretic Robust Reinforcement Learning Handles Temporally-Coupled Perturbations [98.5802673062712]
  We introduce temporally-coupled perturbations, presenting a novel challenge for existing robust reinforcement learning methods. We propose GRAD, a novel game-theoretic approach that treats the temporally-coupled robust RL problem as a partially observable two-player zero-sum game.
  arXiv  Detail & Related papers  (2023-07-22T12:10:04Z)
• Robust Reinforcement Learning using Adversarial Populations [118.73193330231163]
  Reinforcement Learning (RL) is an effective tool for controller design but can struggle with issues of robustness. We show that using a single adversary does not consistently yield robustness to dynamics variations under standard parametrizations of the adversary. We propose a population-based augmentation to the Robust RL formulation in which we randomly initialize a population of adversaries and sample from the population uniformly during training.
  arXiv  Detail & Related papers  (2020-08-04T20:57:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.