PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Tracking

• URL: http://arxiv.org/abs/2603.19305v1
• Date: Fri, 13 Mar 2026 06:43:44 GMT
• Title: PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Tracking
• Abstract summary: We present PhyGile, a unified framework that closes the loop between robot-native motion generation and inference.<n>We train the GMT controller with a curriculum-based mixture-of-experts scheme, followed by post-training on unlabeled motion data to improve robustness over large-scale robot motions.<n>PhyGile expands the frontier of text-driven humanoid control, enabling stable tracking of agile, highly difficult whole-body motions.
• Score: 23.96905373874686
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Humanoid robots are expected to execute agile and expressive whole-body motions in real-world settings. Existing text-to-motion generation models are predominantly trained on captured human motion datasets, whose priors assume human biomechanics, actuation, mass distribution, and contact strategies. When such motions are directly retargeted to humanoid robots, the resulting trajectories may satisfy geometric constraints (e.g., joint limits and pose continuity) and appear kinematically reasonable. However, they frequently violate the physical feasibility required for real-world execution. To address these issues, we present PhyGile, a unified framework that closes the loop between robot-native motion generation and General Motion Tracking (GMT). PhyGile performs physics-prefix-guided robot-native motion generation at inference time, directly generating robot-native motions in a 262-dimensional skeletal space with physics-guided prefixes, thereby eliminating inference-time retargeting artifacts and reducing generation-execution discrepancies. Before physics-prefix adaptation, we train the GMT controller with a curriculum-based mixture-of-experts scheme, followed by post-training on unlabeled motion data to improve robustness over large-scale robot motions. During physics-prefix adaptation, the GMT controller is further fine-tuned with generated objectives under physics-derived prefixes, enabling agile and stable execution of complex motions on real robots. Extensive offline and real-robot experiments demonstrate that PhyGile expands the frontier of text-driven humanoid control, enabling stable tracking of agile, highly difficult whole-body motions that go well beyond walking and low-dynamic motions typically achieved by prior methods.

Related papers

• TEXEDO : Test Time Scaling for Controller-aware Language-conditioned Humanoid Motion Generation [48.72797830886802]
  We introduce TEXEDO, a test-time scaling framework for humanoid motion generation.<n>It improves motion quality without requiring a stronger underlying generator.<n>We show it consistently improves both tracking fidelity and text alignment.
  arXiv  Detail & Related papers  (2026-06-22T08:14:35Z)
• PhysDrift: Bridging the Embodiment Gap in Humanoid Co-Speech Motion Generation [31.168201029670865]
  We introduce PhysDrift, an embodiment-aware co-speech motion framework that predicts humanoid joint trajectories from speech without relying on human-body representations.<n>Experiments and real-world humanoid deployment demonstrate that embodiment-aware robot-native generation substantially improves speech-motion alignment, physical plausibility, motion smoothness, inference efficiency, and real-time interaction capability.
  arXiv  Detail & Related papers  (2026-06-18T08:31:58Z)
• Human2Humanoid: Physics-Aware Cross-Morphology Motion Retargeting for Humanoid Robots [9.096721498763717]
  Retargeting human motion to humanoid robots is critical for teleoperation, imitation learning and human-robot interaction.<n>This paper presents Human2Human, an unsupervised motion framework that transfers human motions to humanoid robot behaviors with high fidelity.<n> Experimental results show that the proposed method successfully retargets human motion to the Unitree G1 humanoid robot without paired data.
  arXiv  Detail & Related papers  (2026-06-02T10:53:06Z)
• PhysMoDPO: Physically-Plausible Humanoid Motion with Preference Optimization [55.25800735159481]
  Whole-Body Controller (WBC) converts diffusion-generated motions into executable trajectories.<n>WBC trajectories become compliant with physics, but they may expose substantial deviations from original motion.<n>We propose PhysMoDPO, a Direct Preference Optimization framework.<n> PhysMoDPO results in significant improvements when applied to zero-shot motion transfer in simulation and for real-world deployment on a G1 humanoid robot.
  arXiv  Detail & Related papers  (2026-03-13T17:59:59Z)
• SPARK: Skeleton-Parameter Aligned Retargeting on Humanoid Robots with Kinodynamic Trajectory Optimization [9.553570391005257]
  Human motion provides rich priors for training general-purpose humanoid control policies, but raw demonstrations are often incompatible with a robot's kinematics and dynamics.<n>We present a two-stage pipeline for generating natural and dynamically feasible motion references from task-space human data.
  arXiv  Detail & Related papers  (2026-03-12T03:03:14Z)
• OmniTrack: General Motion Tracking via Physics-Consistent Reference [54.256312586493415]
  We introduce OmniTrack, a general tracking framework that explicitly decouples physical feasibility from general motion tracking.<n>Experiments show that OmniTrack improves tracking accuracy and demonstrates strong generalization to unseen motions.<n>In real-world tests, OmniTrack achieves hour-long, consistent, and stable tracking, including complex acrobatic motions such as flips and cartwheels.
  arXiv  Detail & Related papers  (2026-02-27T09:12:15Z)
• TeleGate: Whole-Body Humanoid Teleoperation via Gated Expert Selection with Motion Prior [27.930225667015872]
  This paper presents TeleGate, a unified whole-body teleoperation framework for humanoid robots.<n>Our key idea is to preserve the full capability of domain-specific expert policies by training a lightweight gating network.<n>To compensate for the absence of future reference trajectories in real-time teleoperation, we introduce a VAE-based motion prior module.
  arXiv  Detail & Related papers  (2026-02-10T10:14:06Z)
• FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructions [147.04372611893032]
  We present FRoM-W1, an open-source framework designed to achieve general humanoid whole-body motion control using natural language.<n>We extensively evaluate FRoM-W1 on Unitree H1 and G1 robots.<n>Results demonstrate superior performance on the HumanML3D-X benchmark for human whole-body motion generation.
  arXiv  Detail & Related papers  (2026-01-19T07:59:32Z)
• KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skills [58.73043119128804]
  This paper presents a physics-based humanoid control framework, aiming to master highly-dynamic human behaviors such as Kungfu and dancing.<n>For motion processing, we design a pipeline to extract, filter out, correct, and retarget motions, while ensuring compliance with physical constraints.<n>For motion imitation, we formulate a bi-level optimization problem to dynamically adjust the tracking accuracy tolerance.<n>In experiments, we train whole-body control policies to imitate a set of highly-dynamic motions.
  arXiv  Detail & Related papers  (2025-06-15T13:58:53Z)
• Morph: A Motion-free Physics Optimization Framework for Human Motion Generation [28.009524143770076]
  Current motion generation approaches disregard physics constraints, resulting in physically implausible motions.<n>We propose textbfMorph, a framework for training an effective motion physics with noisy motion data.<n>Our framework achieves state-of-the-art motion quality while improving physical plausibility drastically.
  arXiv  Detail & Related papers  (2024-11-22T14:09:56Z)
• I-CTRL: Imitation to Control Humanoid Robots Through Constrained Reinforcement Learning [8.97654258232601]
  We develop a framework to control humanoid robots through bounded residual reinforcement learning (I-CTRL)<n>I-CTRL excels in motion imitation with simple and unique rewards that generalize across five robots.<n>Our framework introduces an automatic priority scheduler to manage large-scale motion datasets.
  arXiv  Detail & Related papers  (2024-05-14T16:12:27Z)
• Skeleton2Humanoid: Animating Simulated Characters for Physically-plausible Motion In-betweening [59.88594294676711]
  Modern deep learning based motion synthesis approaches barely consider the physical plausibility of synthesized motions. We propose a system Skeleton2Humanoid'' which performs physics-oriented motion correction at test time. Experiments on the challenging LaFAN1 dataset show our system can outperform prior methods significantly in terms of both physical plausibility and accuracy.
  arXiv  Detail & Related papers  (2022-10-09T16:15:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.