GenTrack: Physical Alignment for Robot-Native Motion Generation and Zero-Shot Humanoid Tracking

• URL: http://arxiv.org/abs/2608.01410v2
• Date: Wed, 05 Aug 2026 07:33:07 GMT
• Title: GenTrack: Physical Alignment for Robot-Native Motion Generation and Zero-Shot Humanoid Tracking
• Abstract summary: General-purpose humanoid trackers can execute diverse references, but their zero-shot coverage depends on large embodied corpora that are costly to extend.<n>We introduce GenTrack, an online generator--tracker framework that alternates execution-grounded, group-relative generator alignment with tracker training on newly generated references.
• Score: 20.397340513713413
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: General-purpose humanoid trackers can execute diverse references, but their zero-shot coverage depends on large embodied corpora that are costly to extend. Text-to-motion generators offer scalable supervision, yet models trained on human motion or retargeted data inherit a gap between kinematic plausibility and robot executability. Existing one-way pipelines fix either the generated corpus or the reward tracker. We introduce GenTrack, an online generator--tracker framework that alternates execution-grounded, group-relative generator alignment with tracker training on newly generated references; anchoring and rehearsal constrain drift. On Unitree G1, we evaluate GenTrack with ProtoMotions and SONIC backbones across three zero-shot tracking splits including public AMASS and LAFAN benchmarks, and a private out-of-distribution test set of 1,024 prompt-motion pairs in the wild. The online co-training strategy consistently produces generators that output more robot-executable motions with strong semantic alignment, and trackers with markedly broader zero-shot coverage and improved tracking accuracy, especially on out-of-distribution references. These results demonstrate that joint online post-training effectively narrows the executability gap between retargeted references and robot-native motion, advancing zero-shot humanoid control without additional data collection and beyond the limitations of a static reference pool.

Related papers

• GigaBrain-WBC-0.5: A Behavior World Model for Robust Whole-Body Control with Environment Interaction [68.67772166423812]
  We present GigaBrain-WBC-0.5, the first Behavior World Model (BWM) for humanoid whole-body control.<n>Rather than a purely reactive tracker, we train a causal Transformer to jointly predict its next action, next state, and the distribution over its next latent behavior command.<n>An automatic terrain-annotation pipeline recovers full 3D contact geometry from retargeted motion, enabling terrain annotation at the scale of existing motion datasets.
  arXiv  Detail & Related papers  (2026-08-18T18:21:36Z)
• TEXEDO : Test Time Scaling for Controller-aware Language-conditioned Humanoid Motion Generation [48.72797830886802]
  We introduce TEXEDO, a test-time scaling framework for humanoid motion generation.<n>It improves motion quality without requiring a stronger underlying generator.<n>We show it consistently improves both tracking fidelity and text alignment.
  arXiv  Detail & Related papers  (2026-06-22T08:14:35Z)
• Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Tracking [21.334872673132594]
  We introduce Humanoid-GPT, a GPT-style Transformer with causal attention trained on a billion-scale motion corpus for whole-body control.<n>Humanoid-GPT is pre-trained on a 2B-frame retargeted corpus that unifies all major mocap datasets with large-scale in-house recordings.
  arXiv  Detail & Related papers  (2026-06-02T17:59:05Z)
• Interactive Tracking: A Human-in-the-Loop Paradigm with Memory-Augmented Adaptation [60.96010213186819]
  We introduce Interactive Tracking, a new paradigm that allows users to guide the tracker at any time using natural language commands.<n>We present InteractTrack, the first large-scale benchmark for interactive tracking, containing 150 videos with dense bounding box annotations and timestamped language instructions.<n>Third, we introduce Interactive Memory-Augmented Tracking (IMAT), a new baseline that employs a dynamic memory mechanism to learn from user feedback and update tracking behavior accordingly.
  arXiv  Detail & Related papers  (2026-04-02T12:33:27Z)
• ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Control [8.983091538704645]
  We present ECHO, an edge-hosted framework for language-driven whole-body control of humanoid robots.<n>A cloud-native diffusion-based text-to-motion generator synthesizes motion references from natural language instructions.<n>An edge-deployed reinforcement-learning tracker executes them in closed loop on the robot.
  arXiv  Detail & Related papers  (2026-03-17T07:16:18Z)
• ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation [55.467742403416175]
  We introduce a physics-driven neural algorithm that translates large-scale motion capture to humanoid embodiments.<n>We learn a unified multimodal controller that supports both dense references and sparse task specifications.<n>Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception.
  arXiv  Detail & Related papers  (2026-03-03T18:59:29Z)
• GenTrack: A New Generation of Multi-Object Tracking [3.259045978275386]
  This paper introduces a novel multi-object tracking (MOT) method, dubbed GenTrack.<n>It employs both flexible and deterministic tracking manners to robustly handle unknown and time-varying numbers of targets.<n>GenTrack provides superior performance on standard benchmarks and real-world scenarios compared to state-of-the-art trackers.
  arXiv  Detail & Related papers  (2025-10-28T13:13:20Z)
• RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Tracking [50.200035833530876]
  RobotDancing is a simple, scalable framework that predicts residual joint targets to explicitly correct dynamics discrepancies.<n>It can track multi-minute, high-energy behaviors (jumps, spins, cartwheels) and deploys zero-shot to hardware with high motion tracking quality.
  arXiv  Detail & Related papers  (2025-09-25T03:30:34Z)
• TrajBooster: Boosting Humanoid Whole-Body Manipulation via Trajectory-Centric Learning [79.59753528758361]
  We present TrajBooster, a cross-embodiment framework that leverages abundant wheeled-humanoid data to boost bipedal VLA.<n>Our key idea is to use end-effector trajectories as a morphology-agnostic interface.<n>Results show that TrajBooster allows existing wheeled-humanoid data to efficiently strengthen bipedal humanoid VLA performance.
  arXiv  Detail & Related papers  (2025-09-15T12:25:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.