Light-Loco-Parkour: Versatile Perceptive Whole-Body Locomotion via Multi-Skill Distillation
- URL: http://arxiv.org/abs/2608.02653v1
- Date: Sat, 01 Aug 2026 06:38:55 GMT
- Title: Light-Loco-Parkour: Versatile Perceptive Whole-Body Locomotion via Multi-Skill Distillation
- Abstract summary: We present textttLight-Loco-Parkour (LLP), an end-to-end perceptive whole-body locomotion system.<n>The policy decides when to walk, balance, climb, step down, or vault with no reference input, skill label, hand-coded gate, or runtime motion graph.<n> Simulation and real-world experiments show high success across both benchmarked terrains and unseen obstacle variations.
- Score: 23.823908892458306
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Existing humanoid whole-body control systems still fall short of the way humans move through cluttered terrain: they either track expressive whole-body references without terrain generalization, or react to terrain online while leaving the arms, torso, and knees largely unused. We present \texttt{Light-Loco-Parkour} (LLP), an end-to-end perceptive whole-body locomotion system that closes this gap with a single deployable policy. Conditioned only on onboard depth and a velocity command, the policy decides when to walk, balance, climb, step down, or vault, with no reference input, skill label, hand-coded gate, or runtime motion graph. Compared with prior humanoid systems, LLP makes three contributions. First, it introduces a whole-body perceptive-control pipeline that extends an RL-trained, velocity-tracking locomotion policy with parkour skills learned from object-interacting motions, so the same policy tracks velocity in open terrain, executes whole-body traversal at obstacles, and resumes locomotion afterward. Second, it acquires terrain-conditioned skills from sparse seeds by expanding a single motion into dynamically feasible, terrain-paired references across obstacle geometry, rather than relying on a large motion corpus. Third, it learns autonomous skill transitions from reward, letting the policy decide when and which whole-body skill to invoke from depth and command alone, with no one-hot skill label, hand-coded state machine, or runtime motion generator. Simulation and real-world experiments show high success across both benchmarked terrains and unseen obstacle variations, and the same policy transfers zero-shot to indoor and outdoor hardware experiments. These results demonstrate autonomous perceptive whole-body locomotion on a humanoid in outdoor settings, using only onboard sensing and a single deployable policy.
Related papers
- Learning Whole-Body Humanoid Locomotion via Motion Generation and Motion Tracking [22.8041193953823]
Whole-body humanoid locomotion is challenging due to high-dimensional control, morphological instability, and the need for real-time adaptation to various terrains using onboard perception.<n>We propose a whole-body humanoid locomotion framework that combines skills learned from reference motions with terrain-aware adaptation.
arXiv Detail & Related papers (2026-04-19T09:02:55Z) - Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching [77.28042137892943]
We present Perceptive Humanoid Parkour (PHP), a modular framework that enables humanoid robots to autonomously perform long-horizon, vision-based parkour.<n>We train motion-tracking reinforcement learning expert policies for these composed motions, and distill them into a single depth-based, multi-skill student policy.<n>We validate our framework with extensive real-world experiments on a Unitree G1 humanoid robot.
arXiv Detail & Related papers (2026-02-17T18:59:11Z) - TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control [62.93681680333618]
TextOp is a real-time text-driven humanoid motion generation and control framework.<n>It supports streaming language commands and on-the-fly instruction modification during execution.<n>By bridging interactive motion generation with robust whole-body control, TextOp unlocks free-form intent expression.
arXiv Detail & Related papers (2026-02-07T08:42:11Z) - Deep Whole-body Parkour [33.232856360240106]
We present a framework where exteroceptive sensing is integrated into whole-body motion tracking.<n>We demonstrate the non-trivial benefit of integrating perception into the control loop.<n>Results show that this framework enables robust, highly dynamic multi-contact motions, such as vaulting and dive-rolling, on unstructured terrain.
arXiv Detail & Related papers (2026-01-12T16:33:16Z) - Locomotion Beyond Feet [35.148387990120014]
Locomotion Beyond Feet is a comprehensive system for whole-body humanoid locomotion across challenging terrains.<n>Our approach addresses two key challenges: contact-rich motion planning and generalization across diverse terrains.<n>Keyframes encode human knowledge of motor skills, are embodiment-specific, and can be readily validated in simulation or on hardware.
arXiv Detail & Related papers (2026-01-07T05:36:39Z) - Gait-Adaptive Perceptive Humanoid Locomotion with Real-Time Under-Base Terrain Reconstruction [86.53248703859718]
We introduce a perceptive locomotion framework that merges terrain sensing, gait regulation, and whole-body control into a single reinforcement learning policy.<n>Experiments conducted on a 31-DoF, 1.65 m humanoid robot demonstrate robust locomotion in both simulation and real-world settings.
arXiv Detail & Related papers (2025-12-08T11:42:41Z) - A Unified and General Humanoid Whole-Body Controller for Versatile Locomotion [30.418274871034775]
We propose HugWBC: a unified and general humanoid whole-body controller for versatile locomotion.<n>By designing a general command space in the aspect of tasks and behaviors, HugWBC enables real-world humanoid robots to produce various natural gaits.<n>HugWBC also supports real-time interventions from external upper-body controllers like teleoperation, enabling loco-manipulation with precision.
arXiv Detail & Related papers (2025-02-05T14:26:01Z) - SoloParkour: Constrained Reinforcement Learning for Visual Locomotion from Privileged Experience [19.817578964184147]
Parkour poses a significant challenge for legged robots, requiring navigation through complex environments with agility and precision based on limited sensory inputs.
We introduce a novel method for training end-to-end visual policies, from depth pixels to robot control commands, to achieve agile and safe quadruped locomotion.
We demonstrate the effectiveness of our method on a real Solo-12 robot, showcasing its capability to perform a variety of parkour skills such as walking, climbing, leaping, and crawling.
arXiv Detail & Related papers (2024-09-20T17:39:20Z) - DexDribbler: Learning Dexterous Soccer Manipulation via Dynamic Supervision [26.9579556496875]
Joint manipulation of moving objects and locomotion with legs, such as playing soccer, receive scant attention in the learning community.
We propose a feedback control block to compute the necessary body-level movement accurately and using the outputs as dynamic joint-level locomotion supervision.
We observe that our learning scheme can not only make the policy network converge faster but also enable soccer robots to perform sophisticated maneuvers.
arXiv Detail & Related papers (2024-03-21T11:16:28Z) - Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control [106.32794844077534]
This paper presents a study on using deep reinforcement learning to create dynamic locomotion controllers for bipedal robots.
We develop a general control solution that can be used for a range of dynamic bipedal skills, from periodic walking and running to aperiodic jumping and standing.
This work pushes the limits of agility for bipedal robots through extensive real-world experiments.
arXiv Detail & Related papers (2024-01-30T10:48:43Z) - Robot Parkour Learning [70.56172796132368]
Parkour is a grand challenge for legged locomotion that requires robots to overcome various obstacles rapidly.
We develop a reinforcement learning method inspired by direct collocation to generate parkour skills.
We distill these skills into a single vision-based parkour policy and transfer it to a quadrupedal robot using its egocentric depth camera.
arXiv Detail & Related papers (2023-09-11T17:59:17Z) - Learning Quadrupedal Locomotion over Challenging Terrain [68.51539602703662]
Legged locomotion can dramatically expand the operational domains of robotics.
Conventional controllers for legged locomotion are based on elaborate state machines that explicitly trigger the execution of motion primitives and reflexes.
Here we present a radically robust controller for legged locomotion in challenging natural environments.
arXiv Detail & Related papers (2020-10-21T19:11:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.