CoRe-MoE: Contrastive Reweighted Mixture of Experts for Multi-Terrain Humanoid Locomotion with Gait Adaptation

• URL: http://arxiv.org/abs/2606.04718v2
• Date: Tue, 09 Jun 2026 06:35:28 GMT
• Title: CoRe-MoE: Contrastive Reweighted Mixture of Experts for Multi-Terrain Humanoid Locomotion with Gait Adaptation
• Abstract summary: We propose CoRe-MoE, a two-stage reinforcement learning framework that decouples gait generation from terrain adaptation.<n>In the first stage, a stable locomotion policy is learned to produce natural walking and running behaviors with smooth transitions.<n>In the second stage, a terrain-aware MoE branch is introduced, and the gating network is trained with a contrastive objective to learn structured terrain representations.
• Score: 18.803751724563448
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Humans primarily rely on walking and running to traverse complex terrains. Similarly, humanoid robots should be able to smoothly transition between walking and running while maintaining natural and stable locomotion. However, unifying gait transition and multi-terrain adaptation within a single policy remains challenging due to gradient interference between tasks and the distribution shift caused by terrain variations. Although Mixture-of-Experts (MoE) architectures can mitigate multi-skill interference, direct joint training often fails to achieve clear expert specialization. To address these challenges, we propose CoRe-MoE, a two-stage reinforcement learning framework that decouples gait generation from terrain adaptation. In the first stage, a stable locomotion policy is learned to produce natural walking and running behaviors with smooth transitions. In the second stage, a terrain-aware MoE branch is introduced, and the gating network is trained with a contrastive objective to learn structured terrain representations and promote expert specialization. The final action is obtained through weighted fusion of the base gait policy and the terrain-aware branch, enabling the policy to preserve stable locomotion while adapting to complex terrains. Extensive simulation results demonstrate that the proposed method outperforms baseline approaches in terms of success rate, locomotion stability, and multi-terrain adaptability. Furthermore, zero-shot deployment on a Unitree G1 humanoid robot validates the effectiveness of our framework, achieving robust walking and running across stairs, slopes, steps, obstacles, and unstructured outdoor terrains while maintaining accurate foothold control and dynamic stability.

Related papers

• Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking [78.30338456206984]
  We introduce a novel framework for training general-purpose 3D foothold-tracking policies.<n>By dynamically providing footstep support through a goal sampler, this method enables the learned policy to be agnostic to specific terrains.<n>Our new target representation effectively mitigates challenges arising in the real world, such as noisy and inaccurate pose estimation and foot contact estimation.
  arXiv  Detail & Related papers  (2026-06-06T16:44:56Z)
• T-GMP: Terrain-conditioned Generative Motion Priors for Versatile and Natural Humanoid Locomotion [10.258225375602231]
  We propose a module that captures a terrain-conditioned latent motion manifold from a few expert state-terrain demonstrations.<n>The learned priors enable smooth style transitions, facilitating a unified policy that adapts to terrain variations.<n>We integrate T-GMP into an adversarial learning pipeline with our proposed Foothold Penalty, where a discriminator dynamically modulates naturalness constraints conditioned on local terrain features.
  arXiv  Detail & Related papers  (2026-06-05T06:15:42Z)
• RPG: Robust Policy Gating for Smooth Multi-Skill Transitions in Humanoid Fighting [52.18271301977709]
  We propose RPG, a hybrid expert policy framework, for smooth and stable humanoid multi-skills transition.<n>Our approach incorporates motion transition randomization and temporal randomization to train a unified policy that generates agile fighting actions.<n>We design a control pipeline that integrates walking/running locomotion with fighting skills, allowing humanlike long-time combat of arbitrary duration.
  arXiv  Detail & Related papers  (2026-04-23T07:14:35Z)
• LatentMimic: Terrain-Adaptive Locomotion via Latent Space Imitation [22.247608050046125]
  We introduce LatentMimic, a novel locomotion learning framework that decouples stylistic fidelity from geometric constraints.<n>By minimizing the marginal latent divergence between the policy's state-action distribution and a learned mocap prior, our approach provides a conditional relaxation of rigid pose-tracking objectives.<n>We validate our method across four locomotion styles and four terrains, demonstrating that LatentMimic enables effective terrain-adaptive locomotion.
  arXiv  Detail & Related papers  (2026-04-07T03:49:15Z)
• START: Traversing Sparse Footholds with Terrain Reconstruction [11.632418196552324]
  We propose START, a single-stage learning framework that enables agile, stable locomotion on highly sparse footholds.<n> START leverages only low-cost onboard vision and proprioception to accurately reconstruct local terrain heightmap.<n> Experimental results demonstrate that START achieves zero-shot transfer across diverse real-world scenarios.
  arXiv  Detail & Related papers  (2025-12-15T10:02:41Z)
• Gait-Adaptive Perceptive Humanoid Locomotion with Real-Time Under-Base Terrain Reconstruction [86.53248703859718]
  We introduce a perceptive locomotion framework that merges terrain sensing, gait regulation, and whole-body control into a single reinforcement learning policy.<n>Experiments conducted on a 31-DoF, 1.65 m humanoid robot demonstrate robust locomotion in both simulation and real-world settings.
  arXiv  Detail & Related papers  (2025-12-08T11:42:41Z)
• Surrogate compliance modeling enables reinforcement learned locomotion gaits for soft robots [5.193389420813379]
  Adaptive morphogenetic robots adapt their morphology and control policies to meet changing tasks and environmental conditions.<n>Many such systems leverage soft components, which enable shape morphing but also introduce simulation and control challenges.<n>Here, we present a surrogate compliance modeling approach: rather than explicitly modeling soft-body physics, we introduce indirect variables representing soft-material deformation within a rigid-body simulator.
  arXiv  Detail & Related papers  (2025-12-08T02:52:42Z)
• Jump-Start Reinforcement Learning with Self-Evolving Priors for Extreme Monopedal Locomotion [11.692916662706361]
  We propose JumpER (jump-start reinforcement learning via self-evolving priors), an RL training framework that structures policy learning into multiple stages of increasing complexity.<n>By dynamically generating self-evolving priors, JumpER progressively refines and enhances guidance, thereby stabilizing exploration and policy optimization.<n>The resulting policy effectively handles challenging scenarios that traditional methods struggle to conquer, including wide gaps up to 60 cm, irregularly spaced stairs, and stepping stones with distances varying from 15 cm to 35 cm.
  arXiv  Detail & Related papers  (2025-07-01T23:31:36Z)
• Coordinating Spinal and Limb Dynamics for Enhanced Sprawling Robot Mobility [0.047116288835793156]
  A flexible spine enables undulation of the body through a wavelike motion along the spine, aiding navigation over uneven terrains and obstacles.<n>Environmental uncertainties, such as surface irregularities and variations in friction, can significantly disrupt body-limb coordination.<n>Deep reinforcement learning offers a promising framework for handling non-deterministic environments.<n>We comparatively examine learning-based control strategies and biologically inspired gait design methods on a salamander-like robot.
  arXiv  Detail & Related papers  (2025-04-18T23:08:48Z)
• MoE-Loco: Mixture of Experts for Multitask Locomotion [52.04025933292957]
  We present MoE-Loco, a framework for multitask locomotion for legged robots.<n>Our method enables a single policy to handle diverse terrains, while supporting quadrupedal and bipedal gaits.
  arXiv  Detail & Related papers  (2025-03-11T15:53:54Z)
• Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning [54.26816599309778]
  We propose a novel whole-body locomotion algorithm based on dynamic balance and Reinforcement Learning (RL)<n> Specifically, we introduce a dynamic balance mechanism by leveraging an extended measure of Zero-Moment Point (ZMP)-driven rewards and task-driven rewards in a whole-body actor-critic framework.<n> Experiments conducted on a full-sized Unitree H1-2 robot verify the ability of our method to maintain balance on extremely narrow terrains.
  arXiv  Detail & Related papers  (2025-02-24T14:53:45Z)
• VAE-Loco: Versatile Quadruped Locomotion by Learning a Disentangled Gait Representation [78.92147339883137]
  We show that it is pivotal in increasing controller robustness by learning a latent space capturing the key stance phases constituting a particular gait. We demonstrate that specific properties of the drive signal map directly to gait parameters such as cadence, footstep height and full stance duration. The use of a generative model facilitates the detection and mitigation of disturbances to provide a versatile and robust planning framework.
  arXiv  Detail & Related papers  (2022-05-02T19:49:53Z)
• Next Steps: Learning a Disentangled Gait Representation for Versatile Quadruped Locomotion [69.87112582900363]
  Current planners are unable to vary key gait parameters continuously while the robot is in motion. In this work we address this limitation by learning a latent space capturing the key stance phases constituting a particular gait. We demonstrate that specific properties of the drive signal map directly to gait parameters such as cadence, foot step height and full stance duration.
  arXiv  Detail & Related papers  (2021-12-09T10:02:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.