GM-Loco: Terrain-Adaptive Humanoid Locomotion on Granular Media

• URL: http://arxiv.org/abs/2609.10286v2
• Date: Mon, 14 Sep 2026 19:11:59 GMT
• Title: GM-Loco: Terrain-Adaptive Humanoid Locomotion on Granular Media
• Abstract summary: We present a physics-grounded granular contact model based on resistive force theory (3D RFT)<n>Unlike traditional rigid contact models and simplified granular contact models with ad-hocs, our contact solver produces physically accurate granular intrusion dynamics.<n>To the best of our knowledge, this is the first demonstration of agile humanoid locomotion on real-world granular terrain.
• Score: 10.30641031753662
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Humanoid locomotion on granular terrain remains a significant challenge due to its complex foot-terrain interaction dynamics that are difficult to model. Existing approaches either ignore granular contact dynamics or incorporate simplified normal force models with heuristic tangential components. In this work, we present a physics-grounded granular contact model based on three-dimensional resistive force theory (3D RFT) and efficiently simulate granular terrain for reinforcement learning (RL) training. Unlike traditional rigid contact models and simplified granular contact models with ad-hoc heuristics, our contact solver produces physically accurate granular intrusion dynamics without resorting to heuristics. It captures realistic penetration and tangential drag during training, enabling the policy to learn behaviors that transfer reliably to real-world granular terrain where rigid contact models fail. To adapt to varying terrain conditions, we train a terrain-adaptive locomotion controller via teacher-student RL, using a variational autoencoder to encode terrain information into a compact latent representation. Simulation studies using material point method (MPM) with NVIDIA Newton demonstrate that our method generalizes to unseen granular terrains, achieves a significantly higher success rate than baselines, and demonstrates zero-shot terrain identification and adaptation. We further validate our approach through extensive hardware experiments across diverse real-world granular terrains including basalt, dry sand, and beach sand. To the best of our knowledge, this is the first demonstration of agile humanoid locomotion on real-world granular terrain. Project page: https://humanoid-gm-locomotion.github.io/HUMANOID-GM/

Related papers

• MILD: Tractable Terrain Modeling for Learning Improved Bipedal Locomotion on Deformable Surfaces [27.312811759047023]
  We present MILD, featuring a physics-grounded discrete-element contact solver.<n>We train a terrain-aware controller via deep reinforcement learning.<n>We demonstrate the system's capability online identification and adaptation across a wide range of surface stiffness.
  arXiv  Detail & Related papers  (2026-08-20T12:24:34Z)
• GAUGE: A Measurement-Grounded Benchmark for Physical Fidelity in Simulation Engines and Video World Models [66.77745044586173]
  GAUGE is a real-world-grounded diagnostic benchmark for evaluating how numerical simulators and generative video world models reproduce or deviate from real-world physics.<n>We benchmark Isaac Sim, Genesis, and Newton on 14 task families using generalized trajectory errors, and evaluate 6 image-to-video models on 5 rigid-body tasks.<n>Our results reveal no uniformly faithful physics engine, with the largest discrepancies arising in impulsive contact, rapid textile motion, and volumetric deformation.
  arXiv  Detail & Related papers  (2026-08-06T12:19:38Z)
• Learning a Particle Dynamics Model with Real-world Videos [3.8381345540147414]
  We introduce a novel framework for training neural object dynamics models directly from unlabeled real-world videos.<n>The model is trained via rendering supervision, enabling learning from real-world videos without requiring particle-level labeled states.<n>To enable this study, we also present a real-world dataset consisting of about 500 videos capturing diverse object interactions.
  arXiv  Detail & Related papers  (2026-05-22T16:56:27Z)
• Inverse Resistive Force Theory (I-RFT): Learning granular properties through robot-terrain physical interactions [7.397755522601659]
  We introduce a physics-informed machine learning framework, Inverse Resistive Force Theory (I-RFT), to infer terrain properties.<n>I-RFT preserves physical consistency while enabling generalization across diverse motion primitives.<n>We show that I-RFT accurately estimates terrain properties across multiple gait trajectories and toe shapes.
  arXiv  Detail & Related papers  (2026-03-08T20:30:31Z)
• D-REX: Differentiable Real-to-Sim-to-Real Engine for Learning Dexterous Grasping [66.22412592525369]
  We introduce a real-to-sim-to-real engine that leverages the Gaussian Splat representations to build a differentiable engine.<n>We show that our engine achieves accurate and robust performance in mass identification across various object geometries and mass values.<n>Those optimized mass values facilitate force-aware policy learning, achieving superior and high performance in object grasping.
  arXiv  Detail & Related papers  (2026-03-01T15:32:04Z)
• MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstruction [54.36564144414704]
  MeshMimic is an innovative framework that bridges 3D scene reconstruction and embodied intelligence to enable humanoid robots to learn coupled "motion-terrain" interactions directly from video.<n>By leveraging state-of-the-art 3D vision models, our framework precisely segments and reconstructs both human trajectories and the underlying 3D geometry of terrains and objects.
  arXiv  Detail & Related papers  (2026-02-17T17:09:45Z)
• Surrogate compliance modeling enables reinforcement learned locomotion gaits for soft robots [5.193389420813379]
  Adaptive morphogenetic robots adapt their morphology and control policies to meet changing tasks and environmental conditions.<n>Many such systems leverage soft components, which enable shape morphing but also introduce simulation and control challenges.<n>Here, we present a surrogate compliance modeling approach: rather than explicitly modeling soft-body physics, we introduce indirect variables representing soft-material deformation within a rigid-body simulator.
  arXiv  Detail & Related papers  (2025-12-08T02:52:42Z)
• Contact-Implicit Modeling and Simulation of a Snake Robot on Compliant and Granular Terrain [0.0]
  This thesis presents a unified modeling and simulation framework for analyzing sidewinding and tumbling locomotion of the COBRA snake robot.<n>A contact-implicit formulation is used to model distributed frictional interactions during sidewinding.<n>For high-energy rolling locomotion on steep slopes, the Chrono DEM Engine is used to simulate particle-resolved granular interactions.
  arXiv  Detail & Related papers  (2025-12-04T17:20:32Z)
• Learning Humanoid Locomotion over Challenging Terrain [84.35038297708485]
  We present a learning-based approach for blind humanoid locomotion capable of traversing challenging natural and man-made terrains. Our model is first pre-trained on a dataset of flat-ground trajectories with sequence modeling, and then fine-tuned on uneven terrain using reinforcement learning. We evaluate our model on a real humanoid robot across a variety of terrains, including rough, deformable, and sloped surfaces.
  arXiv  Detail & Related papers  (2024-10-04T17:57:09Z)
• GraMMaR: Ground-aware Motion Model for 3D Human Motion Reconstruction [61.833152949826946]
  We propose a novel Ground-aware Motion Model for 3D Human Motion Reconstruction, named GraMMaR. GraMMaR learns the distribution of transitions in both pose and interaction between every joint and ground plane at each time step of a motion sequence. It is trained to explicitly promote consistency between the motion and distance change towards the ground.
  arXiv  Detail & Related papers  (2023-06-29T07:22:20Z)
• Real-World Humanoid Locomotion with Reinforcement Learning [92.85934954371099]
  We present a fully learning-based approach for real-world humanoid locomotion. Our controller can walk over various outdoor terrains, is robust to external disturbances, and can adapt in context.
  arXiv  Detail & Related papers  (2023-03-06T18:59:09Z)
• Deep Generative Framework for Interactive 3D Terrain Authoring and Manipulation [4.202216894379241]
  We propose a novel realistic terrain authoring framework powered by a combination of VAE and generative conditional GAN model. Our framework is an example-based method that attempts to overcome the limitations of existing methods by learning a latent space from a real-world terrain dataset. We also developed an interactive tool, that lets the user generate diverse terrains with minimalist inputs.
  arXiv  Detail & Related papers  (2022-01-07T08:58:01Z)
• Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling [86.9726984929758]
  We focus on the integration of incomplete physics models into deep generative models. We propose a VAE architecture in which a part of the latent space is grounded by physics. We demonstrate generative performance improvements over a set of synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2021-02-25T20:28:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.