VIGOR: Visual Goal-In-Context Inference for Unified Humanoid Fall Safety

• URL: http://arxiv.org/abs/2602.16511v2
• Date: Tue, 03 Mar 2026 21:24:18 GMT
• Title: VIGOR: Visual Goal-In-Context Inference for Unified Humanoid Fall Safety
• Abstract summary: We present a unified fall safety approach that spans all phases of fall recovery.<n>We train a privileged teacher using sparse human demonstrations on flat terrain and simulated complex terrains.<n>Results in simulation and on a real Unitree G1 humanoid demonstrate robust, zero-shot fall safety across diverse non-flat environments.
• Score: 22.62399552569191
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Reliable fall recovery is critical for humanoids operating in cluttered environments. Unlike quadrupeds or wheeled robots, humanoids experience high-energy impacts, complex whole-body contact, and large viewpoint changes during a fall, making recovery essential for continued operation. Existing methods fragment fall safety into separate problems such as fall avoidance, impact mitigation, and stand-up recovery, or rely on end-to-end policies trained without vision through reinforcement learning or imitation learning, often on flat terrain. At a deeper level, fall safety is treated as monolithic data complexity, coupling pose, dynamics, and terrain and requiring exhaustive coverage, limiting scalability and generalization. We present a unified fall safety approach that spans all phases of fall recovery. It builds on two insights: 1) Natural human fall and recovery poses are highly constrained and transferable from flat to complex terrain through alignment, and 2) Fast whole-body reactions require integrated perceptual-motor representations. We train a privileged teacher using sparse human demonstrations on flat terrain and simulated complex terrains, and distill it into a deployable student that relies only on egocentric depth and proprioception. The student learns how to react by matching the teacher's goal-in-context latent representation, which combines the next target pose with the local terrain, rather than separately encoding what it must perceive and how it must act. Results in simulation and on a real Unitree G1 humanoid demonstrate robust, zero-shot fall safety across diverse non-flat environments without real-world fine-tuning. The project page is available at https://vigor2026.github.io/

Related papers

• Robust Fall Recovery for Armless Bipedal-Wheeled Robots Via Force-Guided Learning [13.56238998710442]
  Some humanoids and quadrupeds are capable of fall recovery from diverse postures by utilizing arms or coordinating multi-legs to generate support forces.<n>Without arms or other legs to provide supportive assistance, a bi-wheeled robot must rely solely on the actuation of its legs.<n>We introduce FTSR (Force-guided Teacher-student framework with Stage-wise Rewards) to address this problem.
  arXiv  Detail & Related papers  (2026-06-12T08:51:51Z)
• PTDL:Multi-Terrain Fall Recovery via Phase-Terrain Decoupled Learning [13.93626645001]
  Humanoid robots can fall on slopes, gravel, and uneven ground in unstructured environments.<n>We propose Phase--Terrain Decoupled Learning (PTDL), which decouples training supervision along phase and terrain axes.<n>We validate PTDL on a 29-DoF Unitree G1 across flat ground, gravel, and slopes up to 20 degrees in simulation and on hardware.
  arXiv  Detail & Related papers  (2026-06-08T02:01:08Z)
• Plan in Sandbox, Navigate in Open Worlds: Learning Physics-Grounded Abstracted Experience for Embodied Navigation [63.11032720821731]
  textitSAGE is a framework that enables agents to learn within a physics-grounded semantic abstraction rather than a photorealistic simulation.<n>We demonstrate that textitSAGE significantly improves planner-assisted embodied navigation, achieving a 53.21% LLM-Match Success Rate on A-EQA.
  arXiv  Detail & Related papers  (2026-05-11T07:34:30Z)
• Embedding Classical Balance Control Principles in Reinforcement Learning for Humanoid Recovery [1.0883174135300417]
  Humans are vulnerable to falls and unrecoverable failure states, limiting their practical utility in unstructured environments.<n>We present a unified RL policy that addresses this limitation by embedding classical balance metrics.<n>The policy achieves a 93.4% recovery rate across randomized initial poses and unscripted fall configurations.
  arXiv  Detail & Related papers  (2026-03-09T17:02:30Z)
• Learning Soccer Skills for Humanoid Robots: A Progressive Perception-Action Framework [50.6604971348824]
  Soccer presents a significant challenge for humanoid robots, demanding tightly integrated perception-action capabilities.<n>We propose Perception-Action integrated Decision-making (PAiD), a progressive architecture that decomposes soccer skill acquisition into three stages.<n> Experiments on the Unitree G1 demonstrate high-fidelity human-like kicking with robust performance under diverse conditions.
  arXiv  Detail & Related papers  (2026-02-05T05:05:03Z)
• Hiking in the Wild: A Scalable Perceptive Parkour Framework for Humanoids [30.976354277907664]
  textitHiking in the Wild is a scalable, end-to-end parkour perceptive framework designed for robust humanoid hiking.<n>Our approach utilizes a single-stage reinforcement learning scheme, mapping raw depth inputs and proprioception directly to joint actions, without relying on external state estimation.
  arXiv  Detail & Related papers  (2026-01-12T16:50:50Z)
• Gait-Adaptive Perceptive Humanoid Locomotion with Real-Time Under-Base Terrain Reconstruction [86.53248703859718]
  We introduce a perceptive locomotion framework that merges terrain sensing, gait regulation, and whole-body control into a single reinforcement learning policy.<n>Experiments conducted on a 31-DoF, 1.65 m humanoid robot demonstrate robust locomotion in both simulation and real-world settings.
  arXiv  Detail & Related papers  (2025-12-08T11:42:41Z)
• GentleHumanoid: Learning Upper-body Compliance for Contact-rich Human and Object Interaction [14.278503723930998]
  GentleHumanoid is a framework that integrates impedance control into a whole-body motion tracking policy to achieve upper-body compliance.<n>We evaluate our approach in both simulation and on the Unitree G1 humanoid across tasks requiring different levels of compliance.
  arXiv  Detail & Related papers  (2025-11-06T18:59:33Z)
• PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction System [67.2851799763138]
  PhysHSI comprises a simulation training pipeline and a real-world deployment system.<n>In simulation, we adopt adversarial motion prior-based policy learning to imitate natural humanoid-scene interaction data.<n>For real-world deployment, we introduce a coarse-to-fine object localization module that combines LiDAR and camera inputs.
  arXiv  Detail & Related papers  (2025-10-13T07:11:37Z)
• PhysHMR: Learning Humanoid Control Policies from Vision for Physically Plausible Human Motion Reconstruction [52.44375492811009]
  We present PhysHMR, a unified framework that learns a visual-to-action policy for humanoid control in a physics-based simulator.<n>A key component of our approach is the pixel-as-ray strategy, which lifts 2D keypoints into 3D spatial rays and transforms them into global space.<n>PhysHMR produces high-fidelity, physically plausible motion across diverse scenarios, outperforming prior approaches in both visual accuracy and physical realism.
  arXiv  Detail & Related papers  (2025-10-02T21:01:11Z)
• HOSIG: Full-Body Human-Object-Scene Interaction Generation with Hierarchical Scene Perception [57.37135310143126]
  HO SIG is a novel framework for synthesizing full-body interactions through hierarchical scene perception.<n>Our framework supports unlimited motion length through autoregressive generation and requires minimal manual intervention.<n>This work bridges the critical gap between scene-aware navigation and dexterous object manipulation.
  arXiv  Detail & Related papers  (2025-06-02T12:08:08Z)
• Learning Humanoid Locomotion with World Model Reconstruction [8.27902320260747]
  We introduce World Model Reconstruction (WMR), an end-to-end learning-based approach for blind humanoid locomotion.<n>We train an estimator to explicitly reconstruct the world state and utilize it to enhance the locomotion policy.<n>The robot successfully completed a 3.2 km hike without any human assistance.
  arXiv  Detail & Related papers  (2025-02-22T13:57:56Z)
• GraMMaR: Ground-aware Motion Model for 3D Human Motion Reconstruction [61.833152949826946]
  We propose a novel Ground-aware Motion Model for 3D Human Motion Reconstruction, named GraMMaR. GraMMaR learns the distribution of transitions in both pose and interaction between every joint and ground plane at each time step of a motion sequence. It is trained to explicitly promote consistency between the motion and distance change towards the ground.
  arXiv  Detail & Related papers  (2023-06-29T07:22:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.