Robust Fall Recovery for Armless Bipedal-Wheeled Robots Via Force-Guided Learning
- URL: http://arxiv.org/abs/2606.14270v1
- Date: Fri, 12 Jun 2026 08:51:51 GMT
- Title: Robust Fall Recovery for Armless Bipedal-Wheeled Robots Via Force-Guided Learning
- Abstract summary: Some humanoids and quadrupeds are capable of fall recovery from diverse postures by utilizing arms or coordinating multi-legs to generate support forces.<n>Without arms or other legs to provide supportive assistance, a bi-wheeled robot must rely solely on the actuation of its legs.<n>We introduce FTSR (Force-guided Teacher-student framework with Stage-wise Rewards) to address this problem.
- Score: 13.56238998710442
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Fall recovery is critical for autonomous legged locomotion. Existing methods have demonstrated that some legged robots, such as humanoids and quadrupeds, are capable of fall recovery from diverse postures by utilizing arms or coordinating multi-legs to generate support forces. Without arms or other legs to provide supportive assistance, a bipedal-wheeled robot must rely solely on the actuation of its legs, making recovery particularly difficult. To address this, we introduce FTSR (Force-guided Teacher-student framework with Stage-wise Rewards). The force-guided method constructs an external auxiliary force during simulation training that correlates directly with the robot's real-time height, explicitly formulating this force as an optimizable constraint. Through constrained reinforcement learning, the policy is guided toward reducing force dependency gradually and increasing the body height, developing internal recovery strategies despite having no arms for support. Height-progressive stage-Wise rewards progressively structure posture stabilization during recovery and transition to sustained locomotion, integrated with teacher-student architecture distilling privileged knowledge of force effects and recovery dynamics. After simulation training, the policy is deployed on a physical armless bipedal-wheeled robot and extensively evaluated. Experiments confirm robust and reliable fall recovery under diverse challenging conditions, demonstrating strong environmental adaptability and motion robustness, while maintaining full post-recovery motion capability. The framework also generalizes effectively to a high-DOF humanoid, confirming its practical generalizability. The project page is available at https://2350575870.github.io/force-guided.github.io/
Related papers
- Natural Sit-to-Stand Motion Synthesis For Humanoids via Guided Assistance Curricula and Staged Rewards [0.0]
Policy learns smooth, human-like rising driven by three complementary components.<n>Policy attains more than 97% balanced-standing success across eight chair heights.
arXiv Detail & Related papers (2026-08-21T07:44:00Z) - RPG: Robust Policy Gating for Smooth Multi-Skill Transitions in Humanoid Fighting [52.18271301977709]
We propose RPG, a hybrid expert policy framework, for smooth and stable humanoid multi-skills transition.<n>Our approach incorporates motion transition randomization and temporal randomization to train a unified policy that generates agile fighting actions.<n>We design a control pipeline that integrates walking/running locomotion with fighting skills, allowing humanlike long-time combat of arbitrary duration.
arXiv Detail & Related papers (2026-04-23T07:14:35Z) - Reinforcement Learning Enabled Adaptive Multi-Task Control for Bipedal Soccer Robots [1.6824051304328205]
This paper proposes a modular reinforcement learning framework for achieving adaptive multi-task control.<n>A posture-driven statemachine is introduced, clearly switching between the ball and kicking network (BSKN) and the fall recoverynetwork (FRN)
arXiv Detail & Related papers (2026-04-21T05:27:43Z) - Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching [77.28042137892943]
We present Perceptive Humanoid Parkour (PHP), a modular framework that enables humanoid robots to autonomously perform long-horizon, vision-based parkour.<n>We train motion-tracking reinforcement learning expert policies for these composed motions, and distill them into a single depth-based, multi-skill student policy.<n>We validate our framework with extensive real-world experiments on a Unitree G1 humanoid robot.
arXiv Detail & Related papers (2026-02-17T18:59:11Z) - A Kung Fu Athlete Bot That Can Do It All Day: Highly Dynamic, Balance-Challenging Motion Dataset and Autonomous Fall-Resilient Tracking [5.968082051565195]
Martial arts are characterized by rapid center-of-mass shifts, complex coordination, and abrupt posture transitions.<n>KungFuAthlete is a high-dynamic martial arts motion dataset derived from professional athletes' daily training videos.<n>We propose a novel training paradigm that enables a single policy to jointly learn high-dynamic motion tracking and fall recovery.
arXiv Detail & Related papers (2026-02-14T07:49:56Z) - Gait-Adaptive Perceptive Humanoid Locomotion with Real-Time Under-Base Terrain Reconstruction [86.53248703859718]
We introduce a perceptive locomotion framework that merges terrain sensing, gait regulation, and whole-body control into a single reinforcement learning policy.<n>Experiments conducted on a 31-DoF, 1.65 m humanoid robot demonstrate robust locomotion in both simulation and real-world settings.
arXiv Detail & Related papers (2025-12-08T11:42:41Z) - Learning to Recover: Dynamic Reward Shaping with Wheel-Leg Coordination for Fallen Robots [10.712715061996194]
This paper presents a learning-based framework integrating Episode-based Dynamic Reward Shaping and curriculum learning.<n>We demonstrate that synergistic wheel-leg coordination reduces joint torque consumption by 15.8% and 26.2%.
arXiv Detail & Related papers (2025-06-05T18:58:12Z) - Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning [54.26816599309778]
We propose a novel whole-body locomotion algorithm based on dynamic balance and Reinforcement Learning (RL)<n> Specifically, we introduce a dynamic balance mechanism by leveraging an extended measure of Zero-Moment Point (ZMP)-driven rewards and task-driven rewards in a whole-body actor-critic framework.<n> Experiments conducted on a full-sized Unitree H1-2 robot verify the ability of our method to maintain balance on extremely narrow terrains.
arXiv Detail & Related papers (2025-02-24T14:53:45Z) - Learning Humanoid Standing-up Control across Diverse Postures [27.79222176982376]
Standing-up control is crucial for humanoid robots, with the potential for integration into current locomotion and loco-manipulation systems.<n>We present HoST (Humanoid Standing-up Control), a reinforcement learning framework that learns standing-up control from scratch.<n>Our experimental results demonstrate that the controllers achieve smooth, stable, and robust standing-up motions across a wide range of laboratory and outdoor environments.
arXiv Detail & Related papers (2025-02-12T13:10:09Z) - Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control [106.32794844077534]
This paper presents a study on using deep reinforcement learning to create dynamic locomotion controllers for bipedal robots.
We develop a general control solution that can be used for a range of dynamic bipedal skills, from periodic walking and running to aperiodic jumping and standing.
This work pushes the limits of agility for bipedal robots through extensive real-world experiments.
arXiv Detail & Related papers (2024-01-30T10:48:43Z) - Natural and Robust Walking using Reinforcement Learning without
Demonstrations in High-Dimensional Musculoskeletal Models [29.592874007260342]
Humans excel at robust bipedal walking in complex natural environments.
It is still not fully understood how the nervous system resolves the musculoskeletal redundancy to solve the multi-objective control problem.
arXiv Detail & Related papers (2023-09-06T13:20:31Z) - Robust and Versatile Bipedal Jumping Control through Reinforcement
Learning [141.56016556936865]
This work aims to push the limits of agility for bipedal robots by enabling a torque-controlled bipedal robot to perform robust and versatile dynamic jumps in the real world.
We present a reinforcement learning framework for training a robot to accomplish a large variety of jumping tasks, such as jumping to different locations and directions.
We develop a new policy structure that encodes the robot's long-term input/output (I/O) history while also providing direct access to a short-term I/O history.
arXiv Detail & Related papers (2023-02-19T01:06:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.