Efficient Learning-Based Control of a Legged Robot in Lunar Gravity
- URL: http://arxiv.org/abs/2509.10128v1
- Date: Fri, 12 Sep 2025 10:43:58 GMT
- Title: Efficient Learning-Based Control of a Legged Robot in Lunar Gravity
- Abstract summary: Legged robots are promising candidates for exploring challenging areas on low-gravity bodies.<n>These robots need energy-efficient control approaches that easily transfer to multiple gravity environments.<n>We introduce a reinforcement learning-based control approach for legged robots with gravity-scaled power-optimized reward functions.
- Score: 6.923275442275323
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Legged robots are promising candidates for exploring challenging areas on low-gravity bodies such as the Moon, Mars, or asteroids, thanks to their advanced mobility on unstructured terrain. However, as planetary robots' power and thermal budgets are highly restricted, these robots need energy-efficient control approaches that easily transfer to multiple gravity environments. In this work, we introduce a reinforcement learning-based control approach for legged robots with gravity-scaled power-optimized reward functions. We use our approach to develop and validate a locomotion controller and a base pose controller in gravity environments from lunar gravity (1.62 m/s2) to a hypothetical super-Earth (19.62 m/s2). Our approach successfully scales across these gravity levels for locomotion and base pose control with the gravity-scaled reward functions. The power-optimized locomotion controller reached a power consumption for locomotion of 23.4 W in Earth gravity on a 15.65 kg robot at 0.4 m/s, a 23 % improvement over the baseline policy. Additionally, we designed a constant-force spring offload system that allowed us to conduct real-world experiments on legged locomotion in lunar gravity. In lunar gravity, the power-optimized control policy reached 12.2 W, 36 % less than a baseline controller which is not optimized for power efficiency. Our method provides a scalable approach to developing power-efficient locomotion controllers for legged robots across multiple gravity levels.
Related papers
- Anti-Gravity Walking by a Flying Humanoid Robot via Thrust-Rate Input Whole-Body Model Predictive Control [10.590519863878098]
We propose and implement a real-time whole-body MPC framework for anti-gravity walking.<n>First, we formulate whole-body MPC using the time derivative of thrust, namely thrust-rate, as the control input.<n>Second, we address the lack of natural support forces in anti-gravity environments.
arXiv Detail & Related papers (2026-09-07T14:27:33Z) - Long-Distance Real-World Navigation of the Legged-Wheeled Robot Go2-W Using Deep Reinforcement Learning [3.0827963321492184]
This paper reports our effort to build a deep reinforcement learning (DRL) based locomotion controller and an autonomous navigation system for the commercially available legged-wheeled robot Go2-W.<n>For locomotion control, we extended a proprioception-only policy, which we had previously developed for quadruped robots, to the 16-DoF legged-wheeled robot.<n>We also found that wheeled locomotion concentrates the load on the hip joints and causes heat concentration that hinders sustained travel, and obtained a policy that suppresses it by distributing the load.
arXiv Detail & Related papers (2026-06-19T12:53:37Z) - Underactuated multimodal jumping robot for extraterrestrial exploration [0.3867363075280543]
We present a rolling and jumping underactuated monopedal robot designed to explore multimodal locomotion on low-gravity bodies.<n>It uses only two reaction wheels to control its spatial orientation with two controllers: a balancing controller which can aim the robot's jump direction on the ground, and an aerial reorientation controller which can aim the robot's leg for landing after flight.
arXiv Detail & Related papers (2026-03-06T18:08:32Z) - Jumping Control for a Quadrupedal Wheeled-Legged Robot via NMPC and DE Optimization [14.88101223616473]
Quadrupedal wheeled-legged robots combine the advantages of legged and wheeled locomotion to achieve superior mobility.<n> executing dynamic jumps remains a significant challenge due to the additional degrees of freedom introduced by wheeled legs.<n>This paper develops a mini-sized wheeled-legged robot for agile motion and presents a novel motion control framework.
arXiv Detail & Related papers (2026-02-25T06:13:59Z) - KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skills [50.34487144149439]
This paper presents a physics-based humanoid control framework, aiming to master highly-dynamic human behaviors such as Kungfu and dancing.<n>For motion processing, we design a pipeline to extract, filter out, correct, and retarget motions, while ensuring compliance with physical constraints.<n>For motion imitation, we formulate a bi-level optimization problem to dynamically adjust the tracking accuracy tolerance.<n>In experiments, we train whole-body control policies to imitate a set of highly-dynamic motions.
arXiv Detail & Related papers (2025-06-15T13:58:53Z) - FACET: Force-Adaptive Control via Impedance Reference Tracking for Legged Robots [23.645867340878574]
We present emphForce-Adaptive Control via Impedance Reference Tracking (FACET)<n>Inspired by impedance control, we use RL to train a control policy to imitate a virtual mass-spring-damper system.<n>In simulation, we demonstrate that our quadruped robot achieves improved robustness to large impulses and exhibits controllable compliance.
arXiv Detail & Related papers (2025-05-11T07:23:26Z) - Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning [54.26816599309778]
We propose a novel whole-body locomotion algorithm based on dynamic balance and Reinforcement Learning (RL)<n> Specifically, we introduce a dynamic balance mechanism by leveraging an extended measure of Zero-Moment Point (ZMP)-driven rewards and task-driven rewards in a whole-body actor-critic framework.<n> Experiments conducted on a full-sized Unitree H1-2 robot verify the ability of our method to maintain balance on extremely narrow terrains.
arXiv Detail & Related papers (2025-02-24T14:53:45Z) - Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Control [18.269588421166503]
Humanoid robots require robust lower-body locomotion and precise upper-body manipulation.<n>Recent Reinforcement Learning approaches provide whole-body loco-manipulation policies, but lack precise manipulation.<n>We introduce high-body kinematic control using inverses (IK) and motion for precise manipulation.<n>We show that CVAE features are crucial for stability and robustness, and significantly outperforms RL-based whole-body control in precise manipulation.
arXiv Detail & Related papers (2024-12-10T18:59:50Z) - Learning to enhance multi-legged robot on rugged landscapes [7.956679144631909]
Multi-legged robots offer a promising solution forNavigating rugged landscapes.
Recent studies have shown that a linear controller can ensure reliable mobility on challenging terrains.
We develop a MuJoCo-based simulator tailored to this robotic platform and use the simulation to develop a reinforcement learning-based control framework.
arXiv Detail & Related papers (2024-09-14T15:53:08Z) - Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control [106.32794844077534]
This paper presents a study on using deep reinforcement learning to create dynamic locomotion controllers for bipedal robots.
We develop a general control solution that can be used for a range of dynamic bipedal skills, from periodic walking and running to aperiodic jumping and standing.
This work pushes the limits of agility for bipedal robots through extensive real-world experiments.
arXiv Detail & Related papers (2024-01-30T10:48:43Z) - Barkour: Benchmarking Animal-level Agility with Quadruped Robots [70.97471756305463]
We introduce the Barkour benchmark, an obstacle course to quantify agility for legged robots.
Inspired by dog agility competitions, it consists of diverse obstacles and a time based scoring mechanism.
We present two methods for tackling the benchmark.
arXiv Detail & Related papers (2023-05-24T02:49:43Z) - Continuous Versatile Jumping Using Learned Action Residuals [35.996425893483796]
We propose a hierarchical framework that combines optimal control and reinforcement learning to learn continuous jumping motions for quadrupedal robots.
The core of our framework is a stance controller, which combines a manually designed acceleration controller with a learned residual policy.
After training in simulation, our framework can be deployed directly to the real robot, and perform versatile, continuous jumping motions.
arXiv Detail & Related papers (2023-04-17T23:28:32Z) - Learning Bipedal Walking for Humanoids with Current Feedback [5.429166905724048]
We present an approach for overcoming the sim2real gap issue for humanoid robots arising from inaccurate torque-tracking at the actuator level.
Our approach successfully trains a unified, end-to-end policy in simulation that can be deployed on a real HRP-5P humanoid robot to achieve bipedal locomotion.
arXiv Detail & Related papers (2023-03-07T08:16:46Z) - Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills
using a Quadrupedal Robot [76.04391023228081]
We address the problem of enabling quadrupedal robots to perform precise shooting skills in the real world using reinforcement learning.
We propose a hierarchical framework that leverages deep reinforcement learning to train a robust motion control policy.
We deploy the proposed framework on an A1 quadrupedal robot and enable it to accurately shoot the ball to random targets in the real world.
arXiv Detail & Related papers (2022-08-01T22:34:51Z) - Agile Maneuvers in Legged Robots: a Predictive Control Approach [20.55884151818753]
We present a contact-phase predictive and state-feedback controllers that enables legged robots to plan and perform agile locomotion skills.
Our work is the first to show that predictive control can handle actuation limits, generate agile locomotion maneuvers and execute locally optimal feedback policies on hardware without the use of a separate whole-body controller.
arXiv Detail & Related papers (2022-03-14T23:32:17Z) - Learning Quadrupedal Locomotion over Challenging Terrain [68.51539602703662]
Legged locomotion can dramatically expand the operational domains of robotics.
Conventional controllers for legged locomotion are based on elaborate state machines that explicitly trigger the execution of motion primitives and reflexes.
Here we present a radically robust controller for legged locomotion in challenging natural environments.
arXiv Detail & Related papers (2020-10-21T19:11:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.