Robust Quadruped Jumping via Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2011.07089v3
• Date: Fri, 11 Aug 2023 08:30:55 GMT
• Title: Robust Quadruped Jumping via Deep Reinforcement Learning
• Authors: Guillaume Bellegarda, Chuong Nguyen, Quan Nguyen
• Abstract summary: In this paper, we consider jumping varying distances and heights for a quadrupedal robot in noisy environments. We propose a framework using deep reinforcement learning that leverages and augments the complex solution of nonlinear trajectory optimization for quadrupedal jumping. We demonstrate robustness of foot disturbances of up to 6 cm in height, or 33% of the robot's nominal standing height, while jumping 2x the body length in distance.
• Score: 10.095966161524043
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we consider a general task of jumping varying distances and heights for a quadrupedal robot in noisy environments, such as off of uneven terrain and with variable robot dynamics parameters. To accurately jump in such conditions, we propose a framework using deep reinforcement learning that leverages and augments the complex solution of nonlinear trajectory optimization for quadrupedal jumping. While the standalone optimization limits jumping to take-off from flat ground and requires accurate assumptions of robot dynamics, our proposed approach improves the robustness to allow jumping off of significantly uneven terrain with variable robot dynamical parameters and environmental conditions. Compared with walking and running, the realization of aggressive jumping on hardware necessitates accounting for the motors' torque-speed relationship as well as the robot's total power limits. By incorporating these constraints into our learning framework, we successfully deploy our policy sim-to-real without further tuning, fully exploiting the available onboard power supply and motors. We demonstrate robustness to environment noise of foot disturbances of up to 6 cm in height, or 33% of the robot's nominal standing height, while jumping 2x the body length in distance.

Related papers

• Learning to enhance multi-legged robot on rugged landscapes [7.956679144631909]
  Multi-legged robots offer a promising solution forNavigating rugged landscapes. Recent studies have shown that a linear controller can ensure reliable mobility on challenging terrains. We develop a MuJoCo-based simulator tailored to this robotic platform and use the simulation to develop a reinforcement learning-based control framework.
  arXiv  Detail & Related papers  (2024-09-14T15:53:08Z)
• Impedance Matching: Enabling an RL-Based Running Jump in a Quadruped Robot [7.516046071926082]
  We propose a new framework to mitigate the gap between simulated and real robots. Our framework offers a structured guideline for parameter selection and the range for dynamics randomization in simulation. Results are, to the best of our knowledge, one of the highest and longest running jumps demonstrated by an RL-based control policy in a real quadruped robot.
  arXiv  Detail & Related papers  (2024-04-23T14:52:09Z)
• Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control [106.32794844077534]
  This paper presents a study on using deep reinforcement learning to create dynamic locomotion controllers for bipedal robots. We develop a general control solution that can be used for a range of dynamic bipedal skills, from periodic walking and running to aperiodic jumping and standing. This work pushes the limits of agility for bipedal robots through extensive real-world experiments.
  arXiv  Detail & Related papers  (2024-01-30T10:48:43Z)
• Barkour: Benchmarking Animal-level Agility with Quadruped Robots [70.97471756305463]
  We introduce the Barkour benchmark, an obstacle course to quantify agility for legged robots. Inspired by dog agility competitions, it consists of diverse obstacles and a time based scoring mechanism. We present two methods for tackling the benchmark.
  arXiv  Detail & Related papers  (2023-05-24T02:49:43Z)
• Robust and Versatile Bipedal Jumping Control through Reinforcement Learning [141.56016556936865]
  This work aims to push the limits of agility for bipedal robots by enabling a torque-controlled bipedal robot to perform robust and versatile dynamic jumps in the real world. We present a reinforcement learning framework for training a robot to accomplish a large variety of jumping tasks, such as jumping to different locations and directions. We develop a new policy structure that encodes the robot's long-term input/output (I/O) history while also providing direct access to a short-term I/O history.
  arXiv  Detail & Related papers  (2023-02-19T01:06:09Z)
• Creating a Dynamic Quadrupedal Robotic Goalkeeper with Reinforcement Learning [18.873152528330063]
  We present a reinforcement learning (RL) framework that enables quadrupedal robots to perform soccer goalkeeping tasks in the real world. Soccer goalkeeping using quadrupeds is a challenging problem, that combines highly dynamic locomotion with precise and fast non-prehensile object (ball) manipulation. We deploy the proposed framework on a Mini Cheetah quadrupedal robot and demonstrate the effectiveness of our framework for various agile interceptions of a fast-moving ball in the real world.
  arXiv  Detail & Related papers  (2022-10-10T04:54:55Z)
• Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills using a Quadrupedal Robot [76.04391023228081]
  We address the problem of enabling quadrupedal robots to perform precise shooting skills in the real world using reinforcement learning. We propose a hierarchical framework that leverages deep reinforcement learning to train a robust motion control policy. We deploy the proposed framework on an A1 quadrupedal robot and enable it to accurately shoot the ball to random targets in the real world.
  arXiv  Detail & Related papers  (2022-08-01T22:34:51Z)
• VAE-Loco: Versatile Quadruped Locomotion by Learning a Disentangled Gait Representation [78.92147339883137]
  We show that it is pivotal in increasing controller robustness by learning a latent space capturing the key stance phases constituting a particular gait. We demonstrate that specific properties of the drive signal map directly to gait parameters such as cadence, footstep height and full stance duration. The use of a generative model facilitates the detection and mitigation of disturbances to provide a versatile and robust planning framework.
  arXiv  Detail & Related papers  (2022-05-02T19:49:53Z)
• Next Steps: Learning a Disentangled Gait Representation for Versatile Quadruped Locomotion [69.87112582900363]
  Current planners are unable to vary key gait parameters continuously while the robot is in motion. In this work we address this limitation by learning a latent space capturing the key stance phases constituting a particular gait. We demonstrate that specific properties of the drive signal map directly to gait parameters such as cadence, foot step height and full stance duration.
  arXiv  Detail & Related papers  (2021-12-09T10:02:02Z)
• Autonomous Navigation of Underactuated Bipedal Robots in Height-Constrained Environments [20.246040671823554]
  This paper presents an end-to-end autonomous navigation framework for bipedal robots. A vertically-actuated Spring-Loaded Inverted Pendulum (vSLIP) model is introduced to capture the robot's coupled dynamics of planar walking and vertical walking height. A variable walking height controller is leveraged to enable the bipedal robot to maintain stable periodic walking gaits while following the planned trajectory.
  arXiv  Detail & Related papers  (2021-09-13T05:36:14Z)
• Autonomous Navigation for Quadrupedal Robots with Optimized Jumping through Constrained Obstacles [3.8651239621657654]
  This paper presents an end-to-end navigation framework for quadrupedal robots. To obtain a dynamic jumping maneuver while avoiding obstacles, dynamically-feasible trajectories are optimized offline. The framework is experimentally deployed and validated on a quadrupedal robot, a Mini Cheetah.
  arXiv  Detail & Related papers  (2021-07-01T23:40:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.