Advanced Skills by Learning Locomotion and Local Navigation End-to-End

• URL: http://arxiv.org/abs/2209.12827v1
• Date: Mon, 26 Sep 2022 16:35:00 GMT
• Title: Advanced Skills by Learning Locomotion and Local Navigation End-to-End
• Authors: Nikita Rudin, David Hoeller, Marko Bjelonic and Marco Hutter
• Abstract summary: In this work, we propose to solve the complete problem by training an end-to-end policy with deep reinforcement learning. We demonstrate the successful deployment of policies on a real quadrupedal robot.
• Score: 10.872193480485596
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The common approach for local navigation on challenging environments with legged robots requires path planning, path following and locomotion, which usually requires a locomotion control policy that accurately tracks a commanded velocity. However, by breaking down the navigation problem into these sub-tasks, we limit the robot's capabilities since the individual tasks do not consider the full solution space. In this work, we propose to solve the complete problem by training an end-to-end policy with deep reinforcement learning. Instead of continuously tracking a precomputed path, the robot needs to reach a target position within a provided time. The task's success is only evaluated at the end of an episode, meaning that the policy does not need to reach the target as fast as possible. It is free to select its path and the locomotion gait. Training a policy in this way opens up a larger set of possible solutions, which allows the robot to learn more complex behaviors. We compare our approach to velocity tracking and additionally show that the time dependence of the task reward is critical to successfully learn these new behaviors. Finally, we demonstrate the successful deployment of policies on a real quadrupedal robot. The robot is able to cross challenging terrains, which were not possible previously, while using a more energy-efficient gait and achieving a higher success rate.

Related papers

• Multi-Robot Informative Path Planning for Efficient Target Mapping using Deep Reinforcement Learning [11.134855513221359]
  We propose a novel deep reinforcement learning approach for multi-robot informative path planning. We train our reinforcement learning policy via the centralized training and decentralized execution paradigm. Our approach outperforms other state-of-the-art multi-robot target mapping approaches by 33.75% in terms of the number of discovered targets-of-interest.
  arXiv  Detail & Related papers  (2024-09-25T14:27:37Z)
• Learning Bipedal Walking for Humanoid Robots in Challenging Environments with Obstacle Avoidance [0.3481985817302898]
  Deep reinforcement learning has seen successful implementations on humanoid robots to achieve dynamic walking. In this paper, we aim to achieve bipedal locomotion in an environment where obstacles are present using a policy-based reinforcement learning.
  arXiv  Detail & Related papers  (2024-09-25T07:02:04Z)
• Robust and Versatile Bipedal Jumping Control through Reinforcement Learning [141.56016556936865]
  This work aims to push the limits of agility for bipedal robots by enabling a torque-controlled bipedal robot to perform robust and versatile dynamic jumps in the real world. We present a reinforcement learning framework for training a robot to accomplish a large variety of jumping tasks, such as jumping to different locations and directions. We develop a new policy structure that encodes the robot's long-term input/output (I/O) history while also providing direct access to a short-term I/O history.
  arXiv  Detail & Related papers  (2023-02-19T01:06:09Z)
• Legged Locomotion in Challenging Terrains using Egocentric Vision [70.37554680771322]
  We present the first end-to-end locomotion system capable of traversing stairs, curbs, stepping stones, and gaps. We show this result on a medium-sized quadruped robot using a single front-facing depth camera.
  arXiv  Detail & Related papers  (2022-11-14T18:59:58Z)
• A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Learning [86.06110576808824]
  Deep reinforcement learning is a promising approach to learning policies in uncontrolled environments. Recent advancements in machine learning algorithms and libraries combined with a carefully tuned robot controller lead to learning quadruped in only 20 minutes in the real world.
  arXiv  Detail & Related papers  (2022-08-16T17:37:36Z)
• Deep Hierarchical Planning from Pixels [86.14687388689204]
  Director is a method for learning hierarchical behaviors directly from pixels by planning inside the latent space of a learned world model. Despite operating in latent space, the decisions are interpretable because the world model can decode goals into images for visualization. Director also learns successful behaviors across a wide range of environments, including visual control, Atari games, and DMLab levels.
  arXiv  Detail & Related papers  (2022-06-08T18:20:15Z)
• Coupling Vision and Proprioception for Navigation of Legged Robots [65.59559699815512]
  We exploit the complementary strengths of vision and proprioception to achieve point goal navigation in a legged robot. We show superior performance compared to wheeled robot (LoCoBot) baselines. We also show the real-world deployment of our system on a quadruped robot with onboard sensors and compute.
  arXiv  Detail & Related papers  (2021-12-03T18:59:59Z)
• Real Robot Challenge using Deep Reinforcement Learning [6.332038240397164]
  This paper details our winning submission to Phase 1 of the 2021 Real Robot Challenge. The challenge is in which a three fingered robot must carry a cube along specified goal trajectories. We use a pure reinforcement learning approach which requires minimal expert knowledge of the robotic system.
  arXiv  Detail & Related papers  (2021-09-30T16:12:17Z)
• Adaptation of Quadruped Robot Locomotion with Meta-Learning [64.71260357476602]
  We demonstrate that meta-reinforcement learning can be used to successfully train a robot capable to solve a wide range of locomotion tasks. The performance of the meta-trained robot is similar to that of a robot that is trained on a single task.
  arXiv  Detail & Related papers  (2021-07-08T10:37:18Z)
• Passing Through Narrow Gaps with Deep Reinforcement Learning [2.299414848492227]
  In this paper we present a deep reinforcement learning method for autonomously navigating through small gaps. We first learn a gap behaviour policy to get through small gaps, where contact between the robot and the gap may be required. In simulation experiments, our approach achieves 93% success rate when the gap behaviour is activated manually by an operator. In real robot experiments, our approach achieves a success rate of 73% with manual activation, and 40% with autonomous behaviour selection.
  arXiv  Detail & Related papers  (2021-03-06T00:10:41Z)
• LBGP: Learning Based Goal Planning for Autonomous Following in Front [16.13120109400351]
  This paper investigates a hybrid solution which combines deep reinforcement learning (RL) and classical trajectory planning. An autonomous robot aims to stay ahead of a person as the person freely walks around. Our system outperforms the state-of-the-art in following ahead and is more reliable compared to end-to-end alternatives in both the simulation and real world experiments.
  arXiv  Detail & Related papers  (2020-11-05T22:29:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.