A Concise Introduction to Reinforcement Learning in Robotics
- URL: http://arxiv.org/abs/2210.07397v1
- Date: Thu, 13 Oct 2022 22:29:42 GMT
- Title: A Concise Introduction to Reinforcement Learning in Robotics
- Authors: Akash Nagaraj, Mukund Sood, Bhagya M Patil
- Abstract summary: This paper aims to serve as a reference guide for researchers in reinforcement learning applied to the field of robotics.
We have covered the most essential concepts required for research in the field of reinforcement learning, with robotics in mind.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: One of the biggest hurdles robotics faces is the facet of sophisticated and
hard-to-engineer behaviors. Reinforcement learning offers a set of tools, and a
framework to address this problem. In parallel, the misgivings of robotics
offer a solid testing ground and evaluation metric for advancements in
reinforcement learning. The two disciplines go hand-in-hand, much like the
fields of Mathematics and Physics. By means of this survey paper, we aim to
invigorate links between the research communities of the two disciplines by
focusing on the work done in reinforcement learning for locomotive and control
aspects of robotics. Additionally, we aim to highlight not only the notable
successes but also the key challenges of the application of Reinforcement
Learning in Robotics. This paper aims to serve as a reference guide for
researchers in reinforcement learning applied to the field of robotics. The
literature survey is at a fairly introductory level, aimed at aspiring
researchers. Appropriately, we have covered the most essential concepts
required for research in the field of reinforcement learning, with robotics in
mind. Through a thorough analysis of this problem, we are able to manifest how
reinforcement learning could be applied profitably, and also focus on
open-ended questions, as well as the potential for future research.
Related papers
- Stabilizing Contrastive RL: Techniques for Robotic Goal Reaching from
Offline Data [101.43350024175157]
Self-supervised learning has the potential to decrease the amount of human annotation and engineering effort required to learn control strategies.
Our work builds on prior work showing that the reinforcement learning (RL) itself can be cast as a self-supervised problem.
We demonstrate that a self-supervised RL algorithm based on contrastive learning can solve real-world, image-based robotic manipulation tasks.
arXiv Detail & Related papers (2023-06-06T01:36:56Z) - Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement
Learning [54.636562516974884]
In imitation and reinforcement learning, the cost of human supervision limits the amount of data that robots can be trained on.
In this work, we propose MEDAL++, a novel design for self-improving robotic systems.
The robot autonomously practices the task by learning to both do and undo the task, simultaneously inferring the reward function from the demonstrations.
arXiv Detail & Related papers (2023-03-02T18:51:38Z) - Physics-Guided Hierarchical Reward Mechanism for Learning-Based Robotic
Grasping [10.424363966870775]
We develop a Physics-Guided Deep Reinforcement Learning with a Hierarchical Reward Mechanism to improve learning efficiency and generalizability for learning-based autonomous grasping.
Our method is validated in robotic grasping tasks with a 3-finger MICO robot arm.
arXiv Detail & Related papers (2022-05-26T18:01:56Z) - Dual-Arm Adversarial Robot Learning [0.6091702876917281]
We propose dual-arm settings as platforms for robot learning.
We will discuss the potential benefits of this setup as well as the challenges and research directions that can be pursued.
arXiv Detail & Related papers (2021-10-15T12:51:57Z) - Auditing Robot Learning for Safety and Compliance during Deployment [4.742825811314168]
We study how best to audit robot learning algorithms for checking their compatibility with humans.
We believe that this is a challenging problem that will require efforts from the entire robot learning community.
arXiv Detail & Related papers (2021-10-12T02:40:11Z) - Lifelong Robotic Reinforcement Learning by Retaining Experiences [61.79346922421323]
Many multi-task reinforcement learning efforts assume the robot can collect data from all tasks at all times.
In this work, we study a practical sequential multi-task RL problem motivated by the practical constraints of physical robotic systems.
We derive an approach that effectively leverages the data and policies learned for previous tasks to cumulatively grow the robot's skill-set.
arXiv Detail & Related papers (2021-09-19T18:00:51Z) - Actionable Models: Unsupervised Offline Reinforcement Learning of
Robotic Skills [93.12417203541948]
We propose the objective of learning a functional understanding of the environment by learning to reach any goal state in a given dataset.
We find that our method can operate on high-dimensional camera images and learn a variety of skills on real robots that generalize to previously unseen scenes and objects.
arXiv Detail & Related papers (2021-04-15T20:10:11Z) - Semantics for Robotic Mapping, Perception and Interaction: A Survey [93.93587844202534]
Study of understanding dictates what does the world "mean" to a robot.
With humans and robots increasingly operating in the same world, the prospects of human-robot interaction also bring semantics into the picture.
Driven by need, as well as by enablers like increasing availability of training data and computational resources, semantics is a rapidly growing research area in robotics.
arXiv Detail & Related papers (2021-01-02T12:34:39Z) - Curiosity Based Reinforcement Learning on Robot Manufacturing Cell [0.0]
Reinforcement learning has proved to be highly successful in solving tasks like robotics and scheduling.
This paper introduces a novel combination of scheduling control on a flexible robot manufacturing cell with curiosity based reinforcement learning.
arXiv Detail & Related papers (2020-11-17T16:19:47Z) - Reinforcement Learning Approaches in Social Robotics [3.9523548427618067]
This article surveys reinforcement learning approaches in social robotics.
Since interaction is a key component in both reinforcement learning and social robotics, it can be a well-suited approach for real-world interactions with physically embodied social robots.
arXiv Detail & Related papers (2020-09-21T08:56:18Z) - The Ingredients of Real-World Robotic Reinforcement Learning [71.92831985295163]
We discuss the elements that are needed for a robotic learning system that can continually and autonomously improve with data collected in the real world.
We propose a particular instantiation of such a system, using dexterous manipulation as our case study.
We demonstrate that our complete system can learn without any human intervention, acquiring a variety of vision-based skills with a real-world three-fingered hand.
arXiv Detail & Related papers (2020-04-27T03:36:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.