Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge

• URL: http://arxiv.org/abs/2412.15587v1
• Date: Fri, 20 Dec 2024 05:46:29 GMT
• Title: Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge
• Authors: Hengxu Yan, Haoshu Fang, Cewu Lu,
• Abstract summary: We introduce a novel reinforcement learning approach that leverages prior dexterous grasp pose knowledge to enhance both efficiency and accuracy. Experimental results demonstrate significant improvements in learning efficiency and success rates across four distinct tasks.
• Score: 55.1299081537782
• License:
• Abstract: Dexterous manipulation has received considerable attention in recent research. Predominantly, existing studies have concentrated on reinforcement learning methods to address the substantial degrees of freedom in hand movements. Nonetheless, these methods typically suffer from low efficiency and accuracy. In this work, we introduce a novel reinforcement learning approach that leverages prior dexterous grasp pose knowledge to enhance both efficiency and accuracy. Unlike previous work, they always make the robotic hand go with a fixed dexterous grasp pose, We decouple the manipulation process into two distinct phases: initially, we generate a dexterous grasp pose targeting the functional part of the object; after that, we employ reinforcement learning to comprehensively explore the environment. Our findings suggest that the majority of learning time is expended in identifying the appropriate initial position and selecting the optimal manipulation viewpoint. Experimental results demonstrate significant improvements in learning efficiency and success rates across four distinct tasks.

Related papers

• Unprejudiced Training Auxiliary Tasks Makes Primary Better: A Multi-Task Learning Perspective [55.531894882776726]
  Multi-task learning methods suggest using auxiliary tasks to enhance a neural network's performance on a specific primary task. Previous methods often select auxiliary tasks carefully but treat them as secondary during training. We propose an uncertainty-based impartial learning method that ensures balanced training across all tasks.
  arXiv  Detail & Related papers  (2024-12-27T09:27:18Z)
• Curriculum Is More Influential Than Haptic Information During Reinforcement Learning of Object Manipulation Against Gravity [0.0]
  Learning to lift and rotate objects with the fingertips is necessary for autonomous in-hand dexterous manipulation. We investigate the role of curriculum learning and haptic feedback in enabling the learning of dexterous manipulation.
  arXiv  Detail & Related papers  (2024-07-13T19:23:11Z)
• Exploring CausalWorld: Enhancing robotic manipulation via knowledge transfer and curriculum learning [6.683222869973898]
  This study explores a learning-based tri-finger robotic arm manipulating task, which requires complex movements and coordination among the fingers. By employing reinforcement learning, we train an agent to acquire the necessary skills for proficient manipulation. Two knowledge transfer strategies, fine-tuning and curriculum learning, were utilized within the soft actor-critic architecture.
  arXiv  Detail & Related papers  (2024-03-25T23:19:19Z)
• A Self-supervised Contrastive Learning Method for Grasp Outcomes Prediction [9.865029065814236]
  We show that contrastive learning methods perform well on the task of grasp outcomes prediction. Our results reveal the potential of contrastive learning methods for applications in the field of robot grasping.
  arXiv  Detail & Related papers  (2023-06-26T06:06:49Z)
• Basis for Intentions: Efficient Inverse Reinforcement Learning using Past Experience [89.30876995059168]
  inverse reinforcement learning (IRL) -- inferring the reward function of an agent from observing its behavior. This paper addresses the problem of IRL -- inferring the reward function of an agent from observing its behavior.
  arXiv  Detail & Related papers  (2022-08-09T17:29:49Z)
• Automated Deepfake Detection [19.17617301462919]
  We propose to utilize Automated Machine Learning to automatically search architecture for deepfake detection. It is experimentally proved that our proposed method not only outperforms previous non-deep learning methods but achieves comparable or even better prediction accuracy.
  arXiv  Detail & Related papers  (2021-06-20T14:48:50Z)
• SIMPLE: SIngle-network with Mimicking and Point Learning for Bottom-up Human Pose Estimation [81.03485688525133]
  We propose a novel multi-person pose estimation framework, SIngle-network with Mimicking and Point Learning for Bottom-up Human Pose Estimation (SIMPLE) Specifically, in the training process, we enable SIMPLE to mimic the pose knowledge from the high-performance top-down pipeline. Besides, SIMPLE formulates human detection and pose estimation as a unified point learning framework to complement each other in single-network.
  arXiv  Detail & Related papers  (2021-04-06T13:12:51Z)
• Self-supervised Knowledge Distillation for Few-shot Learning [123.10294801296926]
  Few shot learning is a promising learning paradigm due to its ability to learn out of order distributions quickly with only a few samples. We propose a simple approach to improve the representation capacity of deep neural networks for few-shot learning tasks. Our experiments show that, even in the first stage, self-supervision can outperform current state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-06-17T11:27:00Z)
• Understanding the Role of Training Regimes in Continual Learning [51.32945003239048]
  Catastrophic forgetting affects the training of neural networks, limiting their ability to learn multiple tasks sequentially. We study the effect of dropout, learning rate decay, and batch size, on forming training regimes that widen the tasks' local minima.
  arXiv  Detail & Related papers  (2020-06-12T06:00:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.