Human-like Planning for Reaching in Cluttered Environments
- URL: http://arxiv.org/abs/2002.12738v2
- Date: Tue, 3 Mar 2020 22:23:00 GMT
- Title: Human-like Planning for Reaching in Cluttered Environments
- Authors: Mohamed Hasan, Matthew Warburton, Wisdom C. Agboh, Mehmet R. Dogar,
Matteo Leonetti, He Wang, Faisal Mushtaq, Mark Mon-Williams and Anthony G.
Cohn
- Abstract summary: Humans are remarkably adept at reaching for objects in cluttered environments.
We identify high-level manipulation plans in humans, and transfer these skills to robot planners.
We found that the human-like planner outperformed a state-of-the-art standard trajectory optimisation algorithm.
- Score: 11.55532557594561
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Humans, in comparison to robots, are remarkably adept at reaching for objects
in cluttered environments. The best existing robot planners are based on random
sampling of configuration space -- which becomes excessively high-dimensional
with large number of objects. Consequently, most planners often fail to
efficiently find object manipulation plans in such environments. We addressed
this problem by identifying high-level manipulation plans in humans, and
transferring these skills to robot planners. We used virtual reality to capture
human participants reaching for a target object on a tabletop cluttered with
obstacles. From this, we devised a qualitative representation of the task space
to abstract the decision making, irrespective of the number of obstacles. Based
on this representation, human demonstrations were segmented and used to train
decision classifiers. Using these classifiers, our planner produced a list of
waypoints in task space. These waypoints provided a high-level plan, which
could be transferred to an arbitrary robot model and used to initialise a local
trajectory optimiser. We evaluated this approach through testing on unseen
human VR data, a physics-based robot simulation, and a real robot (dataset and
code are publicly available). We found that the human-like planner outperformed
a state-of-the-art standard trajectory optimisation algorithm, and was able to
generate effective strategies for rapid planning -- irrespective of the number
of obstacles in the environment.
Related papers
- Exploring Robot Trajectory Planning -- A Comparative Analysis of Algorithms And Software Implementations in Dynamic Environments [0.0]
Trajectory planning is a crucial word in Modern & Advanced Robotics.
It's a way of generating a smooth and feasible path for the robot to follow over time.
Trajectory planning is extensively used in Automobile Industrial Robot, Manipulators, and Mobile Robots.
arXiv Detail & Related papers (2024-07-18T09:30:27Z) - Planning Robot Placement for Object Grasping [5.327052729563043]
When performing manipulation-based activities such as picking objects, a mobile robot needs to position its base at a location that supports successful execution.
To address this problem, prominent approaches typically rely on costly grasp planners to provide grasp poses for a target object.
We propose instead to first find robot placements that would not result in collision with the environment, then evaluate them to find the best placement candidate.
arXiv Detail & Related papers (2024-05-26T20:57:32Z) - Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulation [65.46610405509338]
We seek to learn a generalizable goal-conditioned policy that enables zero-shot robot manipulation.
Our framework,Track2Act predicts tracks of how points in an image should move in future time-steps based on a goal.
We show that this approach of combining scalably learned track prediction with a residual policy enables diverse generalizable robot manipulation.
arXiv Detail & Related papers (2024-05-02T17:56:55Z) - Semi-Supervised Active Learning for Semantic Segmentation in Unknown
Environments Using Informative Path Planning [27.460481202195012]
Self-supervised and fully supervised active learning methods emerged to improve a robot's vision.
We propose a planning method for semi-supervised active learning of semantic segmentation.
We leverage an adaptive map-based planner guided towards the frontiers of unexplored space with high model uncertainty.
arXiv Detail & Related papers (2023-12-07T16:16:47Z) - AI planning in the imagination: High-level planning on learned abstract
search spaces [68.75684174531962]
We propose a new method, called PiZero, that gives an agent the ability to plan in an abstract search space that the agent learns during training.
We evaluate our method on multiple domains, including the traveling salesman problem, Sokoban, 2048, the facility location problem, and Pacman.
arXiv Detail & Related papers (2023-08-16T22:47:16Z) - Model Predictive Control for Fluid Human-to-Robot Handovers [50.72520769938633]
Planning motions that take human comfort into account is not a part of the human-robot handover process.
We propose to generate smooth motions via an efficient model-predictive control framework.
We conduct human-to-robot handover experiments on a diverse set of objects with several users.
arXiv Detail & Related papers (2022-03-31T23:08:20Z) - SABER: Data-Driven Motion Planner for Autonomously Navigating
Heterogeneous Robots [112.2491765424719]
We present an end-to-end online motion planning framework that uses a data-driven approach to navigate a heterogeneous robot team towards a global goal.
We use model predictive control (SMPC) to calculate control inputs that satisfy robot dynamics, and consider uncertainty during obstacle avoidance with chance constraints.
recurrent neural networks are used to provide a quick estimate of future state uncertainty considered in the SMPC finite-time horizon solution.
A Deep Q-learning agent is employed to serve as a high-level path planner, providing the SMPC with target positions that move the robots towards a desired global goal.
arXiv Detail & Related papers (2021-08-03T02:56:21Z) - NeRP: Neural Rearrangement Planning for Unknown Objects [49.191284597526]
We propose NeRP (Neural Rearrangement Planning), a deep learning based approach for multi-step neural object rearrangement planning.
NeRP works with never-before-seen objects, that is trained on simulation data, and generalizes to the real world.
arXiv Detail & Related papers (2021-06-02T17:56:27Z) - A Long Horizon Planning Framework for Manipulating Rigid Pointcloud
Objects [25.428781562909606]
We present a framework for solving long-horizon planning problems involving manipulation of rigid objects.
Our method plans in the space of object subgoals and frees the planner from reasoning about robot-object interaction dynamics.
arXiv Detail & Related papers (2020-11-16T18:59:33Z) - Task-relevant Representation Learning for Networked Robotic Perception [74.0215744125845]
This paper presents an algorithm to learn task-relevant representations of sensory data that are co-designed with a pre-trained robotic perception model's ultimate objective.
Our algorithm aggressively compresses robotic sensory data by up to 11x more than competing methods.
arXiv Detail & Related papers (2020-11-06T07:39:08Z) - Autonomous Planning Based on Spatial Concepts to Tidy Up Home
Environments with Service Robots [5.739787445246959]
We propose a novel planning method that can efficiently estimate the order and positions of the objects to be tidied up by learning the parameters of a probabilistic generative model.
The model allows a robot to learn the distributions of the co-occurrence probability of the objects and places to tidy up using the multimodal sensor information collected in a tidied environment.
We evaluate the effectiveness of the proposed method by an experimental simulation that reproduces the conditions of the Tidy Up Here task of the World Robot Summit 2018 international robotics competition.
arXiv Detail & Related papers (2020-02-10T11:49:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.