Task Tree Retrieval For Robotic Cooking
- URL: http://arxiv.org/abs/2312.09434v1
- Date: Mon, 27 Nov 2023 20:41:21 GMT
- Title: Task Tree Retrieval For Robotic Cooking
- Authors: Chakradhar Reddy Nallu
- Abstract summary: This paper is based on developing different algorithms, which generate the task tree planning for the given goal node(recipe)
The knowledge representation of the dishes is called FOON. It contains the different objects and their between them with respective to the motion node.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This paper is based on developing different algorithms, which generate the
task tree planning for the given goal node(recipe). The knowledge
representation of the dishes is called FOON. It contains the different objects
and their between them with respective to the motion node The graphical
representation of FOON is made by noticing the change in the state of an object
with respect to the human manipulators. We will explore how the FOON is created
for different recipes by the robots. Task planning contains difficulties in
exploring unknown problems, as its knowledge is limited to the FOON. To get the
task tree planning for a given recipe, the robot will retrieve the information
of different functional units from the knowledge retrieval process called FOON.
Thus the generated subgraphs will allow the robot to cook the required dish.
Thus the robot can able to cook the given recipe by following the sequence of
instructions.
Related papers
- Task tree retrieval from FOON using search algorithms [0.0]
It is nearly impossible to provide a robot with instructions for every possible task.
We have a Universal Functional object-oriented network (FOON) which was created and expanded.
We use two algorithms (IDS and GBFS) to retrieve a task tree for a goal node and a given set of kitchen items.
arXiv Detail & Related papers (2023-12-02T05:00:55Z) - Learning Reward Functions for Robotic Manipulation by Observing Humans [92.30657414416527]
We use unlabeled videos of humans solving a wide range of manipulation tasks to learn a task-agnostic reward function for robotic manipulation policies.
The learned rewards are based on distances to a goal in an embedding space learned using a time-contrastive objective.
arXiv Detail & Related papers (2022-11-16T16:26:48Z) - Knowledge Retrieval for Robotic Cooking [0.0]
The motivation behind developing search algorithms in Functional Object-Oriented Networks is that most of the time, a certain recipe needs to be retrieved or ingredients for a certain recipe needs to be determined.
This paper shows several proposed weighted FOON and task planning algorithms that allow a robot and a human to successfully complete complicated tasks together.
arXiv Detail & Related papers (2022-11-08T19:40:27Z) - Task Tree Retrieval for Robotic Cooking [0.0]
In this essay, the idea of FOON, a structural knowledge representation built on insights from human manipulations, is introduced.
To reduce the failure rate and ensure that the task is effectively completed, three different algorithms have been implemented.
This knowledge representation was created using videos of open-sourced recipes.
arXiv Detail & Related papers (2022-11-03T12:18:31Z) - Long-Horizon Planning and Execution with Functional Object-Oriented
Networks [79.94575713911189]
We introduce the idea of exploiting object-level knowledge as a FOON for task planning and execution.
Our approach automatically transforms FOON into PDDL and leverages off-the-shelf planners, action contexts, and robot skills.
We demonstrate our approach on long-horizon tasks in CoppeliaSim and show how learned action contexts can be extended to never-before-seen scenarios.
arXiv Detail & Related papers (2022-07-12T19:29:35Z) - Can Foundation Models Perform Zero-Shot Task Specification For Robot
Manipulation? [54.442692221567796]
Task specification is critical for engagement of non-expert end-users and adoption of personalized robots.
A widely studied approach to task specification is through goals, using either compact state vectors or goal images from the same robot scene.
In this work, we explore alternate and more general forms of goal specification that are expected to be easier for humans to specify and use.
arXiv Detail & Related papers (2022-04-23T19:39:49Z) - Functional Task Tree Generation from a Knowledge Graph to Solve Unseen
Problems [5.400294730456784]
Unlike humans, robots cannot creatively adapt to novel scenarios.
Existing knowledge in the form of a knowledge graph is used as a base of reference to create task trees.
Our results indicate that the proposed method can produce task plans with high accuracy even for never-before-seen ingredient combinations.
arXiv Detail & Related papers (2021-12-04T21:28:22Z) - The MineRL BASALT Competition on Learning from Human Feedback [58.17897225617566]
The MineRL BASALT competition aims to spur forward research on this important class of techniques.
We design a suite of four tasks in Minecraft for which we expect it will be hard to write down hardcoded reward functions.
We provide a dataset of human demonstrations on each of the four tasks, as well as an imitation learning baseline.
arXiv Detail & Related papers (2021-07-05T12:18:17Z) - Evaluating Recipes Generated from Functional Object-Oriented Network [4.94338660039249]
The functional object-oriented network (FOON) has been introduced as a knowledge representation, which takes the form of a graph.
To get a sequential plan for a manipulation task, a robot can obtain a task tree through a knowledge retrieval process from the FOON.
We compare the quality of an acquired task tree with a conventional form of task knowledge, such as recipes or manuals.
arXiv Detail & Related papers (2021-06-01T19:00:52Z) - A Road-map to Robot Task Execution with the Functional Object-Oriented
Network [77.93376696738409]
functional object-oriented network (FOON) is a knowledge graph representation for robots.
Taking the form of a bipartite graph, a FOON contains symbolic or high-level information that would be pertinent to a robot's understanding of its environment and tasks.
arXiv Detail & Related papers (2021-06-01T00:43:04Z) - Structure-Aware Generation Network for Recipe Generation from Images [142.047662926209]
We investigate an open research task of generating cooking instructions based on only food images and ingredients.
Target recipes are long-length paragraphs and do not have annotations on structure information.
We propose a novel framework of Structure-aware Generation Network (SGN) to tackle the food recipe generation task.
arXiv Detail & Related papers (2020-09-02T10:54:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.