Task tree retrieval from FOON using search algorithms
- URL: http://arxiv.org/abs/2401.05346v1
- Date: Sat, 2 Dec 2023 05:00:55 GMT
- Title: Task tree retrieval from FOON using search algorithms
- Authors: Amitha Attapu
- Abstract summary: It is nearly impossible to provide a robot with instructions for every possible task.
We have a Universal Functional object-oriented network (FOON) which was created and expanded.
We use two algorithms (IDS and GBFS) to retrieve a task tree for a goal node and a given set of kitchen items.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Robots can be very useful to automate tasks and reduce the human effort
required. But for the robot to know, how to perform tasks, we need to give it a
clear set of steps to follow. It is nearly impossible to provide a robot with
instructions for every possible task. Therefore we have a Universal Functional
object-oriented network (FOON) which was created and expanded and has a lot of
existing recipe information [1]. But certain tasks are complicated for robots
to perform and similarly, some tasks are complicated for humans to perform.
Therefore weights have been added to functional units to represent the chance
of successful execution of the motion by the robot [2]. Given a set of kitchen
items and a goal node, using Universal FOON, a robot must be able to determine
if the required items are present in the kitchen, and if yes, get the steps to
convert the required kitchen items to the goal node. Now through this paper, we
use two algorithms (IDS and GBFS) to retrieve a task tree (if possible) for a
goal node and a given set of kitchen items. The following would be the
different parts of the paper: Section II FOON creation, where we will discuss
the different terminologies related to FOON and visualization of FOON. In
Section III Methodology we discuss the IDS and GBFS search algorithms and the
two different heuristics implemented and used in GBFS. In Section IV
Experiment/Discussion, we compare the performance of different algorithms. In
the final section V, we specify the references of the papers that have been
cited.
Related papers
- COHERENT: Collaboration of Heterogeneous Multi-Robot System with Large Language Models [49.24666980374751]
COHERENT is a novel LLM-based task planning framework for collaboration of heterogeneous multi-robot systems.
A Proposal-Execution-Feedback-Adjustment mechanism is designed to decompose and assign actions for individual robots.
The experimental results show that our work surpasses the previous methods by a large margin in terms of success rate and execution efficiency.
arXiv Detail & Related papers (2024-09-23T15:53:41Z) - Task Tree Retrieval For Robotic Cooking [0.0]
This paper is based on developing different algorithms, which generate the task tree planning for the given goal node(recipe)
The knowledge representation of the dishes is called FOON. It contains the different objects and their between them with respective to the motion node.
arXiv Detail & Related papers (2023-11-27T20:41:21Z) - Learning Reward Functions for Robotic Manipulation by Observing Humans [92.30657414416527]
We use unlabeled videos of humans solving a wide range of manipulation tasks to learn a task-agnostic reward function for robotic manipulation policies.
The learned rewards are based on distances to a goal in an embedding space learned using a time-contrastive objective.
arXiv Detail & Related papers (2022-11-16T16:26:48Z) - Extracting task trees using knowledge retrieval search algorithms in
functional object-oriented network [0.0]
The functional object-oriented network (FOON) has been developed as a knowledge representation method that can be used by robots.
A FOON can be observed as a graph that can provide an ordered plan for robots to retrieve a task tree.
arXiv Detail & Related papers (2022-11-15T17:20:08Z) - Knowledge Retrieval for Robotic Cooking [0.0]
The motivation behind developing search algorithms in Functional Object-Oriented Networks is that most of the time, a certain recipe needs to be retrieved or ingredients for a certain recipe needs to be determined.
This paper shows several proposed weighted FOON and task planning algorithms that allow a robot and a human to successfully complete complicated tasks together.
arXiv Detail & Related papers (2022-11-08T19:40:27Z) - Knowledge Retrieval [0.0]
This paper mainly focusses on Functional Object Oriented Network which is structured knowledge representation using the input output and motion nodes.
Different algorithms to traverse the tree in order to get the best output are also discussed in this paper.
arXiv Detail & Related papers (2022-10-22T20:41:09Z) - Long-Horizon Planning and Execution with Functional Object-Oriented
Networks [79.94575713911189]
We introduce the idea of exploiting object-level knowledge as a FOON for task planning and execution.
Our approach automatically transforms FOON into PDDL and leverages off-the-shelf planners, action contexts, and robot skills.
We demonstrate our approach on long-horizon tasks in CoppeliaSim and show how learned action contexts can be extended to never-before-seen scenarios.
arXiv Detail & Related papers (2022-07-12T19:29:35Z) - Fast Inference and Transfer of Compositional Task Structures for
Few-shot Task Generalization [101.72755769194677]
We formulate it as a few-shot reinforcement learning problem where a task is characterized by a subtask graph.
Our multi-task subtask graph inferencer (MTSGI) first infers the common high-level task structure in terms of the subtask graph from the training tasks.
Our experiment results on 2D grid-world and complex web navigation domains show that the proposed method can learn and leverage the common underlying structure of the tasks for faster adaptation to the unseen tasks.
arXiv Detail & Related papers (2022-05-25T10:44:25Z) - Can Foundation Models Perform Zero-Shot Task Specification For Robot
Manipulation? [54.442692221567796]
Task specification is critical for engagement of non-expert end-users and adoption of personalized robots.
A widely studied approach to task specification is through goals, using either compact state vectors or goal images from the same robot scene.
In this work, we explore alternate and more general forms of goal specification that are expected to be easier for humans to specify and use.
arXiv Detail & Related papers (2022-04-23T19:39:49Z) - A Road-map to Robot Task Execution with the Functional Object-Oriented
Network [77.93376696738409]
functional object-oriented network (FOON) is a knowledge graph representation for robots.
Taking the form of a bipartite graph, a FOON contains symbolic or high-level information that would be pertinent to a robot's understanding of its environment and tasks.
arXiv Detail & Related papers (2021-06-01T00:43:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.