Functional Task Tree Generation from a Knowledge Graph to Solve Unseen Problems

• URL: http://arxiv.org/abs/2112.02433v1
• Date: Sat, 4 Dec 2021 21:28:22 GMT
• Title: Functional Task Tree Generation from a Knowledge Graph to Solve Unseen Problems
• Authors: Md. Sadman Sakib, David Paulius, and Yu Sun
• Abstract summary: Unlike humans, robots cannot creatively adapt to novel scenarios. Existing knowledge in the form of a knowledge graph is used as a base of reference to create task trees. Our results indicate that the proposed method can produce task plans with high accuracy even for never-before-seen ingredient combinations.
• Score: 5.400294730456784
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: A major component for developing intelligent and autonomous robots is a suitable knowledge representation, from which a robot can acquire knowledge about its actions or world. However, unlike humans, robots cannot creatively adapt to novel scenarios, as their knowledge and environment are rigidly defined. To address the problem of producing novel and flexible task plans called task trees, we explore how we can derive plans with concepts not originally in the robot's knowledge base. Existing knowledge in the form of a knowledge graph is used as a base of reference to create task trees that are modified with new object or state combinations. To demonstrate the flexibility of our method, we randomly selected recipes from the Recipe1M+ dataset and generated their task trees. The task trees were then thoroughly checked with a visualization tool that portrays how each ingredient changes with each action to produce the desired meal. Our results indicate that the proposed method can produce task plans with high accuracy even for never-before-seen ingredient combinations.

Related papers

• Task Tree Retrieval For Robotic Cooking [0.0]
  This paper is based on developing different algorithms, which generate the task tree planning for the given goal node(recipe) The knowledge representation of the dishes is called FOON. It contains the different objects and their between them with respective to the motion node.
  arXiv  Detail & Related papers  (2023-11-27T20:41:21Z)
• Incremental procedural and sensorimotor learning in cognitive humanoid robots [52.77024349608834]
  This work presents a cognitive agent that can learn procedures incrementally. We show the cognitive functions required in each substage and how adding new functions helps address tasks previously unsolved by the agent. Results show that this approach is capable of solving complex tasks incrementally.
  arXiv  Detail & Related papers  (2023-04-30T22:51:31Z)
• Knowledge Retrieval for Robotic Cooking [0.0]
  The motivation behind developing search algorithms in Functional Object-Oriented Networks is that most of the time, a certain recipe needs to be retrieved or ingredients for a certain recipe needs to be determined. This paper shows several proposed weighted FOON and task planning algorithms that allow a robot and a human to successfully complete complicated tasks together.
  arXiv  Detail & Related papers  (2022-11-08T19:40:27Z)
• Knowledge Retrieval using Functional Object-Oriented Network [0.0]
  The functional object-oriented network (FOON) is a knowledge representation for symbolic task planning that takes the shape of a graph. A graph retrieval methodology is shown to produce manipulation motion sequences from the FOON to accomplish a desired aim. The outcomes are illustrated using motion sequences created by the FOON to complete the desired objectives in a simulated environment.
  arXiv  Detail & Related papers  (2022-11-06T06:02:29Z)
• Knowledge Retrieval [0.0]
  This paper mainly focusses on Functional Object Oriented Network which is structured knowledge representation using the input output and motion nodes. Different algorithms to traverse the tree in order to get the best output are also discussed in this paper.
  arXiv  Detail & Related papers  (2022-10-22T20:41:09Z)
• BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning [108.41464483878683]
  We study the problem of enabling a vision-based robotic manipulation system to generalize to novel tasks. We develop an interactive and flexible imitation learning system that can learn from both demonstrations and interventions. When scaling data collection on a real robot to more than 100 distinct tasks, we find that this system can perform 24 unseen manipulation tasks with an average success rate of 44%.
  arXiv  Detail & Related papers  (2022-02-04T07:30:48Z)
• Discovering Generalizable Skills via Automated Generation of Diverse Tasks [82.16392072211337]
  We propose a method to discover generalizable skills via automated generation of a diverse set of tasks. As opposed to prior work on unsupervised discovery of skills, our method pairs each skill with a unique task produced by a trainable task generator. A task discriminator defined on the robot behaviors in the generated tasks is jointly trained to estimate the evidence lower bound of the diversity objective. The learned skills can then be composed in a hierarchical reinforcement learning algorithm to solve unseen target tasks.
  arXiv  Detail & Related papers  (2021-06-26T03:41:51Z)
• Evaluating Recipes Generated from Functional Object-Oriented Network [4.94338660039249]
  The functional object-oriented network (FOON) has been introduced as a knowledge representation, which takes the form of a graph. To get a sequential plan for a manipulation task, a robot can obtain a task tree through a knowledge retrieval process from the FOON. We compare the quality of an acquired task tree with a conventional form of task knowledge, such as recipes or manuals.
  arXiv  Detail & Related papers  (2021-06-01T19:00:52Z)
• A Road-map to Robot Task Execution with the Functional Object-Oriented Network [77.93376696738409]
  functional object-oriented network (FOON) is a knowledge graph representation for robots. Taking the form of a bipartite graph, a FOON contains symbolic or high-level information that would be pertinent to a robot's understanding of its environment and tasks.
  arXiv  Detail & Related papers  (2021-06-01T00:43:04Z)
• COG: Connecting New Skills to Past Experience with Offline Reinforcement Learning [78.13740204156858]
  We show that we can reuse prior data to extend new skills simply through dynamic programming. We demonstrate the effectiveness of our approach by chaining together several behaviors seen in prior datasets for solving a new task. We train our policies in an end-to-end fashion, mapping high-dimensional image observations to low-level robot control commands.
  arXiv  Detail & Related papers  (2020-10-27T17:57:29Z)
• Automated Relational Meta-learning [95.02216511235191]
  We propose an automated relational meta-learning framework that automatically extracts the cross-task relations and constructs the meta-knowledge graph. We conduct extensive experiments on 2D toy regression and few-shot image classification and the results demonstrate the superiority of ARML over state-of-the-art baselines.
  arXiv  Detail & Related papers  (2020-01-03T07:02:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.