Knowledge Retrieval using Functional Object-Oriented Network
- URL: http://arxiv.org/abs/2211.03037v1
- Date: Sun, 6 Nov 2022 06:02:29 GMT
- Title: Knowledge Retrieval using Functional Object-Oriented Network
- Authors: Naseem Shaik
- Abstract summary: The functional object-oriented network (FOON) is a knowledge representation for symbolic task planning that takes the shape of a graph.
A graph retrieval methodology is shown to produce manipulation motion sequences from the FOON to accomplish a desired aim.
The outcomes are illustrated using motion sequences created by the FOON to complete the desired objectives in a simulated environment.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Robots can complete all human-performed tasks, but due to their current lack
of knowledge, some tasks still cannot be completed by them with a high degree
of success. However, with the right knowledge, these tasks can be completed by
robots with a high degree of success, reducing the amount of human effort
required to complete daily tasks. In this paper, the FOON, which describes the
robot action success rate, is discussed. The functional object-oriented network
(FOON) is a knowledge representation for symbolic task planning that takes the
shape of a graph. It is to demonstrate the adaptability of FOON in developing a
novel and adaptive method of solving a problem utilizing knowledge obtained
from various sources, a graph retrieval methodology is shown to produce
manipulation motion sequences from the FOON to accomplish a desired aim. The
outcomes are illustrated using motion sequences created by the FOON to complete
the desired objectives in a simulated environment.
Related papers
- Egocentric Planning for Scalable Embodied Task Achievement [6.870094263016224]
Egocentric Planning is an innovative approach that combines symbolic planning and Object-oriented POMDPs to solve tasks in complex environments.
We evaluated our approach in ALFRED, a simulated environment designed for domestic tasks, and demonstrated its high scalability.
Our method requires reliable perception and the specification or learning of a symbolic description of the preconditions and effects of the agent's actions.
arXiv Detail & Related papers (2023-06-02T06:41:24Z) - Long-Horizon Planning and Execution with Functional Object-Oriented
Networks [79.94575713911189]
We introduce the idea of exploiting object-level knowledge as a FOON for task planning and execution.
Our approach automatically transforms FOON into PDDL and leverages off-the-shelf planners, action contexts, and robot skills.
We demonstrate our approach on long-horizon tasks in CoppeliaSim and show how learned action contexts can be extended to never-before-seen scenarios.
arXiv Detail & Related papers (2022-07-12T19:29:35Z) - Can Foundation Models Perform Zero-Shot Task Specification For Robot
Manipulation? [54.442692221567796]
Task specification is critical for engagement of non-expert end-users and adoption of personalized robots.
A widely studied approach to task specification is through goals, using either compact state vectors or goal images from the same robot scene.
In this work, we explore alternate and more general forms of goal specification that are expected to be easier for humans to specify and use.
arXiv Detail & Related papers (2022-04-23T19:39:49Z) - Learning Sensorimotor Primitives of Sequential Manipulation Tasks from
Visual Demonstrations [13.864448233719598]
This paper describes a new neural network-based framework for learning simultaneously low-level policies and high-level policies.
A key feature of the proposed approach is that the policies are learned directly from raw videos of task demonstrations.
Empirical results on object manipulation tasks with a robotic arm show that the proposed network can efficiently learn from real visual demonstrations to perform the tasks.
arXiv Detail & Related papers (2022-03-08T01:36:48Z) - BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning [108.41464483878683]
We study the problem of enabling a vision-based robotic manipulation system to generalize to novel tasks.
We develop an interactive and flexible imitation learning system that can learn from both demonstrations and interventions.
When scaling data collection on a real robot to more than 100 distinct tasks, we find that this system can perform 24 unseen manipulation tasks with an average success rate of 44%.
arXiv Detail & Related papers (2022-02-04T07:30:48Z) - Functional Task Tree Generation from a Knowledge Graph to Solve Unseen
Problems [5.400294730456784]
Unlike humans, robots cannot creatively adapt to novel scenarios.
Existing knowledge in the form of a knowledge graph is used as a base of reference to create task trees.
Our results indicate that the proposed method can produce task plans with high accuracy even for never-before-seen ingredient combinations.
arXiv Detail & Related papers (2021-12-04T21:28:22Z) - Procedure Planning in Instructional Videosvia Contextual Modeling and
Model-based Policy Learning [114.1830997893756]
This work focuses on learning a model to plan goal-directed actions in real-life videos.
We propose novel algorithms to model human behaviors through Bayesian Inference and model-based Imitation Learning.
arXiv Detail & Related papers (2021-10-05T01:06:53Z) - Example-Driven Model-Based Reinforcement Learning for Solving
Long-Horizon Visuomotor Tasks [85.56153200251713]
We introduce EMBR, a model-based RL method for learning primitive skills that are suitable for completing long-horizon visuomotor tasks.
On a Franka Emika robot arm, we find that EMBR enables the robot to complete three long-horizon visuomotor tasks at 85% success rate.
arXiv Detail & Related papers (2021-09-21T16:48:07Z) - A Road-map to Robot Task Execution with the Functional Object-Oriented
Network [77.93376696738409]
functional object-oriented network (FOON) is a knowledge graph representation for robots.
Taking the form of a bipartite graph, a FOON contains symbolic or high-level information that would be pertinent to a robot's understanding of its environment and tasks.
arXiv Detail & Related papers (2021-06-01T00:43:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.