Dynamic Knowledge Graphs as Semantic Memory Model for Industrial Robots
- URL: http://arxiv.org/abs/2101.01099v2
- Date: Wed, 6 Jan 2021 18:58:44 GMT
- Title: Dynamic Knowledge Graphs as Semantic Memory Model for Industrial Robots
- Authors: Mohak Sukhwani, Vishakh Duggal, Said Zahrai
- Abstract summary: We present a model for semantic memory that allows machines to collect information and experiences to become more proficient with time.
After a semantic analysis of the data, information is stored in a knowledge graph which is used to comprehend instructions, expressed in natural language, and execute the required tasks in a deterministic manner.
- Score: 0.7863638253070437
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: In this paper, we present a model for semantic memory that allows machines to
collect information and experiences to become more proficient with time. After
a semantic analysis of the data, information is stored in a knowledge graph
which is used to comprehend instructions, expressed in natural language, and
execute the required tasks in a deterministic manner. This imparts industrial
robots cognitive behavior and an intuitive user interface, which is most
appreciated in an era, when collaborative robots are to work alongside humans.
The paper outlines the architecture of the system together with a practical
implementation of the proposal.
Related papers
- Interactive Planning Using Large Language Models for Partially
Observable Robotics Tasks [54.60571399091711]
Large Language Models (LLMs) have achieved impressive results in creating robotic agents for performing open vocabulary tasks.
We present an interactive planning technique for partially observable tasks using LLMs.
arXiv Detail & Related papers (2023-12-11T22:54:44Z) - A Graph-to-Text Approach to Knowledge-Grounded Response Generation in
Human-Robot Interaction [2.3590037806133024]
This paper presents a novel conversational model for human--robot interaction that rests upon a graph-based representation of the dialogue state.
The neural conversational model employed to respond to user utterances relies on a simple but effective graph-to-text mechanism.
The proposed approach is empirically evaluated through a user study with a humanoid robot.
arXiv Detail & Related papers (2023-11-03T15:44:28Z) - Knowledge Acquisition and Completion for Long-Term Human-Robot
Interactions using Knowledge Graph Embedding [0.0]
We propose an architecture to gather data from users and environments in long-runs of continual learning.
We adopt Knowledge Graph Embedding techniques to generalize the acquired information with the goal of incrementally extending the robot's inner representation of the environment.
We evaluate the performance of the overall continual learning architecture by measuring the capabilities of the robot of learning entities and relations coming from unknown contexts.
arXiv Detail & Related papers (2023-01-17T12:23:40Z) - Conceptual Design of the Memory System of the Robot Cognitive
Architecture ArmarX [6.201183690272094]
We describe conceptual and technical characteristics such a memory system has to fulfill, together with the underlying data representation.
We extend our robot software framework ArmarX into a unified cognitive architecture that is used in robots of the ARMAR humanoid robot family.
We show how the memory is used by the robots to implement memory-driven behaviors.
arXiv Detail & Related papers (2022-06-05T19:15:29Z) - OG-SGG: Ontology-Guided Scene Graph Generation. A Case Study in Transfer
Learning for Telepresence Robotics [124.08684545010664]
Scene graph generation from images is a task of great interest to applications such as robotics.
We propose an initial approximation to a framework called Ontology-Guided Scene Graph Generation (OG-SGG)
arXiv Detail & Related papers (2022-02-21T13:23:15Z) - Human-Robot Collaboration and Machine Learning: A Systematic Review of
Recent Research [69.48907856390834]
Human-robot collaboration (HRC) is the approach that explores the interaction between a human and a robot.
This paper proposes a thorough literature review of the use of machine learning techniques in the context of HRC.
arXiv Detail & Related papers (2021-10-14T15:14:33Z) - A Road-map to Robot Task Execution with the Functional Object-Oriented
Network [77.93376696738409]
functional object-oriented network (FOON) is a knowledge graph representation for robots.
Taking the form of a bipartite graph, a FOON contains symbolic or high-level information that would be pertinent to a robot's understanding of its environment and tasks.
arXiv Detail & Related papers (2021-06-01T00:43:04Z) - VSGM -- Enhance robot task understanding ability through visual semantic
graph [0.0]
We consider that giving robots an understanding of visual semantics and language semantics will improve inference ability.
In this paper, we propose a novel method-VSGM, which uses the semantic graph to obtain better visual image features.
arXiv Detail & Related papers (2021-05-19T07:22:31Z) - Cognitive architecture aided by working-memory for self-supervised
multi-modal humans recognition [54.749127627191655]
The ability to recognize human partners is an important social skill to build personalized and long-term human-robot interactions.
Deep learning networks have achieved state-of-the-art results and demonstrated to be suitable tools to address such a task.
One solution is to make robots learn from their first-hand sensory data with self-supervision.
arXiv Detail & Related papers (2021-03-16T13:50:24Z) - Learning Predictive Models From Observation and Interaction [137.77887825854768]
Learning predictive models from interaction with the world allows an agent, such as a robot, to learn about how the world works.
However, learning a model that captures the dynamics of complex skills represents a major challenge.
We propose a method to augment the training set with observational data of other agents, such as humans.
arXiv Detail & Related papers (2019-12-30T01:10:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.