When Prolog meets generative models: a new approach for managing knowledge and planning in robotic applications

• URL: http://arxiv.org/abs/2309.15049v1
• Date: Tue, 26 Sep 2023 16:26:17 GMT
• Title: When Prolog meets generative models: a new approach for managing knowledge and planning in robotic applications
• Authors: Enrico Saccon, Ahmet Tikna, Davide De Martini, Edoardo Lamon, Marco Roveri, Luigi Palopoli (Department of Information Engineering and Computer Science, Universit\`a di Trento, Trento, Italy)
• Abstract summary: We propose a robot oriented knowledge management system based on the use of the Prolog language. The framework is supported by a set of open source tools and is shown on a realistic application.
• Score: 3.8817507108225873
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we propose a robot oriented knowledge management system based on the use of the Prolog language. Our framework hinges on a special organisation of knowledge base that enables: 1. its efficient population from natural language texts using semi-automated procedures based on Large Language Models, 2. the bumpless generation of temporal parallel plans for multi-robot systems through a sequence of transformations, 3. the automated translation of the plan into an executable formalism (the behaviour trees). The framework is supported by a set of open source tools and is shown on a realistic application.

Related papers

• A Temporal Planning Framework for Multi-Agent Systems via LLM-Aided Knowledge Base Management [5.548477348501636]
  This paper presents a novel framework, called PLANTOR, that integrates Large Language Models (LLMs) with Prolog-based knowledge management and planning for multi-robot tasks. Results demonstrate that LLMs can produce accurate knowledge bases with modest human feedback, while Prolog guarantees formal correctness and explainability. This approach underscores the potential of LLM integration for advanced robotics tasks requiring flexible, scalable, and human-understandable planning.
  arXiv  Detail & Related papers  (2025-02-26T13:51:28Z)
• The Ann Arbor Architecture for Agent-Oriented Programming [6.630761601310476]
  We argue that language models function as automata and, like all automata, should be programmed in the languages they accept. We introduce the Ann Arbor Architecture, a conceptual framework for agent-oriented programming of language models. We present the design of our agent platform Postline, and report on our initial experiments in agent training.
  arXiv  Detail & Related papers  (2025-02-14T04:21:36Z)
• An Agentic Approach to Automatic Creation of P&ID Diagrams from Natural Language Descriptions [2.8039483625021258]
  We introduce a novel copilot for automating the generation of P&IDs from natural language descriptions. We demonstrate the feasibility of the generation process by evaluating the soundness and completeness of the workflow, and show improved results compared to vanilla zero-shot and few-shot generation approaches.
  arXiv  Detail & Related papers  (2024-12-17T13:21:26Z)
• Generative AI Systems: A Systems-based Perspective on Generative AI [12.400966570867322]
  Large Language Models (LLMs) have revolutionized AI systems by enabling communication with machines using natural language. Recent developments in Generative AI (GenAI) have shown great promise in using LLMs as multimodal systems. This paper aims to explore and state new research directions in Generative AI Systems.
  arXiv  Detail & Related papers  (2024-06-25T12:51:47Z)
• A Roadmap Towards Automated and Regulated Robotic Systems [4.6015001632772545]
  We argue that the unregulated generative processes from AI is fitted for low level end tasks. We propose a roadmap that can lead to fully automated and regulated robotic systems.
  arXiv  Detail & Related papers  (2024-03-21T00:14:53Z)
• RoboScript: Code Generation for Free-Form Manipulation Tasks across Real and Simulation [77.41969287400977]
  This paper presents textbfRobotScript, a platform for a deployable robot manipulation pipeline powered by code generation. We also present a benchmark for a code generation benchmark for robot manipulation tasks in free-form natural language. We demonstrate the adaptability of our code generation framework across multiple robot embodiments, including the Franka and UR5 robot arms.
  arXiv  Detail & Related papers  (2024-02-22T15:12:00Z)
• Learning a Hierarchical Planner from Humans in Multiple Generations [21.045112705349222]
  We present natural programming, a library learning system that combines programmatic learning with a hierarchical planner. A user teaches the system via curriculum building, by identifying a challenging yet not impossible goal. The system solves for the goal via hierarchical planning, using the linguistic hints to guide its probability distribution.
  arXiv  Detail & Related papers  (2023-10-17T22:28:13Z)
• A Graphical Modeling Language for Artificial Intelligence Applications in Automation Systems [69.50862982117127]
  An interdisciplinary graphical modeling language that enables the modeling of an AI application as an overall system comprehensible to all disciplines does not yet exist. This paper presents a graphical modeling language that enables consistent and understandable modeling of AI applications in automation systems at system level.
  arXiv  Detail & Related papers  (2023-06-20T12:06:41Z)
• Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model [63.66204449776262]
  Instruct2Act is a framework that maps multi-modal instructions to sequential actions for robotic manipulation tasks. Our approach is adjustable and flexible in accommodating various instruction modalities and input types. Our zero-shot method outperformed many state-of-the-art learning-based policies in several tasks.
  arXiv  Detail & Related papers  (2023-05-18T17:59:49Z)
• ProgPrompt: Generating Situated Robot Task Plans using Large Language Models [68.57918965060787]
  Large language models (LLMs) can be used to score potential next actions during task planning. We present a programmatic LLM prompt structure that enables plan generation functional across situated environments.
  arXiv  Detail & Related papers  (2022-09-22T20:29:49Z)
• Natural Language Processing for Systems Engineering: Automatic Generation of Systems Modelling Language Diagrams [0.10312968200748115]
  An approach is proposed to assist systems engineers in the automatic generation of systems diagrams from unstructured natural language text. The intention is to provide the users with a more standardised, comprehensive and automated starting point onto which subsequently refine and adapt the diagrams according to their needs.
  arXiv  Detail & Related papers  (2022-08-09T19:20:33Z)
• GenNI: Human-AI Collaboration for Data-Backed Text Generation [102.08127062293111]
  Table2Text systems generate textual output based on structured data utilizing machine learning. GenNI (Generation Negotiation Interface) is an interactive visual system for high-level human-AI collaboration in producing descriptive text.
  arXiv  Detail & Related papers  (2021-10-19T18:07:07Z)
• Procedures as Programs: Hierarchical Control of Situated Agents through Natural Language [81.73820295186727]
  We propose a formalism of procedures as programs, a powerful yet intuitive method of representing hierarchical procedural knowledge for agent command and control. We instantiate this framework on the IQA and ALFRED datasets for NL instruction following.
  arXiv  Detail & Related papers  (2021-09-16T20:36:21Z)
• Combining Planning and Learning of Behavior Trees for Robotic Assembly [0.9262157005505219]
  We propose a method for generating Behavior Trees using a Genetic Programming algorithm. We show that this type of high level learning of Behavior Trees can be transferred to a real system without further training.
  arXiv  Detail & Related papers  (2021-03-16T13:11:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.