SkiROS2: A skill-based Robot Control Platform for ROS
- URL: http://arxiv.org/abs/2306.17030v1
- Date: Thu, 29 Jun 2023 15:25:51 GMT
- Title: SkiROS2: A skill-based Robot Control Platform for ROS
- Authors: Matthias Mayr, Francesco Rovida, Volker Krueger
- Abstract summary: We introduce SkiROS2, a skill-based robot control platform on top of ROS.
SkiROS2 proposes a layered, hybrid control structure for automated task planning, and reactive execution.
We relate SkiROS2 to the field and outline three example use cases that cover task planning, reasoning, multisensory input, integration in a manufacturing execution system and reinforcement learning.
- Score: 1.4502611532302039
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The need for autonomous robot systems in both the service and the industrial
domain is larger than ever. In the latter, the transition to small batches or
even "batch size 1" in production created a need for robot control system
architectures that can provide the required flexibility. Such architectures
must not only have a sufficient knowledge integration framework. It must also
support autonomous mission execution and allow for interchangeability and
interoperability between different tasks and robot systems. We introduce
SkiROS2, a skill-based robot control platform on top of ROS. SkiROS2 proposes a
layered, hybrid control structure for automated task planning, and reactive
execution, supported by a knowledge base for reasoning about the world state
and entities. The scheduling formulation builds on the extended behavior tree
model that merges task-level planning and execution. This allows for a high
degree of modularity and a fast reaction to changes in the environment. The
skill formulation based on pre-, hold- and post-conditions allows to organize
robot programs and to compose diverse skills reaching from perception to
low-level control and the incorporation of external tools. We relate SkiROS2 to
the field and outline three example use cases that cover task planning,
reasoning, multisensory input, integration in a manufacturing execution system
and reinforcement learning.
Related papers
- $π_0$: A Vision-Language-Action Flow Model for General Robot Control [77.32743739202543]
We propose a novel flow matching architecture built on top of a pre-trained vision-language model (VLM) to inherit Internet-scale semantic knowledge.
We evaluate our model in terms of its ability to perform tasks in zero shot after pre-training, follow language instructions from people, and its ability to acquire new skills via fine-tuning.
arXiv Detail & Related papers (2024-10-31T17:22:30Z) - $\textbf{EMOS}$: $\textbf{E}$mbodiment-aware Heterogeneous $\textbf{M}$ulti-robot $\textbf{O}$perating $\textbf{S}$ystem with LLM Agents [33.77674812074215]
We introduce a novel multi-agent framework designed to enable effective collaboration among heterogeneous robots.
We propose a self-prompted approach, where agents comprehend robot URDF files and call robot kinematics tools to generate descriptions of their physics capabilities.
The Habitat-MAS benchmark is designed to assess how a multi-agent framework handles tasks that require embodiment-aware reasoning.
arXiv Detail & Related papers (2024-10-30T03:20:01Z) - Enabling Novel Mission Operations and Interactions with ROSA: The Robot Operating System Agent [6.031333490943827]
This paper introduces ROSA (Robot Operating System Agent), an AI-powered agent that bridges the gap between the Robot Operating System (ROS) and natural language interfaces.
By leveraging state-of-the-art language models and integrating open-source frameworks, ROSA enables operators to interact with robots using natural language.
arXiv Detail & Related papers (2024-10-09T01:54:02Z) - COHERENT: Collaboration of Heterogeneous Multi-Robot System with Large Language Models [49.24666980374751]
COHERENT is a novel LLM-based task planning framework for collaboration of heterogeneous multi-robot systems.
A Proposal-Execution-Feedback-Adjustment mechanism is designed to decompose and assign actions for individual robots.
The experimental results show that our work surpasses the previous methods by a large margin in terms of success rate and execution efficiency.
arXiv Detail & Related papers (2024-09-23T15:53:41Z) - Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Models [81.55156507635286]
Legged robots are physically capable of navigating a diverse variety of environments and overcoming a wide range of obstructions.
Current learning methods often struggle with generalization to the long tail of unexpected situations without heavy human supervision.
We propose a system, VLM-Predictive Control (VLM-PC), combining two key components that we find to be crucial for eliciting on-the-fly, adaptive behavior selection.
arXiv Detail & Related papers (2024-07-02T21:00:30Z) - ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoning [74.58666091522198]
We present a framework for intuitive robot programming by non-experts.
We leverage natural language prompts and contextual information from the Robot Operating System (ROS)
Our system integrates large language models (LLMs), enabling non-experts to articulate task requirements to the system through a chat interface.
arXiv Detail & Related papers (2024-06-28T08:28:38Z) - RoboScript: Code Generation for Free-Form Manipulation Tasks across Real
and Simulation [77.41969287400977]
This paper presents textbfRobotScript, a platform for a deployable robot manipulation pipeline powered by code generation.
We also present a benchmark for a code generation benchmark for robot manipulation tasks in free-form natural language.
We demonstrate the adaptability of our code generation framework across multiple robot embodiments, including the Franka and UR5 robot arms.
arXiv Detail & Related papers (2024-02-22T15:12:00Z) - Using Knowledge Representation and Task Planning for Robot-agnostic
Skills on the Example of Contact-Rich Wiping Tasks [44.99833362998488]
We show how a single robot skill that utilizes knowledge representation, task planning, and automatic selection of skill implementations can be executed in different contexts.
We demonstrate how the skill-based control platform enables this with contact-rich wiping tasks on different robot systems.
arXiv Detail & Related papers (2023-08-27T21:17:32Z) - PlanSys2: A Planning System Framework for ROS2 [0.12073758871143175]
PlanSys2 aims to be the reference task planning framework in ROS2, the latest version of the em de facto standard in robotics software development.
It can be highlighted the optimized execution, based on Behavior Trees, of plans through a new actions auction protocol and its multi-robot planning capabilities.
It already has a small but growing community of users and developers, and this document is a summary of the design and capabilities of this project.
arXiv Detail & Related papers (2021-07-01T11:24:44Z) - Machine Learning-Based Automated Design Space Exploration for Autonomous
Aerial Robots [55.056709056795206]
Building domain-specific architectures for autonomous aerial robots is challenging due to a lack of systematic methodology for designing onboard compute.
We introduce a novel performance model called the F-1 roofline to help architects understand how to build a balanced computing system.
To navigate the cyber-physical design space automatically, we subsequently introduce AutoPilot.
arXiv Detail & Related papers (2021-02-05T03:50:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.