Robot-Enabled Construction Assembly with Automated Sequence Planning
based on ChatGPT: RoboGPT
- URL: http://arxiv.org/abs/2304.11018v1
- Date: Fri, 21 Apr 2023 15:04:41 GMT
- Title: Robot-Enabled Construction Assembly with Automated Sequence Planning
based on ChatGPT: RoboGPT
- Authors: Hengxu You, Yang Ye, Tianyu Zhou, Qi Zhu, Jing Du
- Abstract summary: This paper introduces RoboGPT, a novel system that leverages the advanced reasoning capabilities of ChatGPT.
The proposed system adapts ChatGPT for construction sequence planning and demonstrate its feasibility and effectiveness.
The results show that RoboGPT-driven robots can handle complex construction operations and adapt to changes on the fly.
- Score: 3.4107729935810944
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Robot-based assembly in construction has emerged as a promising solution to
address numerous challenges such as increasing costs, labor shortages, and the
demand for safe and efficient construction processes. One of the main obstacles
in realizing the full potential of these robotic systems is the need for
effective and efficient sequence planning for construction tasks. Current
approaches, including mathematical and heuristic techniques or machine learning
methods, face limitations in their adaptability and scalability to dynamic
construction environments. To expand the ability of the current robot system in
sequential understanding, this paper introduces RoboGPT, a novel system that
leverages the advanced reasoning capabilities of ChatGPT, a large language
model, for automated sequence planning in robot-based assembly applied to
construction tasks. The proposed system adapts ChatGPT for construction
sequence planning and demonstrate its feasibility and effectiveness through
experimental evaluation including Two case studies and 80 trials about real
construction tasks. The results show that RoboGPT-driven robots can handle
complex construction operations and adapt to changes on the fly. This paper
contributes to the ongoing efforts to enhance the capabilities and performance
of robot-based assembly systems in the construction industry, and it paves the
way for further integration of large language model technologies in the field
of construction robotics.
Related papers
- RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis [102.1876259853457]
We propose a tree-structured multimodal code generation framework for generalized robotic behavior synthesis, termed RoboCodeX.
RoboCodeX decomposes high-level human instructions into multiple object-centric manipulation units consisting of physical preferences such as affordance and safety constraints.
To further enhance the capability to map conceptual and perceptual understanding into control commands, a specialized multimodal reasoning dataset is collected for pre-training and an iterative self-updating methodology is introduced for supervised fine-tuning.
arXiv Detail & Related papers (2024-02-25T15:31:43Z) - RoboScript: Code Generation for Free-Form Manipulation Tasks across Real
and Simulation [77.41969287400977]
This paper presents textbfRobotScript, a platform for a deployable robot manipulation pipeline powered by code generation.
We also present a benchmark for a code generation benchmark for robot manipulation tasks in free-form natural language.
We demonstrate the adaptability of our code generation framework across multiple robot embodiments, including the Franka and UR5 robot arms.
arXiv Detail & Related papers (2024-02-22T15:12:00Z) - Interactive Planning Using Large Language Models for Partially
Observable Robotics Tasks [54.60571399091711]
Large Language Models (LLMs) have achieved impressive results in creating robotic agents for performing open vocabulary tasks.
We present an interactive planning technique for partially observable tasks using LLMs.
arXiv Detail & Related papers (2023-12-11T22:54:44Z) - RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation [68.70755196744533]
RoboGen is a generative robotic agent that automatically learns diverse robotic skills at scale via generative simulation.
Our work attempts to extract the extensive and versatile knowledge embedded in large-scale models and transfer them to the field of robotics.
arXiv Detail & Related papers (2023-11-02T17:59:21Z) - CoPAL: Corrective Planning of Robot Actions with Large Language Models [8.209152055117283]
We propose a system architecture that orchestrates a seamless interplay between cognitive levels, encompassing reasoning, planning, and motion generation.
At its core lies a novel replanning strategy that handles physically grounded, logical, and semantic errors in the generated plans.
arXiv Detail & Related papers (2023-10-11T07:39:42Z) - SkiROS2: A skill-based Robot Control Platform for ROS [1.4502611532302039]
We introduce SkiROS2, a skill-based robot control platform on top of ROS.
SkiROS2 proposes a layered, hybrid control structure for automated task planning, and reactive execution.
We relate SkiROS2 to the field and outline three example use cases that cover task planning, reasoning, multisensory input, integration in a manufacturing execution system and reinforcement learning.
arXiv Detail & Related papers (2023-06-29T15:25:51Z) - ProgPrompt: Generating Situated Robot Task Plans using Large Language
Models [68.57918965060787]
Large language models (LLMs) can be used to score potential next actions during task planning.
We present a programmatic LLM prompt structure that enables plan generation functional across situated environments.
arXiv Detail & Related papers (2022-09-22T20:29:49Z) - Cooperative Task and Motion Planning for Multi-Arm Assembly Systems [32.56644393804845]
Multi-robot assembly systems are becoming increasingly appealing in manufacturing.
Planning for these systems in a manner that ensures each robot is simultaneously productive, and not idle, is challenging.
We present a task and motion planning framework that jointly plans safe, low-makespan plans for a team of robots to assemble complex spatial structures.
arXiv Detail & Related papers (2022-03-04T18:12:49Z) - A Reference Software Architecture for Social Robots [64.86618385090416]
We propose a series of principles that social robots may benefit from.
These principles lay also the foundations for the design of a reference software architecture for Social Robots.
arXiv Detail & Related papers (2020-07-09T17:03:21Z) - Predicting Sample Collision with Neural Networks [5.713670854553366]
We present a framework to address the cost of expensive primitive operations in sampling-based motion planning.
We evaluate our framework on multiple planning problems with a variety of robots in 2D and 3D workspaces.
arXiv Detail & Related papers (2020-06-30T14:56:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.