A reinforcement learning based construction material supply strategy using robotic crane and computer vision for building reconstruction after an earthquake

• URL: http://arxiv.org/abs/2308.16280v1
• Date: Wed, 30 Aug 2023 19:13:23 GMT
• Title: A reinforcement learning based construction material supply strategy using robotic crane and computer vision for building reconstruction after an earthquake
• Authors: Yifei Xiao, T.Y. Yang, Xiao Pan, Fan Xie and Zhongwei Chen
• Abstract summary: In this paper, the robotic crane with advanced AI algorithms is proposed to provide resources for infrastructure reconstruction after an earthquake. The proximal policy optimization (PPO), a reinforcement learning (RL) algorithm, is implemented for 3D lift path planning. Two models are trained through a loading task in different environments by using PPO algorithm, one considering the influence of obstacles and the other not considering obstacles.
• Score: 7.0046513193263165
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: After an earthquake, it is particularly important to provide the necessary resources on site because a large number of infrastructures need to be repaired or newly constructed. Due to the complex construction environment after the disaster, there are potential safety hazards for human labors working in this environment. With the advancement of robotic technology and artificial intelligent (AI) algorithms, smart robotic technology is the potential solution to provide construction resources after an earthquake. In this paper, the robotic crane with advanced AI algorithms is proposed to provide resources for infrastructure reconstruction after an earthquake. The proximal policy optimization (PPO), a reinforcement learning (RL) algorithm, is implemented for 3D lift path planning when transporting the construction materials. The state and reward function are designed in detail for RL model training. Two models are trained through a loading task in different environments by using PPO algorithm, one considering the influence of obstacles and the other not considering obstacles. Then, the two trained models are compared and evaluated through an unloading task and a loading task in simulation environments. For each task, two different cases are considered. One is that there is no obstacle between the initial position where the construction material is lifted and the target position, and the other is that there are obstacles between the initial position and the target position. The results show that the model that considering the obstacles during training can generate proper actions for the robotic crane to execute so that the crane can automatically transport the construction materials to the desired location with swing suppression, short time consumption and collision avoidance.

Related papers

• Robotic warehousing operations: a learn-then-optimize approach to large-scale neighborhood search [84.39855372157616]
  This paper supports robotic parts-to-picker operations in warehousing by optimizing order-workstation assignments, item-pod assignments and the schedule of order fulfillment at workstations. We solve it via large-scale neighborhood search, with a novel learn-then-optimize approach to subproblem generation. In collaboration with Amazon Robotics, we show that our model and algorithm generate much stronger solutions for practical problems than state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-08-29T20:22:22Z)
• Rapid post-disaster infrastructure damage characterisation enabled by remote sensing and deep learning technologies -- a tiered approach [0.4837072536850576]
  Transport networks and bridges are systematically targeted during wars and suffer damage during natural disasters. No methods exist for automated characterisation of damage at multiple scales. We propose an integrated, multi-scale tiered approach to fill this capability gap.
  arXiv  Detail & Related papers  (2024-01-31T11:36:12Z)
• RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation [68.70755196744533]
  RoboGen is a generative robotic agent that automatically learns diverse robotic skills at scale via generative simulation. Our work attempts to extract the extensive and versatile knowledge embedded in large-scale models and transfer them to the field of robotics.
  arXiv  Detail & Related papers  (2023-11-02T17:59:21Z)
• Robotic Handling of Compliant Food Objects by Robust Learning from Demonstration [79.76009817889397]
  We propose a robust learning policy based on Learning from Demonstration (LfD) for robotic grasping of food compliant objects. We present an LfD learning policy that automatically removes inconsistent demonstrations, and estimates the teacher's intended policy. The proposed approach has a vast range of potential applications in the aforementioned industry sectors.
  arXiv  Detail & Related papers  (2023-09-22T13:30:26Z)
• Cloud-Based Hierarchical Imitation Learning for Scalable Transfer of Construction Skills from Human Workers to Assisting Robots [0.0]
  This paper proposes an immersive, cloud robotics-based virtual demonstration framework. It digitalizes the demonstration process, eliminating the need for repetitive physical manipulation of heavy construction objects. By delegating the physical strains of construction work to human-trained robots, this framework promotes the inclusion of workers with diverse physical capabilities.
  arXiv  Detail & Related papers  (2023-09-20T20:04:42Z)
• Robot-Enabled Construction Assembly with Automated Sequence Planning based on ChatGPT: RoboGPT [3.4107729935810944]
  This paper introduces RoboGPT, a novel system that leverages the advanced reasoning capabilities of ChatGPT. The proposed system adapts ChatGPT for construction sequence planning and demonstrate its feasibility and effectiveness. The results show that RoboGPT-driven robots can handle complex construction operations and adapt to changes on the fly.
  arXiv  Detail & Related papers  (2023-04-21T15:04:41Z)
• Learning Design and Construction with Varying-Sized Materials via Prioritized Memory Resets [30.993174896902357]
  Can a robot autonomously learn to design and construct a bridge from varying-sized blocks without a blueprint? It is a challenging task with long horizon and sparse reward -- the robot has to figure out physically stable design schemes and feasible actions to manipulate and transport blocks. In this paper, we propose a hierarchical approach for this problem. It consists of a reinforcement-learning designer to propose high-level building instructions and a motion-planning-based action generator to manipulate blocks at the low level.
  arXiv  Detail & Related papers  (2022-04-12T03:45:48Z)
• ADAPT: An Open-Source sUAS Payload for Real-Time Disaster Prediction and Response with AI [55.41644538483948]
  Small unmanned aircraft systems (sUAS) are becoming prominent components of many humanitarian assistance and disaster response operations. We have developed the free and open-source ADAPT multi-mission payload for deploying real-time AI and computer vision onboard a sUAS. We demonstrate the example mission of real-time, in-flight ice segmentation to monitor river ice state and provide timely predictions of catastrophic flooding events.
  arXiv  Detail & Related papers  (2022-01-25T14:51:19Z)
• AI Agents in Emergency Response Applications [0.0]
  Emergency personnel respond to various situations ranging from fire, medical, hazardous materials, industrial accidents, to natural disasters. Mission-critical "edge AI" situations require low-latency, reliable analytics. We propose an agent-based architecture for deployment of AI agents via 5G service-based architecture.
  arXiv  Detail & Related papers  (2021-09-10T03:24:50Z)
• Habitat 2.0: Training Home Assistants to Rearrange their Habitat [122.54624752876276]
  We introduce Habitat 2.0 (H2.0), a simulation platform for training virtual robots in interactive 3D environments. We make contributions to all levels of the embodied AI stack - data, simulation, and benchmark tasks.
  arXiv  Detail & Related papers  (2021-06-28T05:42:15Z)
• Simultaneous Navigation and Construction Benchmarking Environments [73.0706832393065]
  We need intelligent robots for mobile construction, the process of navigating in an environment and modifying its structure according to a geometric design. In this task, a major robot vision and learning challenge is how to exactly achieve the design without GPS. We benchmark the performance of a handcrafted policy with basic localization and planning, and state-of-the-art deep reinforcement learning methods.
  arXiv  Detail & Related papers  (2021-03-31T00:05:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.