Dynamic AGV Task Allocation in Intelligent Warehouses
- URL: http://arxiv.org/abs/2312.16026v1
- Date: Tue, 26 Dec 2023 12:28:25 GMT
- Title: Dynamic AGV Task Allocation in Intelligent Warehouses
- Authors: Arash Dehghan and Mucahit Cevik and Merve Bodur
- Abstract summary: The booming AGV industry is witnessing widespread adoption due to its efficiency, reliability, and cost-effectiveness.
This paper focuses on enhancing the picker-to-parts system, prevalent in small to medium-sized warehouses, through the strategic use of AGVs.
We propose a novel approach Neural Dynamic Programming approach for coordinating a mixed team of human AGV workers.
- Score: 1.519321208145928
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This paper explores the integration of Automated Guided Vehicles (AGVs) in
warehouse order picking, a crucial and cost-intensive aspect of warehouse
operations. The booming AGV industry, accelerated by the COVID-19 pandemic, is
witnessing widespread adoption due to its efficiency, reliability, and
cost-effectiveness in automating warehouse tasks. This paper focuses on
enhancing the picker-to-parts system, prevalent in small to medium-sized
warehouses, through the strategic use of AGVs. We discuss the benefits and
applications of AGVs in various warehouse tasks, highlighting their
transformative potential in improving operational efficiency. We examine the
deployment of AGVs by leading companies in the industry, showcasing their
varied functionalities in warehouse management. Addressing the gap in research
on optimizing operational performance in hybrid environments where humans and
AGVs coexist, our study delves into a dynamic picker-to-parts warehouse
scenario. We propose a novel approach Neural Approximate Dynamic Programming
approach for coordinating a mixed team of human and AGV workers, aiming to
maximize order throughput and operational efficiency. This involves innovative
solutions for non-myopic decision making, order batching, and battery
management. We also discuss the integration of advanced robotics technology in
automating the complete order-picking process. Through a comprehensive
numerical study, our work offers valuable insights for managing a heterogeneous
workforce in a hybrid warehouse setting, contributing significantly to the
field of warehouse automation and logistics.
Related papers
- Robotic warehousing operations: a learn-then-optimize approach to large-scale neighborhood search [84.39855372157616]
This paper supports robotic parts-to-picker operations in warehousing by optimizing order-workstation assignments, item-pod assignments and the schedule of order fulfillment at workstations.
We solve it via large-scale neighborhood search, with a novel learn-then-optimize approach to subproblem generation.
In collaboration with Amazon Robotics, we show that our model and algorithm generate much stronger solutions for practical problems than state-of-the-art approaches.
arXiv Detail & Related papers (2024-08-29T20:22:22Z) - Multi-Agent Path Finding with Real Robot Dynamics and Interdependent Tasks for Automated Warehouses [1.2810395420131764]
Multi-Agent Path Finding (MAPF) is an important optimization problem underlying the deployment of robots in automated warehouses and factories.
We consider a realistic problem of online order delivery in a warehouse, where a fleet of robots bring the products belonging to each order from shelves to workstations.
This creates a stream of inter-dependent pickup and delivery tasks and the associated MAPF problem consists of computing realistic collision-free robot trajectories.
arXiv Detail & Related papers (2024-08-26T15:13:38Z) - A Meta-Engine Framework for Interleaved Task and Motion Planning using Topological Refinements [51.54559117314768]
Task And Motion Planning (TAMP) is the problem of finding a solution to an automated planning problem.
We propose a general and open-source framework for modeling and benchmarking TAMP problems.
We introduce an innovative meta-technique to solve TAMP problems involving moving agents and multiple task-state-dependent obstacles.
arXiv Detail & Related papers (2024-08-11T14:57:57Z) - Cooperative Cognitive Dynamic System in UAV Swarms: Reconfigurable Mechanism and Framework [80.39138462246034]
We propose the cooperative cognitive dynamic system (CCDS) to optimize the management for UAV swarms.
CCDS is a hierarchical and cooperative control structure that enables real-time data processing and decision.
In addition, CCDS can be integrated with the biomimetic mechanism to efficiently allocate tasks for UAV swarms.
arXiv Detail & Related papers (2024-05-18T12:45:00Z) - Random Network Distillation Based Deep Reinforcement Learning for AGV Path Planning [0.0]
We present simulation environments of AGV path planning with continuous actions and positions for AGVs.
Results demonstrate that our proposed method enables AGV to more rapidly complete path planning tasks with continuous actions in our environments.
arXiv Detail & Related papers (2024-04-19T02:52:56Z) - Learning Efficient and Fair Policies for Uncertainty-Aware Collaborative Human-Robot Order Picking [11.997524293204368]
In collaborative human-robot order picking systems, human pickers and Autonomous Mobile Robots (AMRs) travel independently through a warehouse and meet at pick locations where pickers load items onto AMRs.
We propose a novel multi-objective Deep Reinforcement Learning (DRL) approach to learn effective allocation policies to pick efficiency while also aiming to improve workload fairness amongst human pickers.
arXiv Detail & Related papers (2024-04-09T11:45:16Z) - Multi-Robot Coordination and Layout Design for Automated Warehousing [55.150593161240444]
We show that, even with state-of-the-art MAPF algorithms, commonly used human-designed layouts can lead to congestion for warehouses with large numbers of robots.
We extend existing automatic scenario generation methods to optimize warehouse layouts.
Results show that our optimized warehouse layouts (1) reduce traffic congestion and thus improve throughput, (2) improve the scalability of the automated warehouses by doubling the number of robots in some cases, and (3) are capable of generating layouts with user-specified diversity measures.
arXiv Detail & Related papers (2023-05-10T20:00:06Z) - Scalable Multi-Agent Reinforcement Learning for Warehouse Logistics with Robotic and Human Co-Workers [41.293077032127904]
We consider a warehouse in which dozens of mobile robots and human pickers work together to collect and deliver items within the warehouse.
The fundamental problem we tackle is how these worker agents must coordinate their movement and actions in the warehouse to maximise performance in this task.
We develop hierarchical MARL algorithms in which a manager agent assigns goals to worker agents, and the policies of the manager and workers are co-trained toward maximising a global objective.
arXiv Detail & Related papers (2022-12-22T06:18:41Z) - DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in
Complex Environments [55.204450019073036]
We present a novel reinforcement learning based task allocation and decentralized navigation algorithm for mobile robots in warehouse environments.
We consider the problem of joint decentralized task allocation and navigation and present a two level approach to solve it.
We observe improvement up to 14% in terms of task completion time and up-to 40% improvement in terms of computing collision-free trajectories for the robots.
arXiv Detail & Related papers (2022-09-07T00:35:27Z) - Efficient UAV Trajectory-Planning using Economic Reinforcement Learning [65.91405908268662]
We introduce REPlanner, a novel reinforcement learning algorithm inspired by economic transactions to distribute tasks between UAVs.
We formulate the path planning problem as a multi-agent economic game, where agents can cooperate and compete for resources.
As the system computes task distributions via UAV cooperation, it is highly resilient to any change in the swarm size.
arXiv Detail & Related papers (2021-03-03T20:54:19Z) - Dynamic Dispatching for Large-Scale Heterogeneous Fleet via Multi-agent
Deep Reinforcement Learning [10.835960004409708]
We propose a novel Deep Reinforcement Learning approach to solve the dynamic problem in mining.
We first develop an event-based mining simulator with parameters calibrated in real mines.
Then we propose an experience-sharing Deep Q Network with a novel abstract state/action representation to learn memories from heterogeneous agents.
arXiv Detail & Related papers (2020-08-24T21:29:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.