HiRAD: A Flexible Large-Scale AGV Routing System
- URL: http://arxiv.org/abs/2609.09752v1
- Date: Wed, 09 Sep 2026 05:50:17 GMT
- Title: HiRAD: A Flexible Large-Scale AGV Routing System
- Abstract summary: We propose HiRAD, a hierarchical RL framework for continuous-space AGV routing with real-time guarantees.<n>HiRAD reduces makespan by 45 percent to 63 percent and shortens end-to-end runtime.
- Score: 6.059667257410882
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Automatic Guided Vehicles (AGVs) substantially boost warehouse throughput, but routing large-scale AGV fleets remains challenging. Classical Multi-Agent Pathfinding solvers suffer from exploding combinatorial complexity and super-quadratic runtime, while relying on idealized grid or piecewise-linear motion models that mismatch real-world kinematics. Recent Reinforcement Learning (RL) solutions improve flexibility via decentralized agent policies but depend on discretized spatiotemporal representations, require millions of episodes to converge, and incur full-map observation at every step, which leads to large models, slow convergence, and high inference latency that violates real-time industrial control constraints. To address these bottlenecks, we propose HiRAD, a hierarchical RL framework for continuous-space AGV routing with real-time guarantees: (1) a step-level spatiotemporal representation that translates continuous motion into a differentiable RL problem, (2) a hierarchical strategy that splits heading choice from velocity control to reduce the action space, and (3) an asynchronous event-driven decision pipeline that lowers inference complexity from O(n^2) to O(n) and cuts per-step latency by as much as 71 percent. Across random graphs and two warehouse maps, HiRAD reduces makespan by 45 percent to 63 percent and shortens end-to-end runtime.
Related papers
- Intelligent Multi-UAV Navigation in ITNTNs: A Hierarchical LLM Approach [33.68706070829591]
Large Language Models (LLMs) excel at semantic reasoning but suffer from high inference latency, rendering them unsuitable for real-time aerodynamic control.<n>A massive cloud-based LLM deployed on a High-Altitude Platform Station manages slow-timescale global load balancing.<n> lightweight edge-LLMs on individual UAVs translate local observations into tactical sub-goals to execute collision-free, handover-aware trajectories.
arXiv Detail & Related papers (2026-07-21T00:34:42Z) - Fast-dDrive: Efficient Block-Diffusion VLM for Autonomous Driving [54.31800246594724]
We present Fast-dDrive, a block-diffusion VLA that performs bidirectional refinement within semantic units.<n>We show that Fast-dDrive redefines the speed-accuracy frontier for driving agents.
arXiv Detail & Related papers (2026-05-22T02:31:32Z) - CLAP: Contrastive Latent-space Prompt Optimization for End-to-end Autonomous Driving [12.890001628695215]
We introduce CLAP, a location-aware adaptation framework that augments a frozen VLA driving model with per-roadblock soft prompts.<n>On the NAVSIM benchmark with various state-of-the-art VLA backbones, CLAP reduces challenging scenario planning error by 24% with no regression on normal frames.
arXiv Detail & Related papers (2026-05-17T06:45:53Z) - Towards Autonomous Railway Operations: A Semi-Hierarchical Deep Reinforcement Learning Approach to the Vehicle Rescheduling Problem [1.0348904561315861]
Managing disruptions in railway traffic management is a major challenge.<n>Rising traffic density and infrastructure limits increase complexity.<n>Most dispatching still relies on human expertise due to the problem's exponential complexity.<n>This paper introduces a semi-hierarchical RL formulation tailored to operational constraints.
arXiv Detail & Related papers (2026-05-11T09:23:50Z) - RAD-2: Scaling Reinforcement Learning in a Generator-Discriminator Framework [49.531001563853984]
RAD-2 is a unified generator-discriminator framework for closed-loop planning.<n>It produces diverse trajectory candidates, while an RL-optimized discriminator reranks these candidates according to their long-term driving quality.<n>It reduces the collision rate by 56% compared with strong diffusion-based planners.
arXiv Detail & Related papers (2026-04-16T17:59:44Z) - HAD: Combining Hierarchical Diffusion with Metric-Decoupled RL for End-to-End Driving [51.268878540511054]
We propose HAD, an end-to-end planning framework with a Hierarchical Diffusion Policy.<n>We show that HAD achieves new state-of-the-art performance on both NAVSIM and HUGSIM.
arXiv Detail & Related papers (2026-04-04T04:12:47Z) - AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edge [49.66156306240961]
High latency breaks the control loop, rendering powerful models unsafe for real-time deployment.<n>We propose AsyncVLA, an asynchronous control framework that decouples semantic reasoning from reactive execution.<n>AsyncVLA achieves a 40% higher success rate than state-of-the-art baselines.
arXiv Detail & Related papers (2026-02-13T21:31:19Z) - Human-Centric Traffic Signal Control for Equity: A Multi-Agent Action Branching Deep Reinforcement Learning Approach [5.2437780355984165]
We propose MA2B-DDQN, a human-centric multi-agent action-branching double Deep Q-Network (DQN) framework.<n>Our key contribution is an action-branching discrete control formulation that decomposes corridor control into local, per-intersection actions.<n>We also design a human-centric reward that penalizes the number of delayed individuals in the corridor, accounting for pedestrians, vehicle occupants, and transit passengers.
arXiv Detail & Related papers (2026-02-03T00:56:03Z) - Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail [85.47497935739936]
Alpamayo-R1 (AR1) is a vision-language-action model that integrates Chain of Causation reasoning with trajectory planning.<n>We show AR1 achieves 12% improvement in planning accuracy on challenging cases compared to a trajectory-only baseline.<n>We plan to release AR1 models and a subset of the CoC in a future update.
arXiv Detail & Related papers (2025-10-30T01:25:34Z) - SCoTT: Strategic Chain-of-Thought Tasking for Wireless-Aware Robot Navigation in Digital Twins [78.53885607559958]
We propose SCoTT, a wireless-aware path planning framework.<n>We show that SCoTT achieves path gains within 2% of DP-WA* while consistently generating shorter trajectories.<n>We also show the practical viability of our approach by deploying SCoTT as a ROS node within Gazebo simulations.
arXiv Detail & Related papers (2024-11-27T10:45:49Z) - Applying Neural Monte Carlo Tree Search to Unsignalized Multi-intersection Scheduling for Autonomous Vehicles [7.32653612106583]
We introduce a transformation model that maps sequences of potentially conflicting road-space reservation requests from platoons of vehicles into a series of board-game-like problems.
We use NMCTS to search for solutions representing optimal road-space allocation schedules in the context of past allocations.
We show that the proposed method maintained free-flow in light traffic when all intersections are under control of PNMCTS and outperformed state-of-the-art RL-based traffic-light controllers in average travel time by 74.5% and total throughput by 16% in heavy traffic.
arXiv Detail & Related papers (2024-10-24T14:37:55Z) - From Imitation to Exploration: End-to-end Autonomous Driving based on World Model [24.578178308010912]
RAMBLE is an end-to-end world model-based RL method for driving decision-making.<n>It can handle complex and dynamic traffic scenarios.<n>It achieves state-of-the-art performance in route completion rate on the CARLA Leaderboard 1.0 and completes all 38 scenarios on the CARLA Leaderboard 2.0.
arXiv Detail & Related papers (2024-10-03T06:45:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.