Multi-Agent Deep Reinforcement Learning for Efficient Passenger Delivery in Urban Air Mobility

• URL: http://arxiv.org/abs/2211.06890v1
• Date: Sun, 13 Nov 2022 12:30:48 GMT
• Title: Multi-Agent Deep Reinforcement Learning for Efficient Passenger Delivery in Urban Air Mobility
• Abstract summary: Urban air mobility (UAM) will play a key role in future transportation. This paper proposes a novel cooperative MADRL algorithm for reliable and efficient passenger delivery in UAM networks.
• Score: 16.081324675010084
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: It has been considered that urban air mobility (UAM), also known as drone-taxi or electrical vertical takeoff and landing (eVTOL), will play a key role in future transportation. By putting UAM into practical future transportation, several benefits can be realized, i.e., (i) the total travel time of passengers can be reduced compared to traditional transportation and (ii) there is no environmental pollution and no special labor costs to operate the system because electric batteries will be used in UAM system. However, there are various dynamic and uncertain factors in the flight environment, i.e., passenger sudden service requests, battery discharge, and collision among UAMs. Therefore, this paper proposes a novel cooperative MADRL algorithm based on centralized training and distributed execution (CTDE) concepts for reliable and efficient passenger delivery in UAM networks. According to the performance evaluation results, we confirm that the proposed algorithm outperforms other existing algorithms in terms of the number of serviced passengers increase (30%) and the waiting time per serviced passenger decrease (26%)

Related papers

• Wind-Informed Rapid Flight-Planning in Complex Urban Topologies via Machine Learning and Experimental Validation [46.65676221937358]
  This work proposes a novel framework towards safe flight planning of aerial vehicles in windy urban environments.<n>A learning-based surrogate model is trained to rapidly predict flow fields from readily available information.<n>A safe, flow-informed flight trajectory is then identified through a cost-minimizing pathfinder.
  arXiv  Detail & Related papers  (2026-08-10T23:30:49Z)
• Distance-based subsidy rate design to incentivize ride-hail access to advanced air mobility hubs [3.413565933896758]
  This study proposes a distance-based subsidy rate design for advanced air mobility (AAM) operators to incentivize ride-hail access to AAM hubs.<n>Using New York City (NYC) airport access as a case study, this study integrates high-volume for-hire vehicle (HVFHV) data from NYC taxi zones.<n>Results show that AAM operators would need to subsidize the ride-hailing operators on vertiport access trips when air taxi operating costs exceed $12/mi.
  arXiv  Detail & Related papers  (2026-06-19T12:54:23Z)
• Heterogeneous Vertiport Selection Optimization for On-Demand Air Taxi Services: A Deep Reinforcement Learning Approach [19.822206623719808]
  Urban Air Mobility (UAM) has emerged as a transformative solution to alleviate urban congestion by utilizing low-altitude airspace.<n>To enable truly efficient and seamless door-to-door travel experiences, UAM requires close integration with existing ground transportation infrastructure.<n>We propose a unified optimization model that integrates strategy selection for both air and ground transportation.
  arXiv  Detail & Related papers  (2026-01-29T06:26:16Z)
• Non-myopic Matching and Rebalancing in Large-Scale On-Demand Ride-Pooling Systems Using Simulation-Informed Reinforcement Learning [1.7403133838762448]
  Ride-pooling, also known as ride-hailing, shared ride-sharing, or microtransit, is a service wherein passengers share rides.<n>A key limitation, however, is its myopic decision-making which overlooks long-term effects of dispatch decisions.<n>We propose a simulation-informed reinforcement learning (RL) approach to address this.
  arXiv  Detail & Related papers  (2025-10-28T23:21:27Z)
• Semi-on-Demand Transit Feeders with Shared Autonomous Vehicles and Reinforcement-Learning-Based Zonal Dispatching Control [2.5407305954218797]
  This paper develops a semi-on-demand transit feeder service using shared autonomous vehicles (SAVs) and zonal dispatching control based on reinforcement learning (RL)<n>After efficient training of the RL model, the semi-on-demand service with dynamic zonal control serves 16% more passengers at 13% higher generalized costs on average compared to traditional fixed-route service.
  arXiv  Detail & Related papers  (2025-09-02T02:14:11Z)
• Real-Time Communication-Aware Ride-Sharing Route Planning for Urban Air Mobility: A Multi-Source Hybrid Attention Reinforcement Learning Approach [27.425849779266613]
  Urban Air Mobility (UAM) systems are rapidly emerging as promising solutions to alleviate urban congestion.<n>Unlike ground transportation, UAM trajectory planning has to prioritize communication quality for accurate location tracking.<n>This work proposes constructing a radio map to evaluate the communication quality of urban airspace.
  arXiv  Detail & Related papers  (2025-07-18T06:09:30Z)
• Task Delay and Energy Consumption Minimization for Low-altitude MEC via Evolutionary Multi-objective Deep Reinforcement Learning [52.64813150003228]
  The low-altitude economy (LAE), driven by unmanned aerial vehicles (UAVs) and other aircraft, has revolutionized fields such as transportation, agriculture, and environmental monitoring. In the upcoming six-generation (6G) era, UAV-assisted mobile edge computing (MEC) is particularly crucial in challenging environments such as mountainous or disaster-stricken areas. The task offloading problem is one of the key issues in UAV-assisted MEC, primarily addressing the trade-off between minimizing the task delay and the energy consumption of the UAV.
  arXiv  Detail & Related papers  (2025-01-11T02:32:42Z)
• Demand Modeling for Advanced Air Mobility [21.445133878049333]
  Advanced Air Mobility (AAM) has emerged as a promising transportation alternative. This study analyzes the demand dynamics of AAM by analyzing employment based trip data across Tennessee's census tracts. Our findings indicate that trips are more likely to be viable for AAM if air transportation accounts for over 70% of the Generalized Cost of Trip.
  arXiv  Detail & Related papers  (2024-11-25T21:51:39Z)
• Fast Decision Support for Air Traffic Management at Urban Air Mobility Vertiports using Graph Learning [7.2547164017692625]
  Urban Air Mobility (UAM) aircraft are conceived to operate from small airports called vertiports. Managing this schedule in real-time becomes challenging for a traditional air-traffic controller but instead calls for an automated solution. This paper provides a novel approach to this problem of Urban Air Mobility - Vertiport Schedule Management (UAM-VSM), which leverages graph reinforcement learning to generate decision-support policies.
  arXiv  Detail & Related papers  (2023-08-17T16:05:44Z)
• Multi-Agent Deep Reinforcement Learning for Dynamic Avatar Migration in AIoT-enabled Vehicular Metaverses with Trajectory Prediction [70.9337170201739]
  We propose a model to predict the future trajectories of intelligent vehicles based on their historical data. We show that our proposed algorithm can effectively reduce the latency of executing avatar tasks by around 25% without prediction.
  arXiv  Detail & Related papers  (2023-06-26T13:27:11Z)
• A deep reinforcement learning approach to assess the low-altitude airspace capacity for urban air mobility [0.0]
  Urban air mobility aims to provide a fast and secure way of travel by utilizing the low-altitude airspace. Authorities are still working on the redaction of new flight rules applicable to urban air mobility. An autonomous UAV path planning framework is proposed using a deep reinforcement learning approach and a deep deterministic policy gradient algorithm.
  arXiv  Detail & Related papers  (2023-01-23T23:38:05Z)
• Learning energy-efficient driving behaviors by imitating experts [75.12960180185105]
  This paper examines the role of imitation learning in bridging the gap between control strategies and realistic limitations in communication and sensing. We show that imitation learning can succeed in deriving policies that, if adopted by 5% of vehicles, may boost the energy-efficiency of networks with varying traffic conditions by 15% using only local observations.
  arXiv  Detail & Related papers  (2022-06-28T17:08:31Z)
• Wireless-Enabled Asynchronous Federated Fourier Neural Network for Turbulence Prediction in Urban Air Mobility (UAM) [101.80862265018033]
  Urban air mobility (UAM) has been proposed in which vertical takeoff and landing (VTOL) aircraft are used to provide a ride-hailing service. In UAM, aircraft can operate in designated air spaces known as corridors, that link the aerodromes. A reliable communication network between GBSs and aircraft enables UAM to adequately utilize the airspace.
  arXiv  Detail & Related papers  (2021-12-26T14:41:52Z)
• Risk Adversarial Learning System for Connected and Autonomous Vehicle Charging [43.42105971560163]
  We study the design of a rational decision support system (RDSS) for a connected and autonomous vehicle charging infrastructure (CAV-CI) In the considered CAV-CI, the distribution system operator (DSO) deploys electric vehicle supply equipment (EVSE) to provide an EV charging facility for human-driven connected vehicles (CVs) and autonomous vehicles (AVs) The charging request by the human-driven EV becomes irrational when it demands more energy and charging period than its actual need. We propose a novel risk adversarial multi-agent learning system (ALS) for CAV-CI to solve
  arXiv  Detail & Related papers  (2021-08-02T02:38:15Z)
• A Multi-UAV System for Exploration and Target Finding in Cluttered and GPS-Denied Environments [68.31522961125589]
  We propose a framework for a team of UAVs to cooperatively explore and find a target in complex GPS-denied environments with obstacles. The team of UAVs autonomously navigates, explores, detects, and finds the target in a cluttered environment with a known map. Results indicate that the proposed multi-UAV system has improvements in terms of time-cost, the proportion of search area surveyed, as well as successful rates for search and rescue missions.
  arXiv  Detail & Related papers  (2021-07-19T12:54:04Z)
• Efficient UAV Trajectory-Planning using Economic Reinforcement Learning [65.91405908268662]
  We introduce REPlanner, a novel reinforcement learning algorithm inspired by economic transactions to distribute tasks between UAVs. We formulate the path planning problem as a multi-agent economic game, where agents can cooperate and compete for resources. As the system computes task distributions via UAV cooperation, it is highly resilient to any change in the swarm size.
  arXiv  Detail & Related papers  (2021-03-03T20:54:19Z)
• Air taxi service for urban mobility: A critical review of recent developments, future challenges, and opportunities [9.594432031144716]
  Air taxi service (ATS) is an aerial on-demand transport for a single passenger or a small group of riders. By adopting an electric vertical takeoff and landing concept (eVTOL), air taxis could be operational from skyports retrofitted on building rooftops.
  arXiv  Detail & Related papers  (2021-02-24T22:48:03Z)
• FlexPool: A Distributed Model-Free Deep Reinforcement Learning Algorithm for Joint Passengers & Goods Transportation [36.989179280016586]
  This paper considers combining passenger transportation with goods delivery to improve vehicle-based transportation. We propose FlexPool, a distributed model-free deep reinforcement learning algorithm that jointly serves passengers & goods workloads. We show that FlexPool achieves 30% higher fleet utilization and 35% higher fuel efficiency in comparison to model-free approaches.
  arXiv  Detail & Related papers  (2020-07-27T17:25:58Z)
• A Physics Model-Guided Online Bayesian Framework for Energy Management of Extended Range Electric Delivery Vehicles [3.927161292818792]
  This paper improves an in-use rule-based EMS that is used in a delivery vehicle fleet equipped with two-way vehicle-to-cloud connectivity. A physics model-guided online Bayesian framework is described and validated on large number of in-use driving samples of EREVs used for last-mile package delivery. Results show an average of 12.8% fuel use reduction among tested vehicles for 155 real delivery trips.
  arXiv  Detail & Related papers  (2020-06-01T08:43:23Z)
• Congestion-aware Evacuation Routing using Augmented Reality Devices [96.68280427555808]
  We present a congestion-aware routing solution for indoor evacuation, which produces real-time individual-customized evacuation routes among multiple destinations. A population density map, obtained on-the-fly by aggregating locations of evacuees from user-end Augmented Reality (AR) devices, is used to model the congestion distribution inside a building.
  arXiv  Detail & Related papers  (2020-04-25T22:54:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.