Adaptive Height Optimisation for Cellular-Connected UAVs using Reinforcement Learning

• URL: http://arxiv.org/abs/2007.13695v3
• Date: Wed, 13 Apr 2022 09:54:22 GMT
• Title: Adaptive Height Optimisation for Cellular-Connected UAVs using Reinforcement Learning
• Abstract summary: This paper proposes a RL algorithm to dynamically optimise the height of a UAV as it moves through the environment. Results show that our proposed RL-based solution improves UAVs by 6% to 41%, depending on the scenario.
• Score: 7.073213965263513
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Providing reliable connectivity to cellular-connected UAV can be very challenging; their performance highly depends on the nature of the surrounding environment, such as density and heights of the ground BSs. On the other hand, tall buildings might block undesired interference signals from ground BSs, thereby improving the connectivity between the UAVs and their serving BSs. To address the connectivity of UAVs in such environments, this paper proposes a RL algorithm to dynamically optimise the height of a UAV as it moves through the environment, with the goal of increasing the throughput or spectrum efficiency that it experiences. The proposed solution is evaluated in two settings: using a series of generated environments where we vary the number of BS and building densities, and in a scenario using real-world data obtained from an experiment in Dublin, Ireland. Results show that our proposed RL-based solution improves UAVs QoS by 6% to 41%, depending on the scenario. We also conclude that, when flying at heights higher than the buildings, building density variation has no impact on UAV QoS. On the other hand, BS density can negatively impact UAV QoS, with higher numbers of BSs generating more interference and deteriorating UAV performance.

Related papers

• OpenCOOD-Air: Prompting Heterogeneous Ground-Air Collaborative Perception with Spatial Conversion and Offset Prediction [18.981305003262282]
  We propose OpenCOOD-Air, a novel framework that integrates UAVs as platforms into V2V collaborative perception.<n>To mitigate gradient interference from ground-air domain gaps and data sparsity, we adopt a transfer learning strategy to fine-tune UAV weights.<n>We present the OPV2V-Air benchmark to validate the transition from V2V to Vehicle-to-Vehicle-to-UAV.
  arXiv  Detail & Related papers  (2026-03-14T12:20:19Z)
• DRL-Enabled Trajectory Planing for UAV-Assisted VLC: Optimal Altitude and Reward Design [35.154994099093244]
  Integration of aerial vehicle (UAV) and visible light communication (VLC) technologies has emerged as a promising solution to offer efficient lighting.<n>This letter investigates the three-dimensional trajectory planning in a UAV-assisted VLC system.
  arXiv  Detail & Related papers  (2026-01-30T03:44:14Z)
• When UAV Swarm Meets IRS: Collaborative Secure Communications in Low-altitude Wireless Networks [68.45202147860537]
  Low-altitude wireless networks (LAWNs) provide enhanced coverage, reliability, and throughput for diverse applications.<n>These networks face significant security vulnerabilities from both known and potential unknown eavesdroppers.<n>We propose a novel secure communication framework for LAWNs where the selected UAVs within a swarm function as a virtual antenna array.
  arXiv  Detail & Related papers  (2025-10-25T02:02:14Z)
• UAV Virtual Antenna Array Deployment for Uplink Interference Mitigation in Data Collection Networks [71.23793087286703]
  Unmanned aerial vehicles (UAVs) have gained considerable attention as a platform for establishing aerial wireless networks and communications. This paper explores a novel uplink interference mitigation approach based on the collaborative beamforming (CB) method in multi-UAV network systems.
  arXiv  Detail & Related papers  (2024-12-09T12:56:50Z)
• Movable Antenna-Equipped UAV for Data Collection in Backscatter Sensor Networks: A Deep Reinforcement Learning-based Approach [10.115361454176773]
  Unmanned aerial vehicles (UAVs) enable flexible data collection from remote backscatter devices (BDs) We consider equipping a UAV with a directional movable antenna (MA) with high directivity and flexibility. We develop a deep reinforcement learning (DRL)-based strategy using the azimuth angle and distance between the UAV and each BD to simplify the agent's observation space.
  arXiv  Detail & Related papers  (2024-11-21T09:34:48Z)
• Deep UAV Path Planning with Assured Connectivity in Dense Urban Setting [2.4156037371075088]
  This paper proposes a framework for UAV path planning with assured connectivity (DUPAC) During UAV flight, DUPAC determines the best route from a defined source to the destination in terms of distance and signal quality. The results confirm that DUPAC achieves an autonomous UAV flight path similar to base method with only 2% increment while maintaining an average 9% better connection quality throughout the flight.
  arXiv  Detail & Related papers  (2024-06-21T15:10:25Z)
• UAV-enabled Collaborative Beamforming via Multi-Agent Deep Reinforcement Learning [79.16150966434299]
  We formulate a UAV-enabled collaborative beamforming multi-objective optimization problem (UCBMOP) to maximize the transmission rate of the UVAA and minimize the energy consumption of all UAVs. We use the heterogeneous-agent trust region policy optimization (HATRPO) as the basic framework, and then propose an improved HATRPO algorithm, namely HATRPO-UCB.
  arXiv  Detail & Related papers  (2024-04-11T03:19:22Z)
• UAV Swarm-enabled Collaborative Secure Relay Communications with Time-domain Colluding Eavesdropper [115.56455278813756]
  Unmanned aerial vehicles (UAV) as aerial relays are practically appealing for assisting Internet Things (IoT) network. In this work, we aim to utilize the UAV to assist secure communication between the UAV base station and terminal terminal devices.
  arXiv  Detail & Related papers  (2023-10-03T11:47:01Z)
• Physics-Based Trajectory Design for Cellular-Connected UAV in Rainy Environments Based on Deep Reinforcement Learning [1.0863256257378173]
  This paper proposes a physics-based trajectory design approach for cellular-connected UAVs in rainy environments. A physics-based electromagnetic simulator is utilized to take into account detailed environment information and the impact of rain on radio wave propagation. The proposed approach has demonstrated great potential for UAV trajectory design under rainy weather conditions.
  arXiv  Detail & Related papers  (2023-08-31T06:23:53Z)
• Integrated Sensing, Computation, and Communication for UAV-assisted Federated Edge Learning [52.7230652428711]
  Federated edge learning (FEEL) enables privacy-preserving model training through periodic communication between edge devices and the server. Unmanned Aerial Vehicle (UAV)mounted edge devices are particularly advantageous for FEEL due to their flexibility and mobility in efficient data collection.
  arXiv  Detail & Related papers  (2023-06-05T16:01:33Z)
• Vision-Based UAV Self-Positioning in Low-Altitude Urban Environments [20.69412701553767]
  Unmanned Aerial Vehicles (UAVs) rely on satellite systems for stable positioning. In such situations, vision-based techniques can serve as an alternative, ensuring the self-positioning capability of UAVs. This paper presents a new dataset, DenseUAV, which is the first publicly available dataset designed for the UAV self-positioning task.
  arXiv  Detail & Related papers  (2022-01-23T07:18:55Z)
• Multi-Agent Deep Reinforcement Learning For Optimising Energy Efficiency of Fixed-Wing UAV Cellular Access Points [3.502112118170715]
  We propose a multi-agent deep reinforcement learning approach to optimise the energy efficiency of fixed-wing UAV cellular access points. In our approach, each UAV is equipped with a Dueling Deep Q-Network (DDQN) agent which can adjust the 3D trajectory of the UAV over a series of timesteps.
  arXiv  Detail & Related papers  (2021-11-03T14:49:17Z)
• Integrating LEO Satellites and Multi-UAV Reinforcement Learning for Hybrid FSO/RF Non-Terrestrial Networks [55.776497048509185]
  A mega-constellation of low-altitude earth orbit satellites (SATs) and burgeoning unmanned aerial vehicles (UAVs) are promising enablers for high-speed and long-distance communications in beyond fifth-generation (5G) systems. We investigate the problem of forwarding packets between two faraway ground terminals through SAT and UAV relays using either millimeter-wave (mmWave) radio-frequency (RF) or free-space optical (FSO) link.
  arXiv  Detail & Related papers  (2020-10-20T09:07:10Z)
• Data Freshness and Energy-Efficient UAV Navigation Optimization: A Deep Reinforcement Learning Approach [88.45509934702913]
  We design a navigation policy for multiple unmanned aerial vehicles (UAVs) where mobile base stations (BSs) are deployed. We incorporate different contextual information such as energy and age of information (AoI) constraints to ensure the data freshness at the ground BS. By applying the proposed trained model, an effective real-time trajectory policy for the UAV-BSs captures the observable network states over time.
  arXiv  Detail & Related papers  (2020-02-21T07:29:15Z)
• Federated Learning in the Sky: Joint Power Allocation and Scheduling with UAV Swarms [98.78553146823829]
  Unmanned aerial vehicle (UAV) swarms must exploit machine learning (ML) in order to execute various tasks. In this paper, a novel framework is proposed to implement distributed learning (FL) algorithms within a UAV swarm.
  arXiv  Detail & Related papers  (2020-02-19T14:04:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.