Energy-Efficient Cellular-Connected UAV Swarm Control Optimization
- URL: http://arxiv.org/abs/2303.10398v1
- Date: Sat, 18 Mar 2023 11:42:04 GMT
- Title: Energy-Efficient Cellular-Connected UAV Swarm Control Optimization
- Authors: Yang Su, Hui Zhou, Yansha Deng and Mischa Dohler
- Abstract summary: We propose a two-phase command and control (C&C) transmission scheme in a cellular-connected UAV swarm network.
We formulate the problem as a Constrained Markov Decision Process to find the optimal policy.
Our algorithm could maximize the number of UAVs that successfully receive the common C&C under energy constraints.
- Score: 25.299881367750487
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Cellular-connected unmanned aerial vehicle (UAV) swarm is a promising
solution for diverse applications, including cargo delivery and traffic
control. However, it is still challenging to communicate with and control the
UAV swarm with high reliability, low latency, and high energy efficiency. In
this paper, we propose a two-phase command and control (C&C) transmission
scheme in a cellular-connected UAV swarm network, where the ground base station
(GBS) broadcasts the common C&C message in Phase I. In Phase II, the UAVs that
have successfully decoded the C&C message will relay the message to the rest of
UAVs via device-to-device (D2D) communications in either broadcast or unicast
mode, under latency and energy constraints. To maximize the number of UAVs that
receive the message successfully within the latency and energy constraints, we
formulate the problem as a Constrained Markov Decision Process to find the
optimal policy. To address this problem, we propose a decentralized constrained
graph attention multi-agent Deep-Q-network (DCGA-MADQN) algorithm based on
Lagrangian primal-dual policy optimization, where a PID-controller algorithm is
utilized to update the Lagrange Multiplier. Simulation results show that our
algorithm could maximize the number of UAVs that successfully receive the
common C&C under energy constraints.
Related papers
- Covert Multicast in UAV-Enabled Wireless Communication Systems With One-hop and Two-hop Strategies [8.702721247072429]
We study the time of covert multicast in a wireless communication system facilitated by Unmanned Aerial Vehicle (UAV)
We propose one (OH) particle swarm (PSO) based algorithm and an exhaustive framework for performance modeling for the transmission scheme and TH scheme, respectively.
The efficiency of the proposed PSO-based algorithm is substantiated through extensive numerical results.
arXiv Detail & Related papers (2024-10-16T06:46:30Z) - UAV-enabled Collaborative Beamforming via Multi-Agent Deep Reinforcement Learning [79.16150966434299]
We formulate a UAV-enabled collaborative beamforming multi-objective optimization problem (UCBMOP) to maximize the transmission rate of the UVAA and minimize the energy consumption of all UAVs.
We use the heterogeneous-agent trust region policy optimization (HATRPO) as the basic framework, and then propose an improved HATRPO algorithm, namely HATRPO-UCB.
arXiv Detail & Related papers (2024-04-11T03:19:22Z) - UAV Swarm-enabled Collaborative Secure Relay Communications with
Time-domain Colluding Eavesdropper [115.56455278813756]
Unmanned aerial vehicles (UAV) as aerial relays are practically appealing for assisting Internet Things (IoT) network.
In this work, we aim to utilize the UAV to assist secure communication between the UAV base station and terminal terminal devices.
arXiv Detail & Related papers (2023-10-03T11:47:01Z) - Multi-Objective Optimization for UAV Swarm-Assisted IoT with Virtual
Antenna Arrays [55.736718475856726]
Unmanned aerial vehicle (UAV) network is a promising technology for assisting Internet-of-Things (IoT)
Existing UAV-assisted data harvesting and dissemination schemes require UAVs to frequently fly between the IoTs and access points.
We introduce collaborative beamforming into IoTs and UAVs simultaneously to achieve energy and time-efficient data harvesting and dissemination.
arXiv Detail & Related papers (2023-08-03T02:49:50Z) - AI-based Radio and Computing Resource Allocation and Path Planning in
NOMA NTNs: AoI Minimization under CSI Uncertainty [23.29963717212139]
We develop a hierarchical aerial computing framework composed of high altitude platform (HAP) and unmanned aerial vehicles (UAVs)
It is shown that task scheduling significantly reduces the average AoI.
It is shown that power allocation has a marginal effect on the average AoI compared to using full transmission power for all users.
arXiv Detail & Related papers (2023-05-01T11:52:15Z) - Optimization for Master-UAV-powered Auxiliary-Aerial-IRS-assisted IoT
Networks: An Option-based Multi-agent Hierarchical Deep Reinforcement
Learning Approach [56.84948632954274]
This paper investigates a master unmanned aerial vehicle (MUAV)-powered Internet of Things (IoT) network.
We propose using a rechargeable auxiliary UAV (AUAV) equipped with an intelligent reflecting surface (IRS) to enhance the communication signals from the MUAV.
Under the proposed model, we investigate the optimal collaboration strategy of these energy-limited UAVs to maximize the accumulated throughput of the IoT network.
arXiv Detail & Related papers (2021-12-20T15:45:28Z) - RIS-assisted UAV Communications for IoT with Wireless Power Transfer
Using Deep Reinforcement Learning [75.677197535939]
We propose a simultaneous wireless power transfer and information transmission scheme for IoT devices with support from unmanned aerial vehicle (UAV) communications.
In a first phase, IoT devices harvest energy from the UAV through wireless power transfer; and then in a second phase, the UAV collects data from the IoT devices through information transmission.
We formulate a Markov decision process and propose two deep reinforcement learning algorithms to solve the optimization problem of maximizing the total network sum-rate.
arXiv Detail & Related papers (2021-08-05T23:55:44Z) - Federated Learning in the Sky: Joint Power Allocation and Scheduling
with UAV Swarms [98.78553146823829]
Unmanned aerial vehicle (UAV) swarms must exploit machine learning (ML) in order to execute various tasks.
In this paper, a novel framework is proposed to implement distributed learning (FL) algorithms within a UAV swarm.
arXiv Detail & Related papers (2020-02-19T14:04:01Z) - Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV
based Random Access IoT Networks with NOMA [20.160827428161898]
We apply the Non-Orthogonal Multiple Access technique to improve massive channel access of a wireless IoT network where solar-powered Unmanned Aerial Vehicles (UAVs) relay data from IoT devices to remote servers.
IoT devices contend for accessing the shared wireless channel using an adaptive $p$-persistent slotted Aloha protocol; and the solar-powered UAVs adopt Successive Interference Cancellation (SIC) to decode multiple received data from IoT devices to improve access efficiency.
arXiv Detail & Related papers (2020-01-31T22:05:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.