AoI-minimizing Scheduling in UAV-relayed IoT Networks
- URL: http://arxiv.org/abs/2107.05181v3
- Date: Mon, 19 Jul 2021 12:39:36 GMT
- Title: AoI-minimizing Scheduling in UAV-relayed IoT Networks
- Authors: Biplav Choudhury, Vijay K. Shah, Aidin Ferdowsi, Jeffrey H. Reed, and
Y. Thomas Hou
- Abstract summary: We propose scheduling policies for Age of Information (AoI) minimization in two-hop UAV-relayed IoT networks.
We show that MAF-MAD is the optimal scheduler under ideal conditions, i.e., error-free channels and generate-at-will traffic.
For realistic conditions, we propose a Deep-Q-Networks (DQN) based scheduler.
- Score: 21.070161851029663
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Due to flexibility, autonomy and low operational cost, unmanned aerial
vehicles (UAVs), as fixed aerial base stations, are increasingly being used as
\textit{relays} to collect time-sensitive information (i.e., status updates)
from IoT devices and deliver it to the nearby terrestrial base station (TBS),
where the information gets processed. In order to ensure timely delivery of
information to the TBS (from all IoT devices), optimal scheduling of
time-sensitive information over two hop UAV-relayed IoT networks (i.e., IoT
device to the UAV [hop 1], and UAV to the TBS [hop 2]) becomes a critical
challenge. To address this, we propose scheduling policies for Age of
Information (AoI) minimization in such two-hop UAV-relayed IoT networks. To
this end, we present a low-complexity MAF-MAD scheduler, that employs Maximum
AoI First (MAF) policy for sampling of IoT devices at UAV (hop 1) and Maximum
AoI Difference (MAD) policy for updating sampled packets from UAV to the TBS
(hop 2). We show that MAF-MAD is the optimal scheduler under ideal conditions,
i.e., error-free channels and generate-at-will traffic generation at IoT
devices. On the contrary, for realistic conditions, we propose a
Deep-Q-Networks (DQN) based scheduler. Our simulation results show that
DQN-based scheduler outperforms MAF-MAD scheduler and three other baseline
schedulers, i.e., Maximal AoI First (MAF), Round Robin (RR) and Random,
employed at both hops under general conditions when the network is small (with
10's of IoT devices). However, it does not scale well with network size whereas
MAF-MAD outperforms all other schedulers under all considered scenarios for
larger networks.
Related papers
- Traffic Learning and Proactive UAV Trajectory Planning for Data Uplink
in Markovian IoT Models [6.49537221266081]
In IoT networks, the traditional resource management schemes rely on a message exchange between the devices and the base station.
We present a novel learning-based framework that estimates the traffic arrival of IoT devices based on Markovian events.
We propose a deep reinforcement learning approach to optimize the optimal policy of each UAV.
arXiv Detail & Related papers (2024-01-24T21:57:55Z) - UAV Swarm-enabled Collaborative Secure Relay Communications with
Time-domain Colluding Eavesdropper [115.56455278813756]
Unmanned aerial vehicles (UAV) as aerial relays are practically appealing for assisting Internet Things (IoT) network.
In this work, we aim to utilize the UAV to assist secure communication between the UAV base station and terminal terminal devices.
arXiv Detail & Related papers (2023-10-03T11:47:01Z) - Multi-Objective Optimization for UAV Swarm-Assisted IoT with Virtual
Antenna Arrays [55.736718475856726]
Unmanned aerial vehicle (UAV) network is a promising technology for assisting Internet-of-Things (IoT)
Existing UAV-assisted data harvesting and dissemination schemes require UAVs to frequently fly between the IoTs and access points.
We introduce collaborative beamforming into IoTs and UAVs simultaneously to achieve energy and time-efficient data harvesting and dissemination.
arXiv Detail & Related papers (2023-08-03T02:49:50Z) - AI-based Radio and Computing Resource Allocation and Path Planning in
NOMA NTNs: AoI Minimization under CSI Uncertainty [23.29963717212139]
We develop a hierarchical aerial computing framework composed of high altitude platform (HAP) and unmanned aerial vehicles (UAVs)
It is shown that task scheduling significantly reduces the average AoI.
It is shown that power allocation has a marginal effect on the average AoI compared to using full transmission power for all users.
arXiv Detail & Related papers (2023-05-01T11:52:15Z) - A Learning-Based Trajectory Planning of Multiple UAVs for AoI
Minimization in IoT Networks [13.2742178284328]
textitAge of Information (AoI) is a metric that quantifies information timeliness, i.e., the freshness of the received information or status update.
We formulate an optimization problem to jointly plan the UAVs' trajectory, while minimizing the AoI of the received messages.
The complex optimization problem is efficiently solved using a deep reinforcement learning (DRL) algorithm.
arXiv Detail & Related papers (2022-09-13T12:39:23Z) - A Practical AoI Scheduler in IoT Networks with Relays [8.361681706210206]
Existing literature on traditional AoI schedulers for two-hop relayed IoT networks are limited.
Deep reinforcement learning (DRL) algorithms have been investigated for AoI scheduling in two-hop IoT networks with relays.
This paper presents a practical AoI scheduler for two-hop IoT networks with relays.
arXiv Detail & Related papers (2022-03-08T17:47:02Z) - RIS-assisted UAV Communications for IoT with Wireless Power Transfer
Using Deep Reinforcement Learning [75.677197535939]
We propose a simultaneous wireless power transfer and information transmission scheme for IoT devices with support from unmanned aerial vehicle (UAV) communications.
In a first phase, IoT devices harvest energy from the UAV through wireless power transfer; and then in a second phase, the UAV collects data from the IoT devices through information transmission.
We formulate a Markov decision process and propose two deep reinforcement learning algorithms to solve the optimization problem of maximizing the total network sum-rate.
arXiv Detail & Related papers (2021-08-05T23:55:44Z) - 3D UAV Trajectory and Data Collection Optimisation via Deep
Reinforcement Learning [75.78929539923749]
Unmanned aerial vehicles (UAVs) are now beginning to be deployed for enhancing the network performance and coverage in wireless communication.
It is challenging to obtain an optimal resource allocation scheme for the UAV-assisted Internet of Things (IoT)
In this paper, we design a new UAV-assisted IoT systems relying on the shortest flight path of the UAVs while maximising the amount of data collected from IoT devices.
arXiv Detail & Related papers (2021-06-06T14:08:41Z) - Federated Learning in the Sky: Joint Power Allocation and Scheduling
with UAV Swarms [98.78553146823829]
Unmanned aerial vehicle (UAV) swarms must exploit machine learning (ML) in order to execute various tasks.
In this paper, a novel framework is proposed to implement distributed learning (FL) algorithms within a UAV swarm.
arXiv Detail & Related papers (2020-02-19T14:04:01Z) - Taurus: A Data Plane Architecture for Per-Packet ML [59.1343317736213]
We present the design and implementation of Taurus, a data plane for line-rate inference.
Our evaluation of a Taurus switch ASIC shows that Taurus operates orders of magnitude faster than a server-based control plane.
arXiv Detail & Related papers (2020-02-12T09:18:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.