Spatio-Temporal Attention Enhanced Multi-Agent DRL for UAV-Assisted Wireless Networks with Limited Communications

• URL: http://arxiv.org/abs/2603.21594v1
• Date: Mon, 23 Mar 2026 05:42:50 GMT
• Title: Spatio-Temporal Attention Enhanced Multi-Agent DRL for UAV-Assisted Wireless Networks with Limited Communications
• Abstract summary: We propose a delay-tolerant multi-agent deep reinforcement learning algorithm that integrates a delay-penalized reward to encourage information sharing among UAVs.<n>We show that our new approach achieves over 50% reduction in information delay and 75% throughput gain compared to the conventional MADRL.<n>It is also effective in reducing the need for UAVs' information exchange and thus fostering practical deployment of MADRL in UAV-assisted wireless networks.
• Score: 73.26813382994867
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we employ multiple UAVs to accelerate data transmissions from ground users (GUs) to a remote base station (BS) via the UAVs' relay communications. The UAVs' intermittent information exchanges typically result in delays in acquiring the complete system state and hinder their effective collaboration. To maximize the overall throughput, we first propose a delay-tolerant multi-agent deep reinforcement learning (MADRL) algorithm that integrates a delay-penalized reward to encourage information sharing among UAVs, while jointly optimizing the UAVs' trajectory planning, network formation, and transmission control strategies. Additionally, considering information loss due to unreliable channel conditions, we further propose a spatio-temporal attention based prediction approach to recover the lost information and enhance each UAV's awareness of the network state. These two designs are envisioned to enhance the network capacity in UAV-assisted wireless networks with limited communications. The simulation results reveal that our new approach achieves over 50\% reduction in information delay and 75% throughput gain compared to the conventional MADRL. Interestingly, it is shown that improving the UAVs' information sharing will not sacrifice the network capacity. Instead, it significantly improves the learning performance and throughput simultaneously. It is also effective in reducing the need for UAVs' information exchange and thus fostering practical deployment of MADRL in UAV-assisted wireless networks.

Related papers

• Digital Twin Enabled Simultaneous Learning and Modeling for UAV-assisted Secure Communications with Eavesdropping Attacks [13.018533875928048]
  This paper focuses on secure communications in UAV-assisted wireless networks.<n>It comprises multiple legitimate UAVs (LE-UAVs) and an intelligent eavesdropping UAV (EA-UAV)<n>We propose a mode-switching scheme that enables LE-UAVs to dynamically switch between the data transmission and jamming modes.
  arXiv  Detail & Related papers  (2026-03-24T03:31:08Z)
• Leveraging Large Vision Model for Multi-UAV Co-perception in Low-Altitude Wireless Networks [51.323657802729535]
  Multi-uncrewed aerial vehicles (UAV) cooperative perception has emerged as a promising paradigm for diverse low-altitude economy applications.<n>This paper proposes a communication-efficient cooperative perception framework, termed Base-Station-Helped UAV (BHU)<n>We employ a Top-K selection mechanism to identify the most informative pixels from UAV-captured RGB images, enabling sparsified visual transmission with reduced data volume and latency.
  arXiv  Detail & Related papers  (2026-03-13T17:49:28Z)
• Age of Information Minimization in UAV-Enabled Integrated Sensing and Communication Systems [34.92822911897626]
  Unmanned aerial vehicles (UAVs) equipped with integrated sensing and communication (ISAC) capabilities are envisioned to play a pivotal role in future wireless networks.<n>We propose Age Information (AoI) system that simultaneously performs target sensing and multi-user communication.
  arXiv  Detail & Related papers  (2025-07-18T18:17:09Z)
• AoI-Sensitive Data Forwarding with Distributed Beamforming in UAV-Assisted IoT [32.6091251316091]
  This paper proposes a UAV-assisted system based on distributed beamforming to enhance age forwarding information (AoI) in Internet of Things (IoT)<n>We propose a deep reinforcement learning (DRL)-based algorithm to solve the problem, thereby enhancing stability and accelerate convergence.
  arXiv  Detail & Related papers  (2025-02-13T07:48:36Z)
• UAV Virtual Antenna Array Deployment for Uplink Interference Mitigation in Data Collection Networks [71.23793087286703]
  Unmanned aerial vehicles (UAVs) have gained considerable attention as a platform for establishing aerial wireless networks and communications.<n>This paper explores a novel uplink interference mitigation approach based on the collaborative beamforming (CB) method in multi-UAV network systems.
  arXiv  Detail & Related papers  (2024-12-09T12:56:50Z)
• Movable Antenna-Equipped UAV for Data Collection in Backscatter Sensor Networks: A Deep Reinforcement Learning-based Approach [10.115361454176773]
  Unmanned aerial vehicles (UAVs) enable flexible data collection from remote backscatter devices (BDs) We consider equipping a UAV with a directional movable antenna (MA) with high directivity and flexibility. We develop a deep reinforcement learning (DRL)-based strategy using the azimuth angle and distance between the UAV and each BD to simplify the agent's observation space.
  arXiv  Detail & Related papers  (2024-11-21T09:34:48Z)
• UAV Swarm-enabled Collaborative Secure Relay Communications with Time-domain Colluding Eavesdropper [115.56455278813756]
  Unmanned aerial vehicles (UAV) as aerial relays are practically appealing for assisting Internet Things (IoT) network. In this work, we aim to utilize the UAV to assist secure communication between the UAV base station and terminal terminal devices.
  arXiv  Detail & Related papers  (2023-10-03T11:47:01Z)
• Federated Learning in UAV-Enhanced Networks: Joint Coverage and Convergence Time Optimization [16.265792031520945]
  Federated learning (FL) involves several devices that collaboratively train a shared model without transferring their local data. FL reduces the communication overhead, making it a promising learning method in UAV-enhanced wireless networks with scarce energy resources. Despite the potential, implementing FL in UAV-enhanced networks is challenging, as conventional UAV placement methods that maximize coverage increase the FL delay.
  arXiv  Detail & Related papers  (2023-08-31T17:50:54Z)
• RIS-assisted UAV Communications for IoT with Wireless Power Transfer Using Deep Reinforcement Learning [75.677197535939]
  We propose a simultaneous wireless power transfer and information transmission scheme for IoT devices with support from unmanned aerial vehicle (UAV) communications. In a first phase, IoT devices harvest energy from the UAV through wireless power transfer; and then in a second phase, the UAV collects data from the IoT devices through information transmission. We formulate a Markov decision process and propose two deep reinforcement learning algorithms to solve the optimization problem of maximizing the total network sum-rate.
  arXiv  Detail & Related papers  (2021-08-05T23:55:44Z)
• 3D UAV Trajectory and Data Collection Optimisation via Deep Reinforcement Learning [75.78929539923749]
  Unmanned aerial vehicles (UAVs) are now beginning to be deployed for enhancing the network performance and coverage in wireless communication. It is challenging to obtain an optimal resource allocation scheme for the UAV-assisted Internet of Things (IoT) In this paper, we design a new UAV-assisted IoT systems relying on the shortest flight path of the UAVs while maximising the amount of data collected from IoT devices.
  arXiv  Detail & Related papers  (2021-06-06T14:08:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.