Integrating LEO Satellite and UAV Relaying via Reinforcement Learning for Non-Terrestrial Networks

• URL: http://arxiv.org/abs/2005.12521v1
• Date: Tue, 26 May 2020 05:39:27 GMT
• Title: Integrating LEO Satellite and UAV Relaying via Reinforcement Learning for Non-Terrestrial Networks
• Authors: Ju-Hyung Lee, Jihong Park, Mehdi Bennis, and Young-Chai Ko
• Abstract summary: A mega-constellation of low-earth orbit (LEO) satellites has the potential to enable long-range communication with low latency. We study the problem of forwarding packets between two faraway ground terminals, through an LEO satellite selected from an orbiting constellation. To maximize the end-to-end data rate, the satellite association and HAP location should be optimized. We tackle this problem using deep reinforcement learning (DRL) with a novel action dimension reduction technique.
• Score: 51.05735925326235
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A mega-constellation of low-earth orbit (LEO) satellites has the potential to enable long-range communication with low latency. Integrating this with burgeoning unmanned aerial vehicle (UAV) assisted non-terrestrial networks will be a disruptive solution for beyond 5G systems provisioning large scale three-dimensional connectivity. In this article, we study the problem of forwarding packets between two faraway ground terminals, through an LEO satellite selected from an orbiting constellation and a mobile high-altitude platform (HAP) such as a fixed-wing UAV. To maximize the end-to-end data rate, the satellite association and HAP location should be optimized, which is challenging due to a huge number of orbiting satellites and the resulting time-varying network topology. We tackle this problem using deep reinforcement learning (DRL) with a novel action dimension reduction technique. Simulation results corroborate that our proposed method achieves up to 5.74x higher average data rate compared to a direct communication baseline without SAT and HAP.

Related papers

• Collaborative Ground-Space Communications via Evolutionary Multi-objective Deep Reinforcement Learning [113.48727062141764]
  We propose a distributed collaborative beamforming (DCB)-based uplink communication paradigm for enabling ground-space direct communications. DCB treats the terminals that are unable to establish efficient direct connections with the low Earth orbit (LEO) satellites as distributed antennas. We propose an evolutionary multi-objective deep reinforcement learning algorithm to obtain the desirable policies.
  arXiv  Detail & Related papers  (2024-04-11T03:13:02Z)
• Stitching Satellites to the Edge: Pervasive and Efficient Federated LEO Satellite Learning [1.3121410433987561]
  This paper proposes a novel FL-SEC framework that empowers satellites to execute large-scale machine learning (ML) tasks onboard efficiently. Key components include personalized learning via divide-and-conquer, which identifies and eliminates redundant satellite images, and orbital model retraining, which generates an aggregated "orbital model" per orbit and retrains it before sending to the ground station. Our approach dramatically reduces FL convergence time by nearly 30 times, and satellite energy consumption down to as low as 1.38 watts, all while maintaining an exceptional accuracy of up to 96%.
  arXiv  Detail & Related papers  (2024-01-28T02:01:26Z)
• Communication-Efficient Federated Learning for LEO Satellite Networks Integrated with HAPs Using Hybrid NOMA-OFDM [1.3121410433987561]
  This paper proposes NomaFedHAP, a novel FL-SatCom approach tailored to LEO satellites. NomaFedHAP utilizes high-altitude platforms (HAPs) as distributed parameter servers (PS) to enhance satellite visibility. We derive a closed-form expression of the outage probability for satellites in near and far shells, as well as for the entire system.
  arXiv  Detail & Related papers  (2024-01-01T07:07:27Z)
• Federated learning for LEO constellations via inter-HAP links [0.0]
  Low Earth Obit (LEO) satellite constellations have seen a sharp increase of deployment in recent years. To apply machine learning (ML) in such applications, the traditional way of downloading satellite data such as imagery to a ground station (GS) is not desirable. We show that existing FL solutions do not fit well in such LEO constellation scenarios because of significant challenges such as excessive convergence delay and unreliable wireless channels.
  arXiv  Detail & Related papers  (2022-05-15T08:22:52Z)
• Learning Emergent Random Access Protocol for LEO Satellite Networks [51.575090080749554]
  We propose a novel grant-free random access solution for LEO SAT networks, dubbed emergent random access channel protocol (eRACH) eRACH is a model-free approach that emerges through interaction with the non-stationary network environment. Compared to RACH, we show from various simulations that our proposed eRACH yields 54.6% higher average network throughput.
  arXiv  Detail & Related papers  (2021-12-03T07:44:45Z)
• Deep Learning Aided Routing for Space-Air-Ground Integrated Networks Relying on Real Satellite, Flight, and Shipping Data [79.96177511319713]
  Current maritime communications mainly rely on satellites having meager transmission resources, hence suffering from poorer performance than modern terrestrial wireless networks. With the growth of transcontinental air traffic, the promising concept of aeronautical ad hoc networking relying on commercial passenger airplanes is potentially capable of enhancing satellite-based maritime communications via air-to-ground and multi-hop air-to-air links. We propose space-air-ground integrated networks (SAGINs) for supporting ubiquitous maritime communications, where the low-earth-orbit satellite constellations, passenger airplanes, terrestrial base stations, ships, respectively, serve as the space-, air-,
  arXiv  Detail & Related papers  (2021-10-28T14:12:10Z)
• Integrating LEO Satellites and Multi-UAV Reinforcement Learning for Hybrid FSO/RF Non-Terrestrial Networks [55.776497048509185]
  A mega-constellation of low-altitude earth orbit satellites (SATs) and burgeoning unmanned aerial vehicles (UAVs) are promising enablers for high-speed and long-distance communications in beyond fifth-generation (5G) systems. We investigate the problem of forwarding packets between two faraway ground terminals through SAT and UAV relays using either millimeter-wave (mmWave) radio-frequency (RF) or free-space optical (FSO) link.
  arXiv  Detail & Related papers  (2020-10-20T09:07:10Z)
• A Comprehensive Overview on 5G-and-Beyond Networks with UAVs: From Communications to Sensing and Intelligence [152.89360859658296]
  5G networks need to support three typical usage scenarios, namely, enhanced mobile broadband (eMBB), ultra-reliable low-latency communications (URLLC) and massive machine-type communications (mMTC) On the one hand, UAVs can be leveraged as cost-effective aerial platforms to provide ground users with enhanced communication services by exploiting their high cruising altitude and controllable maneuverability in 3D space. On the other hand, providing such communication services simultaneously for both UAV and ground users poses new challenges due to the need for ubiquitous 3D signal coverage as well as the strong air-ground network interference.
  arXiv  Detail & Related papers  (2020-10-19T08:56:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.