Reinforcement Learning-based Wavefront Sensorless Adaptive Optics Approaches for Satellite-to-Ground Laser Communication

• URL: http://arxiv.org/abs/2303.07516v1
• Date: Mon, 13 Mar 2023 23:03:17 GMT
• Title: Reinforcement Learning-based Wavefront Sensorless Adaptive Optics Approaches for Satellite-to-Ground Laser Communication
• Authors: Payam Parvizi, Runnan Zou, Colin Bellinger, Ross Cheriton and Davide Spinello
• Abstract summary: Optical satellite-to-ground communication (OSGC) has the potential to improve access to fast and affordable Internet in remote regions. Traditional adaptive optics (AO) systems use a wavefront sensor to improve fiber coupling. We propose the use of reinforcement learning (RL) to reduce the latency, size and cost of the system by up to $30-40%$ by learning a control policy through interactions with a low-cost quadrant photodiode rather than a wavefront phase profiling camera.
• Score: 1.8531813733282103
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Optical satellite-to-ground communication (OSGC) has the potential to improve access to fast and affordable Internet in remote regions. Atmospheric turbulence, however, distorts the optical beam, eroding the data rate potential when coupling into single-mode fibers. Traditional adaptive optics (AO) systems use a wavefront sensor to improve fiber coupling. This leads to higher system size, cost and complexity, consumes a fraction of the incident beam and introduces latency, making OSGC for internet service impractical. We propose the use of reinforcement learning (RL) to reduce the latency, size and cost of the system by up to $30-40\%$ by learning a control policy through interactions with a low-cost quadrant photodiode rather than a wavefront phase profiling camera. We develop and share an AO RL environment that provides a standardized platform to develop and evaluate RL based on the Strehl ratio, which is correlated to fiber-coupling performance. Our empirical analysis finds that Proximal Policy Optimization (PPO) outperforms Soft-Actor-Critic and Deep Deterministic Policy Gradient. PPO converges to within $86\%$ of the maximum reward obtained by an idealized Shack-Hartmann sensor after training of 250 episodes, indicating the potential of RL to enable efficient wavefront sensorless OSGC.

Related papers

• OpticGAI: Generative AI-aided Deep Reinforcement Learning for Optical Networks Optimization [21.282153851021796]
  We introduce OpticGAI, the AI-generated policy design paradigm for optical networks. In detail, it is implemented as a novel DRL framework that utilizes generative models to learn the optimal policy network. We show that OpticGAI achieves the highest reward and the lowest blocking rate of both RWA and RMSA problems.
  arXiv  Detail & Related papers  (2024-06-22T17:59:50Z)
• Design Optimization of NOMA Aided Multi-STAR-RIS for Indoor Environments: A Convex Approximation Imitated Reinforcement Learning Approach [51.63921041249406]
  Sixth-generation (6G) networks leverage simultaneously transmitting and reflecting reconfigurable intelligent surfaces (STAR-RISs) to overcome the limitations of traditional RISs. deploying STAR-RISs indoors presents challenges in interference mitigation, power consumption, and real-time configuration. A novel network architecture utilizing multiple access points (APs) and STAR-RISs is proposed for indoor communication.
  arXiv  Detail & Related papers  (2024-06-19T07:17:04Z)
• The Security Analysis of Continuous-Variable Quantum Key Distribution under Limited Eavesdropping with Practical Fiber [26.001773854548933]
  We investigate how the fiber loss influences the eavesdropping ability based on a teleportation-based collective attack model. We find that if the distributed entanglement is limited due to the practical loss, the optimal attack occurs when the two teleportation stations are merged to one.
  arXiv  Detail & Related papers  (2023-12-23T12:17:18Z)
• DRL Enabled Coverage and Capacity Optimization in STAR-RIS Assisted Networks [55.0821435415241]
  A new paradigm in wireless communications, how to analyze the coverage and capacity performance of STAR-RISs becomes essential but challenging. To solve the coverage and capacity optimization problem in STAR-RIS assisted networks, a multi-objective policy optimization (MO-PPO) algorithm is proposed. In order to improve the performance of the MO-PPO algorithm, two update strategies, i.e., action-value-based update strategy (AVUS) and loss function-based update strategy (LFUS) are investigated.
  arXiv  Detail & Related papers  (2022-09-01T14:54:36Z)
• Single-Shot Optical Neural Network [55.41644538483948]
  'Weight-stationary' analog optical and electronic hardware has been proposed to reduce the compute resources required by deep neural networks. We present a scalable, single-shot-per-layer weight-stationary optical processor.
  arXiv  Detail & Related papers  (2022-05-18T17:49:49Z)
• The self-learning AI controller for adaptive power beaming with fiber-array laser transmitter system [0.0]
  We consider adaptive power beaming with fiber-array laser transmitter system in presence of atmospheric turbulence. In this study an optimal control is synthesized by a deep neural network (DNN) using target-plane PVA sensor data as its input.
  arXiv  Detail & Related papers  (2022-04-08T16:24:49Z)
• Analysis of satellite-to-ground quantum key distribution with adaptive optics [0.0]
  Future quantum communication infrastructures will rely on both terrestrial and space-based links. We study the role of adaptive optics (AO) in this optimization.
  arXiv  Detail & Related papers  (2021-11-12T14:47:23Z)
• Neural Architecture Search for Efficient Uncalibrated Deep Photometric Stereo [105.05232615226602]
  We leverage differentiable neural architecture search (NAS) strategy to find uncalibrated PS architecture automatically. Experiments on the DiLiGenT dataset show that the automatically searched neural architectures performance compares favorably with the state-of-the-art uncalibrated PS methods.
  arXiv  Detail & Related papers  (2021-10-11T21:22:17Z)
• Optimal design and performance evaluation of free-space Quantum Key Distribution systems [0.0]
  We present a model of the performance of a free-space ground-to-ground quantum key distribution (QKD) system based on the efficient-BB84 protocol with active decoy states. We find that the channel fluctuation statistics must be considered to correctly estimate the effect of the saturation rate of the single-photon detectors.
  arXiv  Detail & Related papers  (2021-09-28T17:28:31Z)
• Meta-Reinforcement Learning for Trajectory Design in Wireless UAV Networks [151.65541208130995]
  A drone base station (DBS) is dispatched to provide uplink connectivity to ground users whose demand is dynamic and unpredictable. In this case, the DBS's trajectory must be adaptively adjusted to satisfy the dynamic user access requests. A meta-learning algorithm is proposed in order to adapt the DBS's trajectory when it encounters novel environments.
  arXiv  Detail & Related papers  (2020-05-25T20:43:59Z)
• Optimization-driven Deep Reinforcement Learning for Robust Beamforming in IRS-assisted Wireless Communications [54.610318402371185]
  Intelligent reflecting surface (IRS) is a promising technology to assist downlink information transmissions from a multi-antenna access point (AP) to a receiver. We minimize the AP's transmit power by a joint optimization of the AP's active beamforming and the IRS's passive beamforming. We propose a deep reinforcement learning (DRL) approach that can adapt the beamforming strategies from past experiences.
  arXiv  Detail & Related papers  (2020-05-25T01:42:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.