Deep Reinforcement Learning Powered IRS-Assisted Downlink NOMA
- URL: http://arxiv.org/abs/2104.01414v1
- Date: Sat, 3 Apr 2021 14:10:40 GMT
- Title: Deep Reinforcement Learning Powered IRS-Assisted Downlink NOMA
- Authors: Muhammad Shehab, Bekir S. Ciftler, Tamer Khattab, Mohamed Abdallah,
and Daniele Trinchero
- Abstract summary: We show that IRS assisted NOMA based on our DRL scheme achieves the capability high sum rate compared to OMA based one, and as the power increases, the serving more users increases.
- Score: 6.3510536583205255
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this work, we examine an intelligent reflecting surface (IRS) assisted
downlink non-orthogonal multiple access (NOMA) scenario with the aim of
maximizing the sum rate of users. The optimization problem at the IRS is quite
complicated, and non-convex, since it requires the tuning of the phase shift
reflection matrix. Driven by the rising deployment of deep reinforcement
learning (DRL) techniques that are capable of coping with solving non-convex
optimization problems, we employ DRL to predict and optimally tune the IRS
phase shift matrices. Simulation results reveal that IRS assisted NOMA based on
our utilized DRL scheme achieves high sum rate compared to OMA based one, and
as the transmit power increases, the capability of serving more users
increases. Furthermore, results show that imperfect successive interference
cancellation (SIC) has a deleterious impact on the data rate of users
performing SIC. As the imperfection increases by ten times, the rate decreases
by more than 10%.
Related papers
- Joint User Association, Interference Cancellation and Power Control for
Multi-IRS Assisted UAV Communications [80.35959154762381]
Intelligent reflecting surface (IRS)-assisted unmanned aerial vehicle (UAV) communications are expected to alleviate the load of ground base stations in a cost-effective way.
Existing studies mainly focus on the deployment and resource allocation of a single IRS instead of multiple IRSs.
We propose a new optimization algorithm for joint IRS-user association, trajectory optimization of UAVs, successive interference cancellation (SIC) decoding order scheduling and power allocation.
arXiv Detail & Related papers (2023-12-08T01:57:10Z) - Posterior Sampling with Delayed Feedback for Reinforcement Learning with
Linear Function Approximation [62.969796245827006]
Delayed-PSVI is an optimistic value-based algorithm that explores the value function space via noise perturbation with posterior sampling.
We show our algorithm achieves $widetildeO(sqrtd3H3 T + d2H2 E[tau]$ worst-case regret in the presence of unknown delays.
We incorporate a gradient-based approximate sampling scheme via Langevin dynamics for Delayed-LPSVI.
arXiv Detail & Related papers (2023-10-29T06:12:43Z) - Deep Reinforcement Learning-Based Adaptive IRS Control with Limited
Feedback Codebooks [26.312293813063558]
We develop a novel adaptive codebook-based limited feedback protocol to control the intelligent reflecting surfaces (IRS)
We propose two solutions for adaptive IRS codebook design: (i) random adjacency (RA), which utilizes correlations across the channel realizations, and (ii) deep neural network policy-based IRS control (DPIC)
Numerical evaluations show that the data rate and average data rate over one coherence time are improved substantially by the proposed schemes.
arXiv Detail & Related papers (2022-05-07T11:21:19Z) - Collaborative Intelligent Reflecting Surface Networks with Multi-Agent
Reinforcement Learning [63.83425382922157]
Intelligent reflecting surface (IRS) is envisioned to be widely applied in future wireless networks.
In this paper, we investigate a multi-user communication system assisted by cooperative IRS devices with the capability of energy harvesting.
arXiv Detail & Related papers (2022-03-26T20:37:14Z) - On the Robustness of Deep Reinforcement Learning in IRS-Aided Wireless
Communications Systems [31.70191055921352]
We consider an Intelligent Reflecting Surface (IRS)-aided multiple-input single-output (MISO) system for downlink transmission.
We compare the performance of Deep Reinforcement Learning (DRL) and conventional optimization methods in finding optimal phase shifts of the IRS elements.
We demonstrate numerically that DRL solutions show more robustness to noisy channels and user mobility.
arXiv Detail & Related papers (2021-07-17T17:42:25Z) - Optimization-driven Machine Learning for Intelligent Reflecting Surfaces
Assisted Wireless Networks [82.33619654835348]
Intelligent surface (IRS) has been employed to reshape the wireless channels by controlling individual scattering elements' phase shifts.
Due to the large size of scattering elements, the passive beamforming is typically challenged by the high computational complexity.
In this article, we focus on machine learning (ML) approaches for performance in IRS-assisted wireless networks.
arXiv Detail & Related papers (2020-08-29T08:39:43Z) - Optimization-driven Deep Reinforcement Learning for Robust Beamforming
in IRS-assisted Wireless Communications [54.610318402371185]
Intelligent reflecting surface (IRS) is a promising technology to assist downlink information transmissions from a multi-antenna access point (AP) to a receiver.
We minimize the AP's transmit power by a joint optimization of the AP's active beamforming and the IRS's passive beamforming.
We propose a deep reinforcement learning (DRL) approach that can adapt the beamforming strategies from past experiences.
arXiv Detail & Related papers (2020-05-25T01:42:55Z) - Millimeter Wave Communications with an Intelligent Reflector:
Performance Optimization and Distributional Reinforcement Learning [119.97450366894718]
A novel framework is proposed to optimize the downlink multi-user communication of a millimeter wave base station.
A channel estimation approach is developed to measure the channel state information (CSI) in real-time.
A distributional reinforcement learning (DRL) approach is proposed to learn the optimal IR reflection and maximize the expectation of downlink capacity.
arXiv Detail & Related papers (2020-02-24T22:18:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.