Related papers: Distributed Multi-Agent Deep Q-Learning for Fast Roaming in IEEE 802.11ax Wi-Fi Systems

Distributed Multi-Agent Deep Q-Learning for Fast Roaming in IEEE 802.11ax Wi-Fi Systems

URL: http://arxiv.org/abs/2304.01210v1
Date: Sat, 25 Mar 2023 04:39:59 GMT
Title: Distributed Multi-Agent Deep Q-Learning for Fast Roaming in IEEE 802.11ax Wi-Fi Systems
Authors: Ting-Hui Wang, Li-Hsiang Shen, Kai-Ten Feng
Abstract summary: Wi-Fi 6, IEEE 802.11ax, was be approved as the next sixth-generation (6G) technology of wireless local area networks (WLANs) In this paper, we propose a multi-agent deep Q-learning for fast roaming (MADAR) algorithm to effectively minimize the latency during the station roaming for Smart Warehouse in Wi-Fi 6 system.
Score: 8.057006406834466
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Abstract: The innovation of Wi-Fi 6, IEEE 802.11ax, was be approved as the next sixth-generation (6G) technology of wireless local area networks (WLANs) by improving the fundamental performance of latency, throughput, and so on. The main technical feature of orthogonal frequency division multiple access (OFDMA) supports multi-users to transmit respective data concurrently via the corresponding access points (APs). However, the conventional IEEE 802.11 protocol for Wi-Fi roaming selects the target AP only depending on received signal strength indication (RSSI) which is obtained by the received Response frame from the APs. In the long term, it may lead to congestion in a single channel under the scenarios of dense users further increasing the association delay and packet drop rate, even reducing the quality of service (QoS) of the overall system. In this paper, we propose a multi-agent deep Q-learning for fast roaming (MADAR) algorithm to effectively minimize the latency during the station roaming for Smart Warehouse in Wi-Fi 6 system. The MADAR algorithm considers not only RSSI but also channel state information (CSI), and through online neural network learning and weighting adjustments to maximize the reward of the action selected from Epsilon-Greedy. Compared to existing benchmark methods, the MADAR algorithm has been demonstrated for improved roaming latency by analyzing the simulation result and realistic dataset.

Related papers

Communication-Efficient Federated Learning by Quantized Variance Reduction for Heterogeneous Wireless Edge Networks [55.467288506826755]
Federated learning (FL) has been recognized as a viable solution for local-privacy-aware collaborative model training in wireless edge networks. Most existing communication-efficient FL algorithms fail to reduce the significant inter-device variance. We propose a novel communication-efficient FL algorithm, named FedQVR, which relies on a sophisticated variance-reduced scheme.
arXiv Detail & Related papers (2025-01-20T04:26:21Z)
Rydberg Atomic Quantum Receivers for Classical Wireless Communications and Sensing: Their Models and Performance [78.76421728334013]
Rydberg atomic quantum receivers (RAQRs) are an eminent solution for detecting the electric field of radio frequency (RF) signals. We introduce the superheterodyne version of RAQRs to the wireless community by presenting an end-to-end reception scheme. We then develop a corresponding equivalent baseband signal model relying on a realistic reception flow.
arXiv Detail & Related papers (2024-12-07T06:25:54Z)
Coordinated Multi-Armed Bandits for Improved Spatial Reuse in Wi-Fi [2.143751226500554]
We explore a coordinated solution based on online learning to drive the optimization of Spatial Reuse (SR) In particular, we focus on a Multi-Agent Multi-Armed Bandit (MA-MAB) setting, where multiple decision-making agents concurrently configure SR parameters from coexisting networks. We demonstrate that AI-native SR enabled by coordinated MABs can improve the network performance over current Wi-Fi operation.
arXiv Detail & Related papers (2024-12-04T06:53:59Z)
Coverage-aware and Reinforcement Learning Using Multi-agent Approach for HD Map QoS in a Realistic Environment [8.853779271331508]
One effective way to optimize the offloading process is by minimizing the transmission time. This is particularly true in a Vehicular Adhoc Network (VANET) where vehicles frequently download and upload High-definition (HD) map data.
arXiv Detail & Related papers (2024-07-19T12:40:07Z)
Deep Learning-Based Synchronization for Uplink NB-IoT [72.86843435313048]
We propose a neural network (NN)-based algorithm for device detection and time of arrival (ToA) estimation for the narrowband physical random-access channel (NPRACH) of narrowband internet of things (NB-IoT) The introduced NN architecture leverages residual convolutional networks as well as knowledge of the preamble structure of the 5G New Radio (5G NR) specifications.
arXiv Detail & Related papers (2022-05-22T12:16:43Z)
INSPIRE: Distributed Bayesian Optimization for ImproviNg SPatIal REuse in Dense WLANs [0.10878040851637999]
IEEE 802.11ax aims at increasing the reuse of a radio channel by allowing the dynamic update of two key parameters in wireless transmission. In this paper, we present INSPIRE, a distributed solution performing local optimizations based on Bayesian processes. In only a few seconds, INSPIRE is able to drastically increase the quality of service of operational spatials by improving their fairness and throughput.
arXiv Detail & Related papers (2022-03-30T14:48:26Z)
Federated Spatial Reuse Optimization in Next-Generation Decentralized IEEE 802.11 WLANs [14.954710245070343]
We explore the feasibility of applying machine learning (ML) in next-generation wireless local area networks (WLANs) More specifically, we focus on the IEEE 802.11ax spatial reuse problem and predict its performance through federated learning (FL) models. The set of FL solutions overviewed in this work is part of the 2021 International Telecommunication Union (ITU) AI for 5G Challenge.
arXiv Detail & Related papers (2022-03-20T06:58:31Z)
IoV Scenario: Implementation of a Bandwidth Aware Algorithm in Wireless Network Communication Mode [49.734868032441625]
This paper proposes a bandwidth aware multi domain virtual network embedding algorithm (BA-VNE) The algorithm is mainly aimed at the problem that users need a lot of bandwidth in wireless communication mode. In order to improve the performance of the algorithm, we introduce particle swarm optimization (PSO) algorithm.
arXiv Detail & Related papers (2022-02-03T03:34:06Z)
Real-Time GPU-Accelerated Machine Learning Based Multiuser Detection for 5G and Beyond [70.81551587109833]
nonlinear beamforming filters can significantly outperform linear approaches in stationary scenarios with massive connectivity. One of the main challenges comes from the real-time implementation of these algorithms. This paper explores the acceleration of APSM-based algorithms through massive parallelization.
arXiv Detail & Related papers (2022-01-13T15:20:45Z)
ML-based Handover Prediction and AP Selection in Cognitive Wi-Fi Networks [9.96238107493626]
Two well-known problems related to device mobility are handover prediction and access point selection. We propose a data-driven machine learning (ML) schemes to efficiently solve these problems in networks. The proposed schemes are evaluated and results are compared with traditional approaches to the aforementioned problems.
arXiv Detail & Related papers (2021-11-27T12:28:09Z)
Data-Driven Random Access Optimization in Multi-Cell IoT Networks with NOMA [78.60275748518589]
Non-orthogonal multiple access (NOMA) is a key technology to enable massive machine type communications (mMTC) in 5G networks and beyond. In this paper, NOMA is applied to improve the random access efficiency in high-density spatially-distributed multi-cell wireless IoT networks. A novel formulation of random channel access management is proposed, in which the transmission probability of each IoT device is tuned to maximize the geometric mean of users' expected capacity.
arXiv Detail & Related papers (2021-01-02T15:21:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.