Enhanced Pub/Sub Communications for Massive IoT Traffic with SARSA
Reinforcement Learning
- URL: http://arxiv.org/abs/2101.00687v1
- Date: Sun, 3 Jan 2021 18:46:01 GMT
- Title: Enhanced Pub/Sub Communications for Massive IoT Traffic with SARSA
Reinforcement Learning
- Authors: Carlos E. Arruda, Pedro F. Moraes, Nazim Agoulmine, Joberto S. B.
Martins
- Abstract summary: Cloud, edge and fog computing are potential and competitive strategies for collecting, processing, and distributing IoT data.
This paper addresses the issue of conveying a massive volume of IoT data through a network with limited communications resources.
It uses a cognitive communications resource allocation based on Reinforcement Learning (RL) with SARSA algorithm.
- Score: 0.11470070927586014
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Sensors are being extensively deployed and are expected to expand at
significant rates in the coming years. They typically generate a large volume
of data on the internet of things (IoT) application areas like smart cities,
intelligent traffic systems, smart grid, and e-health. Cloud, edge and fog
computing are potential and competitive strategies for collecting, processing,
and distributing IoT data. However, cloud, edge, and fog-based solutions need
to tackle the distribution of a high volume of IoT data efficiently through
constrained and limited resource network infrastructures. This paper addresses
the issue of conveying a massive volume of IoT data through a network with
limited communications resources (bandwidth) using a cognitive communications
resource allocation based on Reinforcement Learning (RL) with SARSA algorithm.
The proposed network infrastructure (PSIoTRL) uses a Publish/ Subscribe
architecture to access massive and highly distributed IoT data. It is
demonstrated that the PSIoTRL bandwidth allocation for buffer flushing based on
SARSA enhances the IoT aggregator buffer occupation and network link
utilization. The PSIoTRL dynamically adapts the IoT aggregator traffic flushing
according to the Pub/Sub topic's priority and network constraint requirements.
Related papers
- The Internet of Senses: Building on Semantic Communications and Edge
Intelligence [67.75406096878321]
The Internet of Senses (IoS) holds the promise of flawless telepresence-style communication for all human receptors'
We elaborate on how the emerging semantic communications and Artificial Intelligence (AI)/Machine Learning (ML) paradigms may satisfy the requirements of IoS use cases.
arXiv Detail & Related papers (2022-12-21T03:37:38Z) - Efficient Federated Learning with Spike Neural Networks for Traffic Sign
Recognition [70.306089187104]
We introduce powerful Spike Neural Networks (SNNs) into traffic sign recognition for energy-efficient and fast model training.
Numerical results indicate that the proposed federated SNN outperforms traditional federated convolutional neural networks in terms of accuracy, noise immunity, and energy efficiency as well.
arXiv Detail & Related papers (2022-05-28T03:11:48Z) - Machine Learning-Based User Scheduling in Integrated
Satellite-HAPS-Ground Networks [82.58968700765783]
Integrated space-air-ground networks promise to offer a valuable solution space for empowering the sixth generation of communication networks (6G)
This paper showcases the prospects of machine learning in the context of user scheduling in integrated space-air-ground communications.
arXiv Detail & Related papers (2022-05-27T13:09:29Z) - Service Discovery in Social Internet of Things using Graph Neural
Networks [1.552282932199974]
Internet-of-Things (IoT) networks intelligently connect thousands of physical entities to provide various services for the community.
It is witnessing an exponential expansion, which is complicating the process of discovering IoT devices existing in the network and requesting corresponding services from them.
We propose a scalable resource allocation neural model adequate for heterogeneous large-scale IoT networks.
arXiv Detail & Related papers (2022-05-25T12:25:37Z) - A Deep Reinforcement Learning-Based Caching Strategy for IoT Networks
with Transient Data [4.686103742494879]
Transient data generation and limited energy resources are the major bottlenecks of Internet of Things networks.
We propose a DRL-based caching scheme that improves the cache hit rate and reduces energy consumption of the IoT networks.
arXiv Detail & Related papers (2022-03-16T12:41:37Z) - A Practical AoI Scheduler in IoT Networks with Relays [8.361681706210206]
Existing literature on traditional AoI schedulers for two-hop relayed IoT networks are limited.
Deep reinforcement learning (DRL) algorithms have been investigated for AoI scheduling in two-hop IoT networks with relays.
This paper presents a practical AoI scheduler for two-hop IoT networks with relays.
arXiv Detail & Related papers (2022-03-08T17:47:02Z) - Computational Intelligence and Deep Learning for Next-Generation
Edge-Enabled Industrial IoT [51.68933585002123]
We investigate how to deploy computational intelligence and deep learning (DL) in edge-enabled industrial IoT networks.
In this paper, we propose a novel multi-exit-based federated edge learning (ME-FEEL) framework.
In particular, the proposed ME-FEEL can achieve an accuracy gain up to 32.7% in the industrial IoT networks with the severely limited resources.
arXiv Detail & Related papers (2021-10-28T08:14:57Z) - Federated Learning over Wireless IoT Networks with Optimized
Communication and Resources [98.18365881575805]
Federated learning (FL) as a paradigm of collaborative learning techniques has obtained increasing research attention.
It is of interest to investigate fast responding and accurate FL schemes over wireless systems.
We show that the proposed communication-efficient federated learning framework converges at a strong linear rate.
arXiv Detail & Related papers (2021-10-22T13:25:57Z) - Optimizing Resource-Efficiency for Federated Edge Intelligence in IoT
Networks [96.24723959137218]
We study an edge intelligence-based IoT network in which a set of edge servers learn a shared model using federated learning (FL)
We propose a novel framework, called federated edge intelligence (FEI), that allows edge servers to evaluate the required number of data samples according to the energy cost of the IoT network.
We prove that our proposed algorithm does not cause any data leakage nor disclose any topological information of the IoT network.
arXiv Detail & Related papers (2020-11-25T12:51:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.