Intelligent Communication Planning for Constrained Environmental IoT Sensing with Reinforcement Learning

• URL: http://arxiv.org/abs/2308.10124v1
• Date: Sat, 19 Aug 2023 22:59:09 GMT
• Title: Intelligent Communication Planning for Constrained Environmental IoT Sensing with Reinforcement Learning
• Authors: Yi Hu, Jinhang Zuo, Bob Iannucci and Carlee Joe-Wong
• Abstract summary: Internet of Things (IoT) devices are often power-constrained and utilize wireless communication schemes with limited bandwidth. We formulate the communication planning problem of IoT sensors that track the state of the environment. We propose a multi-agent reinforcement learning (MARL) method to find the optimal communication policies for each sensor.
• Score: 19.715387333728152
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Internet of Things (IoT) technologies have enabled numerous data-driven mobile applications and have the potential to significantly improve environmental monitoring and hazard warnings through the deployment of a network of IoT sensors. However, these IoT devices are often power-constrained and utilize wireless communication schemes with limited bandwidth. Such power constraints limit the amount of information each device can share across the network, while bandwidth limitations hinder sensors' coordination of their transmissions. In this work, we formulate the communication planning problem of IoT sensors that track the state of the environment. We seek to optimize sensors' decisions in collecting environmental data under stringent resource constraints. We propose a multi-agent reinforcement learning (MARL) method to find the optimal communication policies for each sensor that maximize the tracking accuracy subject to the power and bandwidth limitations. MARL learns and exploits the spatial-temporal correlation of the environmental data at each sensor's location to reduce the redundant reports from the sensors. Experiments on wildfire spread with LoRA wireless network simulators show that our MARL method can learn to balance the need to collect enough data to predict wildfire spread with unknown bandwidth limitations.

Related papers

• Efficient Unsupervised Domain Adaptation Regression for Spatial-Temporal Air Quality Sensor Fusion [6.963971634605796]
  We propose a novel unsupervised domain adaptation (UDA) method specifically tailored for regression tasks on graph-structured data. We incorporate spatial-temporal graph neural networks (STGNNs) to model the relationships between sensors. Our approach allows low-cost IoT sensors to learn calibration parameters from expensive reference sensors.
  arXiv  Detail & Related papers  (2024-11-11T12:20:57Z)
• ViT LoS V2X: Vision Transformers for Environment-aware LoS Blockage Prediction for 6G Vehicular Networks [20.953587995374168]
  We propose a Deep Learning-based approach that combines Convolutional Neural Networks (CNNs) and customized Vision Transformers (ViTs) Our method capitalizes on the synergistic strengths of CNNs and ViTs to extract features from time-series multimodal data. Our results show that the proposed approach achieves high accuracy and outperforms state-of-the-art solutions, achieving more than $95%$ accurate predictions.
  arXiv  Detail & Related papers  (2024-06-27T01:38:09Z)
• A Plug-in Tiny AI Module for Intelligent and Selective Sensor Data Transmission [10.174575604689391]
  We propose a novel sensing module to equip sensing frameworks with intelligent data transmission capabilities. We integrate a highly efficient machine learning model placed near the sensor. This model provides prompt feedback for the sensing system to transmit only valuable data while discarding irrelevant information.
  arXiv  Detail & Related papers  (2024-02-03T05:41:39Z)
• Effective Intrusion Detection in Heterogeneous Internet-of-Things Networks via Ensemble Knowledge Distillation-based Federated Learning [52.6706505729803]
  We introduce Federated Learning (FL) to collaboratively train a decentralized shared model of Intrusion Detection Systems (IDS) FLEKD enables a more flexible aggregation method than conventional model fusion techniques. Experiment results show that the proposed approach outperforms local training and traditional FL in terms of both speed and performance.
  arXiv  Detail & Related papers  (2024-01-22T14:16:37Z)
• Physical-Layer Semantic-Aware Network for Zero-Shot Wireless Sensing [74.12670841657038]
  Device-free wireless sensing has recently attracted significant interest due to its potential to support a wide range of immersive human-machine interactive applications. Data heterogeneity in wireless signals and data privacy regulation of distributed sensing have been considered as the major challenges that hinder the wide applications of wireless sensing in large area networking systems. We propose a novel zero-shot wireless sensing solution that allows models constructed in one or a limited number of locations to be directly transferred to other locations without any labeled data.
  arXiv  Detail & Related papers  (2023-12-08T13:50:30Z)
• Federated Learning on Edge Sensing Devices: A Review [0.0]
  Federated Learning (FL) is emerging as a solution to privacy, hardware, and connectivity limitations. We focus on the key FL principles, software frameworks, and testbeds. We also explore the current sensor technologies, properties of the sensing devices and sensing applications where FL is utilized.
  arXiv  Detail & Related papers  (2023-11-02T12:55:26Z)
• The Internet of Senses: Building on Semantic Communications and Edge Intelligence [67.75406096878321]
  The Internet of Senses (IoS) holds the promise of flawless telepresence-style communication for all human receptors' We elaborate on how the emerging semantic communications and Artificial Intelligence (AI)/Machine Learning (ML) paradigms may satisfy the requirements of IoS use cases.
  arXiv  Detail & Related papers  (2022-12-21T03:37:38Z)
• A Reinforcement Learning Approach to Sensing Design in Resource-Constrained Wireless Networked Control Systems [0.0]
  We consider a wireless network of smart sensors (agents) that monitor a dynamical process and send measurements to a base station. Smart sensors are equipped with both sensing and computation, and can either send raw measurements or process them prior to transmission. We propose a Reinforcement Learning approach to learn an efficient policy that dynamically decides when measurements are to be processed at each sensor.
  arXiv  Detail & Related papers  (2022-04-01T21:55:11Z)
• Federated Learning over Wireless IoT Networks with Optimized Communication and Resources [98.18365881575805]
  Federated learning (FL) as a paradigm of collaborative learning techniques has obtained increasing research attention. It is of interest to investigate fast responding and accurate FL schemes over wireless systems. We show that the proposed communication-efficient federated learning framework converges at a strong linear rate.
  arXiv  Detail & Related papers  (2021-10-22T13:25:57Z)
• Complex-valued Convolutional Neural Networks for Enhanced Radar Signal Denoising and Interference Mitigation [73.0103413636673]
  We propose the use of Complex-Valued Convolutional Neural Networks (CVCNNs) to address the issue of mutual interference between radar sensors. CVCNNs increase data efficiency, speeds up network training and substantially improves the conservation of phase information during interference removal.
  arXiv  Detail & Related papers  (2021-04-29T10:06:29Z)
• Energy Aware Deep Reinforcement Learning Scheduling for Sensors Correlated in Time and Space [62.39318039798564]
  We propose a scheduling mechanism capable of taking advantage of correlated information. The proposed mechanism is capable of determining the frequency with which sensors should transmit their updates. We show that our solution can significantly extend the sensors' lifetime.
  arXiv  Detail & Related papers  (2020-11-19T09:53:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.