RL-IoT: Towards IoT Interoperability via Reinforcement Learning

• URL: http://arxiv.org/abs/2105.00884v1
• Date: Mon, 3 May 2021 14:09:03 GMT
• Title: RL-IoT: Towards IoT Interoperability via Reinforcement Learning
• Authors: Giulia Milan, Luca Vassio, Idilio Drago, Marco Mellia
• Abstract summary: We propose RL-IoT -- a system that explores how to interact with possibly unknown IoT devices. We leverage reinforcement learning to understand the semantics of protocol messages and to control the device to reach a given goal. With properly tuned parameters, RL-IoT learns how to perform actions with the target device, completing non-trivial patterns with as few as 400 interactions.
• Score: 3.939866872704532
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Our life is getting filled by Internet of Things (IoT) devices. These devices often rely on closed or poorly documented protocols, with unknown formats and semantics. Learning how to interact with such devices in an autonomous manner is key for interoperability and automatic verification of their capabilities. In this paper, we propose RL-IoT -- a system that explores how to automatically interact with possibly unknown IoT devices. We leverage reinforcement learning (RL) to understand the semantics of protocol messages and to control the device to reach a given goal, while minimizing the number of interactions. We assume only to know a database of possible IoT protocol messages, whose semantics are however unknown. RL-IoT exchanges messages with the target IoT device, learning those commands that are useful to reach the given goal. Our results show that RL-IoT is able to solve simple and complex tasks. With properly tuned parameters, RL-IoT learns how to perform actions with the target device, a Yeelight smart bulb for our case study, completing non-trivial patterns with as few as 400 interactions. RL-IoT opens the opportunity to use RL to automatically explore how to interact with IoT protocols with limited information, and paving the road for interoperable systems.

Related papers

• Agentic Search Engine for Real-Time IoT Data [1.9275428660922078]
  The Internet of Things (IoT) has enabled diverse devices to communicate over the Internet, yet the fragmentation of IoT systems limits seamless data sharing and coordinated management. This paper presents the IoT Agentic Search Engine (IoT-ASE), a real-time search engine tailored for IoT environments.
  arXiv  Detail & Related papers  (2025-03-15T20:46:17Z)
• Leveraging Foundation Models for Zero-Shot IoT Sensing [5.319176383069102]
  Deep learning models are increasingly deployed on edge Internet of Things (IoT) devices. ZSL aims to classify data of unseen classes with the help of semantic information. In this work, we align the IoT data embeddings with the semantic embeddings generated by an FM's text encoder for zero-shot IoT sensing.
  arXiv  Detail & Related papers  (2024-07-29T11:16:48Z)
• IoT-LM: Large Multisensory Language Models for the Internet of Things [70.74131118309967]
  IoT ecosystem provides rich source of real-world modalities such as motion, thermal, geolocation, imaging, depth, sensors, and audio. Machine learning presents a rich opportunity to automatically process IoT data at scale. We introduce IoT-LM, an open-source large multisensory language model tailored for the IoT ecosystem.
  arXiv  Detail & Related papers  (2024-07-13T08:20:37Z)
• Device Scheduling and Assignment in Hierarchical Federated Learning for Internet of Things [20.09415156099031]
  This paper proposes an improved K-Center algorithm for device scheduling and introduces a deep reinforcement learning-based approach for assigning IoT devices to edge servers. Experiments show that scheduling 50% of IoT devices is generally adequate for achieving convergence in HFL with much lower time delay and energy consumption.
  arXiv  Detail & Related papers  (2024-02-04T14:42:13Z)
• Effective Intrusion Detection in Heterogeneous Internet-of-Things Networks via Ensemble Knowledge Distillation-based Federated Learning [52.6706505729803]
  We introduce Federated Learning (FL) to collaboratively train a decentralized shared model of Intrusion Detection Systems (IDS) FLEKD enables a more flexible aggregation method than conventional model fusion techniques. Experiment results show that the proposed approach outperforms local training and traditional FL in terms of both speed and performance.
  arXiv  Detail & Related papers  (2024-01-22T14:16:37Z)
• Empowering Private Tutoring by Chaining Large Language Models [87.76985829144834]
  This work explores the development of a full-fledged intelligent tutoring system powered by state-of-the-art large language models (LLMs) The system is into three inter-connected core processes-interaction, reflection, and reaction. Each process is implemented by chaining LLM-powered tools along with dynamically updated memory modules.
  arXiv  Detail & Related papers  (2023-09-15T02:42:03Z)
• Harris Hawks Feature Selection in Distributed Machine Learning for Secure IoT Environments [8.690178186919635]
  Internet of Things (IoT) applications can collect and transfer sensitive data. It is necessary to develop new methods to detect hacked IoT devices. This paper proposes a Feature Selection (FS) model based on Harris Hawks Optimization (HHO) and Random Weight Network (RWN) to detect IoT botnet attacks.
  arXiv  Detail & Related papers  (2023-02-20T09:38:12Z)
• The Internet of Senses: Building on Semantic Communications and Edge Intelligence [67.75406096878321]
  The Internet of Senses (IoS) holds the promise of flawless telepresence-style communication for all human receptors' We elaborate on how the emerging semantic communications and Artificial Intelligence (AI)/Machine Learning (ML) paradigms may satisfy the requirements of IoS use cases.
  arXiv  Detail & Related papers  (2022-12-21T03:37:38Z)
• Federated Learning for Internet of Things: A Federated Learning Framework for On-device Anomaly Data Detection [10.232121085973782]
  We build a FedIoT platform that contains a synthesized dataset using N-BaIoT, FedDetect algorithm, and a system design for IoT devices. In a network of realistic IoT devices (PI), we evaluate FedIoT platform and FedDetect algorithm in both model and system performance.
  arXiv  Detail & Related papers  (2021-06-15T08:53:42Z)
• PsiPhi-Learning: Reinforcement Learning with Demonstrations using Successor Features and Inverse Temporal Difference Learning [102.36450942613091]
  We propose an inverse reinforcement learning algorithm, called emphinverse temporal difference learning (ITD) We show how to seamlessly integrate ITD with learning from online environment interactions, arriving at a novel algorithm for reinforcement learning with demonstrations, called $Psi Phi$-learning.
  arXiv  Detail & Related papers  (2021-02-24T21:12:09Z)
• Machine learning and data analytics for the IoT [8.39035688352917]
  We review how IoT-generated data are processed for machine learning analysis. We propose a framework to enable IoT applications to adaptively learn from other IoT applications.
  arXiv  Detail & Related papers  (2020-06-30T07:38:31Z)
• Wireless Communications for Collaborative Federated Learning [160.82696473996566]
  Internet of Things (IoT) devices may not be able to transmit their collected data to a central controller for training machine learning models. Google's seminal FL algorithm requires all devices to be directly connected with a central controller. This paper introduces a novel FL framework, called collaborative FL (CFL), which enables edge devices to implement FL with less reliance on a central controller.
  arXiv  Detail & Related papers  (2020-06-03T20:00:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.