Adaptive Federated Learning and Digital Twin for Industrial Internet of Things

• URL: http://arxiv.org/abs/2010.13058v2
• Date: Sun, 1 Nov 2020 02:53:35 GMT
• Title: Adaptive Federated Learning and Digital Twin for Industrial Internet of Things
• Authors: Wen Sun, Shiyu Lei, Lu Wang, Zhiqiang Liu, and Yan Zhang
• Abstract summary: Industrial Internet of Things (IoT) enables distributed intelligent services varying with the dynamic and realtime industrial devices to achieve Industry 4.0 benefits. We consider a new architecture of digital twin empowered Industrial IoT where digital twins capture the characteristics of industrial devices to assist federated learning. Noticing that digital twins may bring estimation deviations from the actual value of device state, a trusted based aggregation is proposed in federated learning to alleviate the effects of such deviation.
• Score: 15.102870055701123
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Industrial Internet of Things (IoT) enables distributed intelligent services varying with the dynamic and realtime industrial devices to achieve Industry 4.0 benefits. In this paper, we consider a new architecture of digital twin empowered Industrial IoT where digital twins capture the characteristics of industrial devices to assist federated learning. Noticing that digital twins may bring estimation deviations from the actual value of device state, a trusted based aggregation is proposed in federated learning to alleviate the effects of such deviation. We adaptively adjust the aggregation frequency of federated learning based on Lyapunov dynamic deficit queue and deep reinforcement learning, to improve the learning performance under the resource constraints. To further adapt to the heterogeneity of Industrial IoT, a clustering-based asynchronous federated learning framework is proposed. Numerical results show that the proposed framework is superior to the benchmark in terms of learning accuracy, convergence, and energy saving.

Related papers

• Satisfaction-Aware Incentive Scheme for Federated Learning in Industrial Metaverse: DRL-Based Stackbelberg Game Approach [52.79672516203574]
  Industrial Metaverse uses federated learning and meta-computing to train models in a distributed manner while ensuring data privacy. This paper designs a satisfaction function that accounts for data size, Age of Information (AoI), and training latency. The satisfaction function is incorporated into the utility functions to incentivize node participation in model training.
  arXiv  Detail & Related papers  (2025-02-10T03:33:36Z)
• Denoising and Adaptive Online Vertical Federated Learning for Sequential Multi-Sensor Data in Industrial Internet of Things [22.208830538149606]
  This study focuses on an industrial assembly line scenario where multiple sensors sequentially collect real-time data. We propose the Denoising and Adaptive Online Vertical Federated Learning (DAO-VFL) algorithm.
  arXiv  Detail & Related papers  (2025-01-03T08:22:15Z)
• Sustainable Diffusion-based Incentive Mechanism for Generative AI-driven Digital Twins in Industrial Cyber-Physical Systems [65.22300383287904]
  Industrial Cyber-Physical Systems (ICPSs) are an integral component of modern manufacturing and industries. By digitizing data throughout product life cycles, Digital Twins (DTs) in ICPSs enable a shift from current industrial infrastructures to intelligent and adaptive infrastructures. GenAI can drive the construction and update of DTs to improve predictive accuracy and prepare for diverse smart manufacturing.
  arXiv  Detail & Related papers  (2024-08-02T10:47:10Z)
• Augmenting the FedProx Algorithm by Minimizing Convergence [0.0]
  We present a novel approach called G Federated Proximity. Our results indicate a significant increase in the throughput of approximately 90% better convergence compared to existing model performance.
  arXiv  Detail & Related papers  (2024-06-02T14:01:55Z)
• Effective Intrusion Detection in Heterogeneous Internet-of-Things Networks via Ensemble Knowledge Distillation-based Federated Learning [52.6706505729803]
  We introduce Federated Learning (FL) to collaboratively train a decentralized shared model of Intrusion Detection Systems (IDS) FLEKD enables a more flexible aggregation method than conventional model fusion techniques. Experiment results show that the proposed approach outperforms local training and traditional FL in terms of both speed and performance.
  arXiv  Detail & Related papers  (2024-01-22T14:16:37Z)
• Give and Take: Federated Transfer Learning for Industrial IoT Network Intrusion Detection [3.7498611358320733]
  We propose a federated transfer learning (FTL) approach to perform IIoT network intrusion detection. As part of the research, we also propose a combinational neural network as the centerpiece for performing FTL. Results showcase high performance for the FTL setup between iterations on both the IIoT clients and the server.
  arXiv  Detail & Related papers  (2023-10-11T10:11:54Z)
• HFedMS: Heterogeneous Federated Learning with Memorable Data Semantics in Industrial Metaverse [49.1501082763252]
  This paper presents HFEDMS for incorporating practical FL into the emerging Industrial Metaverse. It reduces data heterogeneity through dynamic grouping and training mode conversion. Then, it compensates for the forgotten knowledge by fusing compressed historical data semantics. Experiments have been conducted on the streamed non-i.i.d. FEMNIST dataset using 368 simulated devices.
  arXiv  Detail & Related papers  (2022-11-07T04:33:24Z)
• Data Heterogeneity-Robust Federated Learning via Group Client Selection in Industrial IoT [57.67687126339891]
  FedGS is a hierarchical cloud-edge-end FL framework for 5G empowered industries. Taking advantage of naturally clustered factory devices, FedGS uses a gradient-based binary permutation algorithm. Experiments show that FedGS improves accuracy by 3.5% and reduces training rounds by 59% on average.
  arXiv  Detail & Related papers  (2022-02-03T10:48:17Z)
• Computational Intelligence and Deep Learning for Next-Generation Edge-Enabled Industrial IoT [51.68933585002123]
  We investigate how to deploy computational intelligence and deep learning (DL) in edge-enabled industrial IoT networks. In this paper, we propose a novel multi-exit-based federated edge learning (ME-FEEL) framework. In particular, the proposed ME-FEEL can achieve an accuracy gain up to 32.7% in the industrial IoT networks with the severely limited resources.
  arXiv  Detail & Related papers  (2021-10-28T08:14:57Z)
• Distributed Learning for Time-varying Networks: A Scalable Design [13.657740129012804]
  We propose a distributed learning framework based on a scalable deep neural network (DNN) design. By exploiting the permutation equivalence and invariance properties of the learning tasks, the DNNs with different scales for different clients can be built up. Model aggregation can also be conducted based on these two sub-matrices to improve the learning convergence and performance.
  arXiv  Detail & Related papers  (2021-07-31T12:44:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.