Secure and Efficient Federated Learning Through Layering and Sharding Blockchain

• URL: http://arxiv.org/abs/2104.13130v5
• Date: Wed, 31 Jan 2024 05:46:26 GMT
• Title: Secure and Efficient Federated Learning Through Layering and Sharding Blockchain
• Authors: Shuo Yuan, Bin Cao, Yao Sun, Zhiguo Wan, Mugen Peng
• Abstract summary: This paper proposes ChainFL, a novel two-layer blockchain-driven Federated Learning system. It splits the Internet network into multiple shards within the subchain layer, effectively reducing the scale of information exchange. It also employs a Direct Acyclic Graph (DAG)-based mainchain as the mainchain layer, enabling parallel and asynchronous cross-shard validation.
• Score: 15.197940168865271
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Introducing blockchain into Federated Learning (FL) to build a trusted edge computing environment for transmission and learning has attracted widespread attention as a new decentralized learning pattern. However, traditional consensus mechanisms and architectures of blockchain systems face significant challenges in handling large-scale FL tasks, especially on Internet of Things (IoT) devices, due to their substantial resource consumption, limited transaction throughput, and complex communication requirements. To address these challenges, this paper proposes ChainFL, a novel two-layer blockchain-driven FL system. It splits the IoT network into multiple shards within the subchain layer, effectively reducing the scale of information exchange, and employs a Direct Acyclic Graph (DAG)-based mainchain as the mainchain layer, enabling parallel and asynchronous cross-shard validation. Furthermore, the FL procedure is customized to integrate deeply with blockchain technology, and a modified DAG consensus mechanism is designed to mitigate distortion caused by abnormal models. To provide a proof-of-concept implementation and evaluation, multiple subchains based on Hyperledger Fabric and a self-developed DAG-based mainchain are deployed. Extensive experiments demonstrate that ChainFL significantly surpasses conventional FL systems, showing up to a 14% improvement in training efficiency and a threefold increase in robustness.

Related papers

• Digital Twin-Assisted Federated Learning with Blockchain in Multi-tier Computing Systems [67.14406100332671]
  In Industry 4.0 systems, resource-constrained edge devices engage in frequent data interactions. This paper proposes a digital twin (DT) and federated digital twin (FL) scheme. The efficacy of our proposed cooperative interference-based FL process has been verified through numerical analysis.
  arXiv  Detail & Related papers  (2024-11-04T17:48:02Z)
• Voltran: Unlocking Trust and Confidentiality in Decentralized Federated Learning Aggregation [12.446757264387564]
  We present Voltran, an innovative hybrid platform designed to achieve trust, confidentiality, and robustness for Federated Learning (FL) We offload the FL aggregation into TEE to provide an isolated, trusted and customizable off-chain execution. We provide strong scalability on multiple FL scenarios by introducing a multi-SGX parallel execution strategy.
  arXiv  Detail & Related papers  (2024-08-13T13:33:35Z)
• Enhancing Trust and Privacy in Distributed Networks: A Comprehensive Survey on Blockchain-based Federated Learning [51.13534069758711]
  Decentralized approaches like blockchain offer a compelling solution by implementing a consensus mechanism among multiple entities. Federated Learning (FL) enables participants to collaboratively train models while safeguarding data privacy. This paper investigates the synergy between blockchain's security features and FL's privacy-preserving model training capabilities.
  arXiv  Detail & Related papers  (2024-03-28T07:08:26Z)
• Graph Attention Network-based Block Propagation with Optimal AoI and Reputation in Web 3.0 [59.94605620983965]
  We design a Graph Attention Network (GAT)-based reliable block propagation optimization framework for blockchain-enabled Web 3.0. To achieve the reliability of block propagation, we introduce a reputation mechanism based on the subjective logic model. Considering that the GAT possesses the excellent ability to process graph-structured data, we utilize the GAT with reinforcement learning to obtain the optimal block propagation trajectory.
  arXiv  Detail & Related papers  (2024-03-20T01:58:38Z)
• BlockFUL: Enabling Unlearning in Blockchained Federated Learning [26.47424619448623]
  Unlearning in Federated Learning (FL) presents significant challenges, as models grow and evolve with complex inheritance relationships. In this paper, we introduce a novel framework with a dual-chain structure comprising a live chain and an archive chain for enabling unlearning capabilities withined FL. Two new unlearning paradigms, i.e., parallel and sequential paradigms, can be effectively implemented through gradient-ascent-based and re-training-based unlearning methods. Our experiments validate that these methods effectively reduce data dependency and operational overhead, thereby boosting the overall performance of unlearning inherited models within BlockFUL.
  arXiv  Detail & Related papers  (2024-02-26T04:31:53Z)
• Generative AI-enabled Blockchain Networks: Fundamentals, Applications, and Case Study [73.87110604150315]
  Generative Artificial Intelligence (GAI) has emerged as a promising solution to address challenges of blockchain technology. In this paper, we first introduce GAI techniques, outline their applications, and discuss existing solutions for integrating GAI into blockchains.
  arXiv  Detail & Related papers  (2024-01-28T10:46:17Z)
• The Implications of Decentralization in Blockchained Federated Learning: Evaluating the Impact of Model Staleness and Inconsistencies [2.6391879803618115]
  We study the practical implications of outsourcing the orchestration of federated learning to a democratic setting such as in a blockchain. Using simulation, we evaluate the blockchained FL operation by applying two different ML models on the well-known MNIST and CIFAR-10 datasets. Our results show the high impact of model inconsistencies on the accuracy of the models (up to a 35% decrease in prediction accuracy)
  arXiv  Detail & Related papers  (2023-10-11T13:18:23Z)
• Federated Learning over Wireless IoT Networks with Optimized Communication and Resources [98.18365881575805]
  Federated learning (FL) as a paradigm of collaborative learning techniques has obtained increasing research attention. It is of interest to investigate fast responding and accurate FL schemes over wireless systems. We show that the proposed communication-efficient federated learning framework converges at a strong linear rate.
  arXiv  Detail & Related papers  (2021-10-22T13:25:57Z)
• Towards On-Device Federated Learning: A Direct Acyclic Graph-based Blockchain Approach [2.9202274421296943]
  This paper introduces a framework for empowering Federated Learning using Direct Acyclic Graph (DAG)-based blockchain systematically (DAG-FL) Two algorithms DAG-FL Controlling and DAG-FL Updating are designed running on different nodes to elaborate the operation of DAG-FL consensus mechanism.
  arXiv  Detail & Related papers  (2021-04-27T10:29:38Z)
• Resource Management for Blockchain-enabled Federated Learning: A Deep Reinforcement Learning Approach [54.29213445674221]
  Federated Learning (BFL) enables mobile devices to collaboratively train neural network models required by a Machine Learning Model Owner (MLMO) The issue of BFL is that the mobile devices have energy and CPU constraints that may reduce the system lifetime and training efficiency. We propose to use the Deep Reinforcement Learning (DRL) to derive the optimal decisions for theO.
  arXiv  Detail & Related papers  (2020-04-08T16:29:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.