Secure and Efficient Federated Learning Through Layering and Sharding
Blockchain
- URL: http://arxiv.org/abs/2104.13130v5
- Date: Wed, 31 Jan 2024 05:46:26 GMT
- Title: Secure and Efficient Federated Learning Through Layering and Sharding
Blockchain
- Authors: Shuo Yuan, Bin Cao, Yao Sun, Zhiguo Wan, Mugen Peng
- Abstract summary: This paper proposes ChainFL, a novel two-layer blockchain-driven Federated Learning system.
It splits the Internet network into multiple shards within the subchain layer, effectively reducing the scale of information exchange.
It also employs a Direct Acyclic Graph (DAG)-based mainchain as the mainchain layer, enabling parallel and asynchronous cross-shard validation.
- Score: 15.197940168865271
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Introducing blockchain into Federated Learning (FL) to build a trusted edge
computing environment for transmission and learning has attracted widespread
attention as a new decentralized learning pattern. However, traditional
consensus mechanisms and architectures of blockchain systems face significant
challenges in handling large-scale FL tasks, especially on Internet of Things
(IoT) devices, due to their substantial resource consumption, limited
transaction throughput, and complex communication requirements. To address
these challenges, this paper proposes ChainFL, a novel two-layer
blockchain-driven FL system. It splits the IoT network into multiple shards
within the subchain layer, effectively reducing the scale of information
exchange, and employs a Direct Acyclic Graph (DAG)-based mainchain as the
mainchain layer, enabling parallel and asynchronous cross-shard validation.
Furthermore, the FL procedure is customized to integrate deeply with blockchain
technology, and a modified DAG consensus mechanism is designed to mitigate
distortion caused by abnormal models. To provide a proof-of-concept
implementation and evaluation, multiple subchains based on Hyperledger Fabric
and a self-developed DAG-based mainchain are deployed. Extensive experiments
demonstrate that ChainFL significantly surpasses conventional FL systems,
showing up to a 14% improvement in training efficiency and a threefold increase
in robustness.
Related papers
- Enhancing Trust and Privacy in Distributed Networks: A Comprehensive Survey on Blockchain-based Federated Learning [51.13534069758711]
Decentralized approaches like blockchain offer a compelling solution by implementing a consensus mechanism among multiple entities.
Federated Learning (FL) enables participants to collaboratively train models while safeguarding data privacy.
This paper investigates the synergy between blockchain's security features and FL's privacy-preserving model training capabilities.
arXiv Detail & Related papers (2024-03-28T07:08:26Z) - Graph Attention Network-based Block Propagation with Optimal AoI and Reputation in Web 3.0 [59.94605620983965]
We design a Graph Attention Network (GAT)-based reliable block propagation optimization framework for blockchain-enabled Web 3.0.
To achieve the reliability of block propagation, we introduce a reputation mechanism based on the subjective logic model.
Considering that the GAT possesses the excellent ability to process graph-structured data, we utilize the GAT with reinforcement learning to obtain the optimal block propagation trajectory.
arXiv Detail & Related papers (2024-03-20T01:58:38Z) - Decentralized Federated Unlearning on Blockchain [27.614497435862766]
Federateded Learning (FL) has been gaining traction for ensuring the integrity and traceability of FL processes.
We propose BlockFUL, a generic framework that redesigns the blockchain structure using Chameleon Hash (CH) technology.
We conduct a comprehensive study of two typical unlearning methods, gradient ascent and re-training, demonstrating the efficient unlearning workflow.
arXiv Detail & Related papers (2024-02-26T04:31:53Z) - Generative AI-enabled Blockchain Networks: Fundamentals, Applications,
and Case Study [73.87110604150315]
Generative Artificial Intelligence (GAI) has emerged as a promising solution to address challenges of blockchain technology.
In this paper, we first introduce GAI techniques, outline their applications, and discuss existing solutions for integrating GAI into blockchains.
arXiv Detail & Related papers (2024-01-28T10:46:17Z) - A Blockchain Solution for Collaborative Machine Learning over IoT [0.31410859223862103]
Federated learning (FL) and blockchain technologies have emerged as promising approaches to address these challenges.
We present a novel IoT solution that combines the incremental learning vector quantization algorithm (XuILVQ) with blockchain technology.
Our proposed architecture addresses the shortcomings of existing blockchain-based FL solutions by reducing computational and communication overheads while maintaining data privacy and security.
arXiv Detail & Related papers (2023-11-23T18:06:05Z) - The Implications of Decentralization in Blockchained Federated Learning: Evaluating the Impact of Model Staleness and Inconsistencies [2.6391879803618115]
We study the practical implications of outsourcing the orchestration of federated learning to a democratic setting such as in a blockchain.
Using simulation, we evaluate the blockchained FL operation by applying two different ML models on the well-known MNIST and CIFAR-10 datasets.
Our results show the high impact of model inconsistencies on the accuracy of the models (up to a 35% decrease in prediction accuracy)
arXiv Detail & Related papers (2023-10-11T13:18:23Z) - Federated Learning over Wireless IoT Networks with Optimized
Communication and Resources [98.18365881575805]
Federated learning (FL) as a paradigm of collaborative learning techniques has obtained increasing research attention.
It is of interest to investigate fast responding and accurate FL schemes over wireless systems.
We show that the proposed communication-efficient federated learning framework converges at a strong linear rate.
arXiv Detail & Related papers (2021-10-22T13:25:57Z) - Towards On-Device Federated Learning: A Direct Acyclic Graph-based
Blockchain Approach [2.9202274421296943]
This paper introduces a framework for empowering Federated Learning using Direct Acyclic Graph (DAG)-based blockchain systematically (DAG-FL)
Two algorithms DAG-FL Controlling and DAG-FL Updating are designed running on different nodes to elaborate the operation of DAG-FL consensus mechanism.
arXiv Detail & Related papers (2021-04-27T10:29:38Z) - Deep Multi-Task Learning for Cooperative NOMA: System Design and
Principles [52.79089414630366]
We develop a novel deep cooperative NOMA scheme, drawing upon the recent advances in deep learning (DL)
We develop a novel hybrid-cascaded deep neural network (DNN) architecture such that the entire system can be optimized in a holistic manner.
arXiv Detail & Related papers (2020-07-27T12:38:37Z) - Resource Management for Blockchain-enabled Federated Learning: A Deep
Reinforcement Learning Approach [54.29213445674221]
Federated Learning (BFL) enables mobile devices to collaboratively train neural network models required by a Machine Learning Model Owner (MLMO)
The issue of BFL is that the mobile devices have energy and CPU constraints that may reduce the system lifetime and training efficiency.
We propose to use the Deep Reinforcement Learning (DRL) to derive the optimal decisions for theO.
arXiv Detail & Related papers (2020-04-08T16:29:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.