User Assignment and Resource Allocation for Hierarchical Federated
Learning over Wireless Networks
- URL: http://arxiv.org/abs/2309.09253v1
- Date: Sun, 17 Sep 2023 12:10:39 GMT
- Title: User Assignment and Resource Allocation for Hierarchical Federated
Learning over Wireless Networks
- Authors: Tinghao Zhang, Kwok-Yan Lam, Jun Zhao
- Abstract summary: Hierarchical FL (HFL) can reduce energy consumption and latency through effective resource allocation and appropriate user assignment.
This article proposes a spectrum resource optimization algorithm (SROA) and a two-stage CPU algorithm (TSIA) for HFL.
Experimental results demonstrate the superiority of the proposed HFL framework over existing studies in energy and latency reduction.
- Score: 20.09415156099031
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The large population of wireless users is a key driver of data-crowdsourced
Machine Learning (ML). However, data privacy remains a significant concern.
Federated Learning (FL) encourages data sharing in ML without requiring data to
leave users' devices but imposes heavy computation and communications overheads
on mobile devices. Hierarchical FL (HFL) alleviates this problem by performing
partial model aggregation at edge servers. HFL can effectively reduce energy
consumption and latency through effective resource allocation and appropriate
user assignment. Nevertheless, resource allocation in HFL involves optimizing
multiple variables, and the objective function should consider both energy
consumption and latency, making the development of resource allocation
algorithms very complicated. Moreover, it is challenging to perform user
assignment, which is a combinatorial optimization problem in a large search
space. This article proposes a spectrum resource optimization algorithm (SROA)
and a two-stage iterative algorithm (TSIA) for HFL. Given an arbitrary user
assignment pattern, SROA optimizes CPU frequency, transmit power, and bandwidth
to minimize system cost. TSIA aims to find a user assignment pattern that
considerably reduces the total system cost. Experimental results demonstrate
the superiority of the proposed HFL framework over existing studies in energy
and latency reduction.
Related papers
- Model Partition and Resource Allocation for Split Learning in Vehicular Edge Networks [24.85135243655983]
This paper proposes a novel U-shaped split federated learning (U-SFL) framework to address these challenges.
U-SFL is able to enhance privacy protection by keeping both raw data and labels on the vehicular user (VU) side.
To optimize communication efficiency, we introduce a semantic-aware auto-encoder (SAE) that significantly reduces the dimensionality of transmitted data.
arXiv Detail & Related papers (2024-11-11T07:59:13Z) - Client Orchestration and Cost-Efficient Joint Optimization for
NOMA-Enabled Hierarchical Federated Learning [55.49099125128281]
We propose a non-orthogonal multiple access (NOMA) enabled HFL system under semi-synchronous cloud model aggregation.
We show that the proposed scheme outperforms the considered benchmarks regarding HFL performance improvement and total cost reduction.
arXiv Detail & Related papers (2023-11-03T13:34:44Z) - Wirelessly Powered Federated Learning Networks: Joint Power Transfer,
Data Sensing, Model Training, and Resource Allocation [24.077525032187893]
Federated learning (FL) has found many successes in wireless networks.
implementation of FL has been hindered by the energy limitation of mobile devices (MDs) and the availability of training data at MDs.
How to integrate wireless power transfer and sustainable sustainable FL networks.
arXiv Detail & Related papers (2023-08-09T13:38:58Z) - Analysis and Optimization of Wireless Federated Learning with Data
Heterogeneity [72.85248553787538]
This paper focuses on performance analysis and optimization for wireless FL, considering data heterogeneity, combined with wireless resource allocation.
We formulate the loss function minimization problem, under constraints on long-term energy consumption and latency, and jointly optimize client scheduling, resource allocation, and the number of local training epochs (CRE)
Experiments on real-world datasets demonstrate that the proposed algorithm outperforms other benchmarks in terms of the learning accuracy and energy consumption.
arXiv Detail & Related papers (2023-08-04T04:18:01Z) - Adaptive Federated Pruning in Hierarchical Wireless Networks [69.6417645730093]
Federated Learning (FL) is a privacy-preserving distributed learning framework where a server aggregates models updated by multiple devices without accessing their private datasets.
In this paper, we introduce model pruning for HFL in wireless networks to reduce the neural network scale.
We show that our proposed HFL with model pruning achieves similar learning accuracy compared with the HFL without model pruning and reduces about 50 percent communication cost.
arXiv Detail & Related papers (2023-05-15T22:04:49Z) - Federated Learning for Energy-limited Wireless Networks: A Partial Model
Aggregation Approach [79.59560136273917]
limited communication resources, bandwidth and energy, and data heterogeneity across devices are main bottlenecks for federated learning (FL)
We first devise a novel FL framework with partial model aggregation (PMA)
The proposed PMA-FL improves 2.72% and 11.6% accuracy on two typical heterogeneous datasets.
arXiv Detail & Related papers (2022-04-20T19:09:52Z) - Federated Learning over Wireless IoT Networks with Optimized
Communication and Resources [98.18365881575805]
Federated learning (FL) as a paradigm of collaborative learning techniques has obtained increasing research attention.
It is of interest to investigate fast responding and accurate FL schemes over wireless systems.
We show that the proposed communication-efficient federated learning framework converges at a strong linear rate.
arXiv Detail & Related papers (2021-10-22T13:25:57Z) - Deep Reinforcement Learning Based Multidimensional Resource Management
for Energy Harvesting Cognitive NOMA Communications [64.1076645382049]
Combination of energy harvesting (EH), cognitive radio (CR), and non-orthogonal multiple access (NOMA) is a promising solution to improve energy efficiency.
In this paper, we study the spectrum, energy, and time resource management for deterministic-CR-NOMA IoT systems.
arXiv Detail & Related papers (2021-09-17T08:55:48Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.