Efficient Resource Optimization for Split Federated Learning
- URL: http://arxiv.org/abs/2608.17849v1
- Date: Tue, 18 Aug 2026 14:44:46 GMT
- Title: Efficient Resource Optimization for Split Federated Learning
- Abstract summary: Split federated learning (SFL) has emerged as a powerful paradigm for model training at the edge.<n>Prior optimization schemes for SFL are either textitheuristic or textitcomputationally inefficient, which cannot handle large-scale user populations.<n>This work establishes an efficient optimization framework for SFL under resource-constrained networks.
- Score: 13.044538176308023
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Split federated learning (SFL) has emerged as a powerful paradigm for model training at the edge. However, SFL inherently involves discrete decision variables for model splitting and resource allocation, resulting in a challenging mixed-integer problem. Consequently, prior optimization schemes for SFL are either \textit{heuristic} or \textit{computationally inefficient}, which cannot handle large-scale user populations. To address this limitation, this work establishes an efficient optimization framework for SFL under resource-constrained networks. Our framework jointly optimizes model splitting and resource allocation to minimize training cost, which is defined as the weighted sum of latency and energy costs. We first study the model splitting problem and develop a polynomial-time algorithm that achieves the global optimum. Then, we extend the approach to the joint model splitting and resource allocation problem. In this case, we formulate it as a two-dimensional master problem and develop an efficient approximation method with a $(1+ε)$-approximation guarantee. Extensive experiments show that the proposed approach provides efficient solutions to strike the optimal energy--latency tradeoff.
Related papers
- ASFL: An Adaptive Model Splitting and Resource Allocation Framework for Split Federated Learning [19.973768722251393]
We propose an adaptive split federated learning (ASFL) framework over wireless networks.<n>ASFL exploits the computation resources of the central server to train part of the model and enables adaptive model splitting.<n>We show that our proposed ASFL framework converges faster and reduces the total delay and energy consumption by up to 75% and 80%, respectively.
arXiv Detail & Related papers (2026-02-19T05:46:13Z) - Device Association and Resource Allocation for Hierarchical Split Federated Learning in Space-Air-Ground Integrated Network [12.484890461669828]
6G facilitates deployment of Federated Learning (FL) in the Space-Air-Ground Integrated Network (SAGIN)<n>This paper proposes a Hierarchical Split Federated Learning framework and derives its upper bound of loss function.<n>We decompose the original problem into several subproblems, where an iterative optimization algorithm for device association and resource allocation is proposed.
arXiv Detail & Related papers (2026-01-20T10:24:10Z) - Don't Be Greedy, Just Relax! Pruning LLMs via Frank-Wolfe [61.68406997155879]
State-of-the-art Large Language Model (LLM) pruning methods operate layer-wise, minimizing the per-layer pruning error on a small dataset to avoid full retraining.<n>Existing methods hence rely on greedy convexs that ignore the weight interactions in the pruning objective.<n>Our method drastically reduces the per-layer pruning error, outperforms strong baselines on state-of-the-art GPT architectures, and remains memory-efficient.
arXiv Detail & Related papers (2025-10-15T16:13:44Z) - Efficient Split Federated Learning for Large Language Models over Communication Networks [45.02252893286613]
Fine-tuning pre-trained large language models (LLMs) in a distributed manner poses significant challenges on resource-constrained edge networks.<n>We propose SflLLM, a novel framework that integrates split federated learning with parameter-efficient fine-tuning techniques.<n>By leveraging model splitting and low-rank adaptation (LoRA), SflLLM reduces the computational burden on edge devices.
arXiv Detail & Related papers (2025-04-20T16:16:54Z) - Over-the-Air Fair Federated Learning via Multi-Objective Optimization [52.295563400314094]
We propose an over-the-air fair federated learning algorithm (OTA-FFL) to train fair FL models.<n>Experiments demonstrate the superiority of OTA-FFL in achieving fairness and robust performance.
arXiv Detail & Related papers (2025-01-06T21:16:51Z) - Adaptive Decentralized Federated Learning in Energy and Latency Constrained Wireless Networks [4.03161352925235]
In Federated Learning (FL), with parameter aggregated by a central node, the communication overhead is a substantial concern.
Recent studies have introduced Decentralized Federated Learning (DFL) as a viable alternative.
We formulate a problem that minimizes the loss function of DFL while considering energy and latency constraints.
arXiv Detail & Related papers (2024-03-29T09:17:40Z) - ESFL: Efficient Split Federated Learning over Resource-Constrained Heterogeneous Wireless Devices [22.664980594996155]
Federated learning (FL) allows multiple parties (distributed devices) to train a machine learning model without sharing raw data.
We propose an efficient split federated learning algorithm (ESFL) to take full advantage of the powerful computing capabilities at a central server.
arXiv Detail & Related papers (2024-02-24T20:50:29Z) - Client Orchestration and Cost-Efficient Joint Optimization for
NOMA-Enabled Hierarchical Federated Learning [55.49099125128281]
We propose a non-orthogonal multiple access (NOMA) enabled HFL system under semi-synchronous cloud model aggregation.
We show that the proposed scheme outperforms the considered benchmarks regarding HFL performance improvement and total cost reduction.
arXiv Detail & Related papers (2023-11-03T13:34:44Z) - Predictive GAN-powered Multi-Objective Optimization for Hybrid Federated
Split Learning [56.125720497163684]
We propose a hybrid federated split learning framework in wireless networks.
We design a parallel computing scheme for model splitting without label sharing, and theoretically analyze the influence of the delayed gradient caused by the scheme on the convergence speed.
arXiv Detail & Related papers (2022-09-02T10:29:56Z) - Resource Allocation via Model-Free Deep Learning in Free Space Optical
Communications [119.81868223344173]
The paper investigates the general problem of resource allocation for mitigating channel fading effects in Free Space Optical (FSO) communications.
Under this framework, we propose two algorithms that solve FSO resource allocation problems.
arXiv Detail & Related papers (2020-07-27T17:38:51Z) - Combining Deep Learning and Optimization for Security-Constrained
Optimal Power Flow [94.24763814458686]
Security-constrained optimal power flow (SCOPF) is fundamental in power systems.
Modeling of APR within the SCOPF problem results in complex large-scale mixed-integer programs.
This paper proposes a novel approach that combines deep learning and robust optimization techniques.
arXiv Detail & Related papers (2020-07-14T12:38:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.