Analyzing the Impact of Participant Failures in Cross-Silo Federated Learning

• URL: http://arxiv.org/abs/2511.14456v1
• Date: Tue, 18 Nov 2025 12:59:51 GMT
• Title: Analyzing the Impact of Participant Failures in Cross-Silo Federated Learning
• Authors: Fabian Stricker, David Bermbach, Christian Zirpins,
• Abstract summary: Federated learning (FL) is a new paradigm for training machine learning (ML) models without sharing data.<n>We study the impact of participant failures on the model quality in the context of cross-silo FL with few participants.<n>Our results offer insights for researchers and software architects aiming to build robust FL systems.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Federated learning (FL) is a new paradigm for training machine learning (ML) models without sharing data. While applying FL in cross-silo scenarios, where organizations collaborate, it is necessary that the FL system is reliable; however, participants can fail due to various reasons (e.g., communication issues or misconfigurations). In order to provide a reliable system, it is necessary to analyze the impact of participant failures. While this problem received attention in cross-device FL where mobile devices with limited resources participate, there is comparatively little research in cross-silo FL. Therefore, we conduct an extensive study for analyzing the impact of participant failures on the model quality in the context of inter-organizational cross-silo FL with few participants. In our study, we focus on analyzing generally influential factors such as the impact of the timing and the data as well as the impact on the evaluation, which is important for deciding, if the model should be deployed. We show that under high skews the evaluation is optimistic and hides the real impact. Furthermore, we demonstrate that the timing impacts the quality of the trained model. Our results offer insights for researchers and software architects aiming to build robust FL systems.

Related papers

• Benchmarking Mutual Information-based Loss Functions in Federated Learning [2.79786165508341]
  Federated Learning (FL) has attracted considerable interest due to growing privacy regulations.<n>This paper examines the use of Mutual Information (MI)-based loss functions to address these concerns.
  arXiv  Detail & Related papers  (2025-04-16T08:58:44Z)
• An Empirical Study of the Impact of Federated Learning on Machine Learning Model Accuracy [6.907897341928317]
  Federated Learning (FL) enables distributed ML model training on private user data at the global scale.<n>We investigate, systematically, how this learning paradigm can affect the accuracy of state-of-the-art ML models for a variety of ML tasks.
  arXiv  Detail & Related papers  (2025-03-26T17:52:30Z)
• Feasible Learning [78.6167929413604]
  We introduce Feasible Learning (FL), a sample-centric learning paradigm where models are trained by solving a feasibility problem that bounds the loss for each training sample.<n>Our empirical analysis, spanning image classification, age regression, and preference optimization in large language models, demonstrates that models trained via FL can learn from data while displaying improved tail behavior compared to ERM, with only a marginal impact on average performance.
  arXiv  Detail & Related papers  (2025-01-24T20:39:38Z)
• A Survey on Federated Unlearning: Challenges and Opportunities [32.0365189539138]
  This SoK paper aims to take a deep look at the emphfederated unlearning literature, with the goal of identifying research trends and challenges in this emerging field.
  arXiv  Detail & Related papers  (2024-03-04T19:35:08Z)
• A Survey on Efficient Federated Learning Methods for Foundation Model Training [62.473245910234304]
  Federated Learning (FL) has become an established technique to facilitate privacy-preserving collaborative training across a multitude of clients. In the wake of Foundation Models (FM), the reality is different for many deep learning applications. We discuss the benefits and drawbacks of parameter-efficient fine-tuning (PEFT) for FL applications.
  arXiv  Detail & Related papers  (2024-01-09T10:22:23Z)
• Deep Equilibrium Models Meet Federated Learning [71.57324258813675]
  This study explores the problem of Federated Learning (FL) by utilizing the Deep Equilibrium (DEQ) models instead of conventional deep learning networks. We claim that incorporating DEQ models into the federated learning framework naturally addresses several open problems in FL. To the best of our knowledge, this study is the first to establish a connection between DEQ models and federated learning.
  arXiv  Detail & Related papers  (2023-05-29T22:51:40Z)
• Automated Federated Learning in Mobile Edge Networks -- Fast Adaptation and Convergence [83.58839320635956]
  Federated Learning (FL) can be used in mobile edge networks to train machine learning models in a distributed manner. Recent FL has been interpreted within a Model-Agnostic Meta-Learning (MAML) framework, which brings FL significant advantages in fast adaptation and convergence over heterogeneous datasets. This paper addresses how much benefit MAML brings to FL and how to maximize such benefit over mobile edge networks.
  arXiv  Detail & Related papers  (2023-03-23T02:42:10Z)
• Towards Interpretable Federated Learning [19.764172768506132]
  Federated learning (FL) enables multiple data owners to build machine learning models collaboratively without exposing their private local data. It is important to balance the need for performance, privacy-preservation and interpretability, especially in mission critical applications such as finance and healthcare. We conduct comprehensive analysis of the representative IFL approaches, the commonly adopted performance evaluation metrics, and promising directions towards building versatile IFL techniques.
  arXiv  Detail & Related papers  (2023-02-27T02:06:18Z)
• Time-sensitive Learning for Heterogeneous Federated Edge Intelligence [52.83633954857744]
  We investigate real-time machine learning in a federated edge intelligence (FEI) system. FEI systems exhibit heterogenous communication and computational resource distribution. We propose a time-sensitive federated learning (TS-FL) framework to minimize the overall run-time for collaboratively training a shared ML model.
  arXiv  Detail & Related papers  (2023-01-26T08:13:22Z)
• Mobility-Aware Cluster Federated Learning in Hierarchical Wireless Networks [81.83990083088345]
  We develop a theoretical model to characterize the hierarchical federated learning (HFL) algorithm in wireless networks. Our analysis proves that the learning performance of HFL deteriorates drastically with highly-mobile users. To circumvent these issues, we propose a mobility-aware cluster federated learning (MACFL) algorithm.
  arXiv  Detail & Related papers  (2021-08-20T10:46:58Z)
• Characterizing Impacts of Heterogeneity in Federated Learning upon Large-Scale Smartphone Data [23.67491703843822]
  Federated learning (FL) is an emerging, privacy-preserving machine learning paradigm, drawing tremendous attention in academia and industry. A unique characteristic of FL is heterogeneity, which resides in the various hardware specifications and dynamic states across the participating devices. We conduct extensive experiments to compare the performance of state-of-the-art FL algorithms under Heterogeneous and Heterogeneous-unaware settings.
  arXiv  Detail & Related papers  (2020-06-12T07:49:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.