The Cost of Local and Global Fairness in Federated Learning

• URL: http://arxiv.org/abs/2503.22762v1
• Date: Thu, 27 Mar 2025 18:37:54 GMT
• Title: The Cost of Local and Global Fairness in Federated Learning
• Authors: Yuying Duan, Gelei Xu, Yiyu Shi, Michael Lemmon,
• Abstract summary: Two concepts of fairness are important in Federated Learning (FL)<n>This paper proposes a framework that investigates the minimum accuracy lost for enforcing a specified level of global and local fairness in multi-class FL settings.
• Score: 4.088196820932921
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: With the emerging application of Federated Learning (FL) in finance, hiring and healthcare, FL models are regulated to be fair, preventing disparities with respect to legally protected attributes such as race or gender. Two concepts of fairness are important in FL: global and local fairness. Global fairness addresses the disparity across the entire population and local fairness is concerned with the disparity within each client. Prior fair FL frameworks have improved either global or local fairness without considering both. Furthermore, while the majority of studies on fair FL focuses on binary settings, many real-world applications are multi-class problems. This paper proposes a framework that investigates the minimum accuracy lost for enforcing a specified level of global and local fairness in multi-class FL settings. Our framework leads to a simple post-processing algorithm that derives fair outcome predictors from the Bayesian optimal score functions. Experimental results show that our algorithm outperforms the current state of the art (SOTA) with regard to the accuracy-fairness tradoffs, computational and communication costs. Codes are available at: https://github.com/papersubmission678/The-cost-of-local-and-global-fairness-in-FL .

Related papers

• LoGoFair: Post-Processing for Local and Global Fairness in Federated Learning [20.12470856622916]
  This paper proposes a novel post-processing framework for achieving both Local and Global Fairness in the FL context, namely LoGoFair.<n> Experimental results on three real-world datasets further illustrate the effectiveness of the proposed LoGoFair framework.
  arXiv  Detail & Related papers  (2025-03-21T15:33:09Z)
• WassFFed: Wasserstein Fair Federated Learning [31.135784690264888]
  Federated Learning (FL) employs a training approach to address scenarios where users' data cannot be shared across clients. We propose a Wasserstein Fair Federated Learning framework, namely WassFFed.
  arXiv  Detail & Related papers  (2024-11-11T11:26:22Z)
• Can We Theoretically Quantify the Impacts of Local Updates on the Generalization Performance of Federated Learning? [50.03434441234569]
  Federated Learning (FL) has gained significant popularity due to its effectiveness in training machine learning models across diverse sites without requiring direct data sharing. While various algorithms have shown that FL with local updates is a communication-efficient distributed learning framework, the generalization performance of FL with local updates has received comparatively less attention.
  arXiv  Detail & Related papers  (2024-09-05T19:00:18Z)
• Locally Estimated Global Perturbations are Better than Local Perturbations for Federated Sharpness-aware Minimization [81.32266996009575]
  In federated learning (FL), the multi-step update and data heterogeneity among clients often lead to a loss landscape with sharper minima. We propose FedLESAM, a novel algorithm that locally estimates the direction of global perturbation on client side.
  arXiv  Detail & Related papers  (2024-05-29T08:46:21Z)
• Post-Fair Federated Learning: Achieving Group and Community Fairness in Federated Learning via Post-processing [2.361519691494246]
  Two notions of fairness have emerged as important issues for federated learning: group fairness and community fairness. This paper proposes and analyzes a post-processing fair federated learning framework called post-FFL.
  arXiv  Detail & Related papers  (2024-05-28T03:26:00Z)
• Rethinking Client Drift in Federated Learning: A Logit Perspective [125.35844582366441]
  Federated Learning (FL) enables multiple clients to collaboratively learn in a distributed way, allowing for privacy protection. We find that the difference in logits between the local and global models increases as the model is continuously updated. We propose a new algorithm, named FedCSD, a Class prototype Similarity Distillation in a federated framework to align the local and global models.
  arXiv  Detail & Related papers  (2023-08-20T04:41:01Z)
• Demystifying Local and Global Fairness Trade-offs in Federated Learning Using Partial Information Decomposition [7.918307236588161]
  This work presents an information-theoretic perspective to group fairness trade-offs in federated learning (FL) We identify three sources of unfairness in FL, namely, $textitUnique Disparity$, $textitRedundant Disparity$, and $textitMasked Disparity$. We derive fundamental limits on the trade-off between global and local fairness, highlighting where they agree or disagree.
  arXiv  Detail & Related papers  (2023-07-21T03:41:55Z)
• Understanding How Consistency Works in Federated Learning via Stage-wise Relaxed Initialization [84.42306265220274]
  Federated learning (FL) is a distributed paradigm that coordinates massive local clients to collaboratively train a global model. Previous works have implicitly studied that FL suffers from the client-drift'' problem, which is caused by the inconsistent optimum across local clients. To alleviate the negative impact of the client drift'' and explore its substance in FL, we first design an efficient FL algorithm textitFedInit.
  arXiv  Detail & Related papers  (2023-06-09T06:55:15Z)
• How Robust is Your Fairness? Evaluating and Sustaining Fairness under Unseen Distribution Shifts [107.72786199113183]
  We propose a novel fairness learning method termed CUrvature MAtching (CUMA) CUMA achieves robust fairness generalizable to unseen domains with unknown distributional shifts. We evaluate our method on three popular fairness datasets.
  arXiv  Detail & Related papers  (2022-07-04T02:37:50Z)
• Proportional Fairness in Federated Learning [27.086313029073683]
  PropFair is a novel and easy-to-implement algorithm for finding proportionally fair solutions in federated learning. We demonstrate that PropFair can approximately find PF solutions, and it achieves a good balance between the average performances of all clients and of the worst 10% clients.
  arXiv  Detail & Related papers  (2022-02-03T16:28:04Z)
• Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning [61.488646649045215]
  Federated learning (FL) is a promising strategy for performing privacy-preserving, distributed learning with a network of clients (i.e., edge devices)
  arXiv  Detail & Related papers  (2021-11-28T19:03:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.