Personalized Federated Learning for Statistical Heterogeneity

• URL: http://arxiv.org/abs/2402.10254v1
• Date: Wed, 7 Feb 2024 12:28:52 GMT
• Title: Personalized Federated Learning for Statistical Heterogeneity
• Authors: Muhammad Firdaus and Kyung-Hyune Rhee
• Abstract summary: The popularity of federated learning (FL) is on the rise, along with growing concerns about data privacy in artificial intelligence applications. This paper offers a brief summary of the current research progress in the field of personalized federated learning (PFL)
• Score: 0.021756081703276
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: The popularity of federated learning (FL) is on the rise, along with growing concerns about data privacy in artificial intelligence applications. FL facilitates collaborative multi-party model learning while simultaneously ensuring the preservation of data confidentiality. Nevertheless, the problem of statistical heterogeneity caused by the presence of diverse client data distributions gives rise to certain challenges, such as inadequate personalization and slow convergence. In order to address the above issues, this paper offers a brief summary of the current research progress in the field of personalized federated learning (PFL). It outlines the PFL concept, examines related techniques, and highlights current endeavors. Furthermore, this paper also discusses potential further research and obstacles associated with PFL.

Related papers

• Federated Large Language Models: Current Progress and Future Directions [63.68614548512534]
  This paper surveys Federated learning for LLMs (FedLLM), highlighting recent advances and future directions. We focus on two key aspects: fine-tuning and prompt learning in a federated setting, discussing existing work and associated research challenges.
  arXiv  Detail & Related papers  (2024-09-24T04:14:33Z)
• Privacy in Federated Learning [0.0]
  Federated Learning (FL) represents a significant advancement in distributed machine learning. This chapter delves into the core privacy concerns within FL, including the risks of data reconstruction, model inversion attacks, and membership inference. It examines the trade-offs between model accuracy and privacy, emphasizing the importance of balancing these factors in practical implementations.
  arXiv  Detail & Related papers  (2024-08-12T18:41:58Z)
• Accuracy-Privacy Trade-off in the Mitigation of Membership Inference Attack in Federated Learning [4.152322723065285]
  federated learning (FL) has emerged as a prominent method in machine learning, emphasizing privacy preservation by allowing multiple clients to collaboratively build a model while keeping their training data private. Despite this focus on privacy, FL models are susceptible to various attacks, including membership inference attacks (MIAs)
  arXiv  Detail & Related papers  (2024-07-26T22:44:41Z)
• Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey [67.48187503803847]
  Vertical Federated Learning (VFL) is a privacy-preserving distributed learning paradigm. Recent research has shown promising results addressing various challenges in VFL. This survey offers a systematic overview of recent developments.
  arXiv  Detail & Related papers  (2024-05-25T16:05:06Z)
• SoK: Challenges and Opportunities in Federated Unlearning [32.0365189539138]
  This SoK paper aims to take a deep look at the emphfederated unlearning literature, with the goal of identifying research trends and challenges in this emerging field.
  arXiv  Detail & Related papers  (2024-03-04T19:35:08Z)
• Personalized Federated Learning with Attention-based Client Selection [57.71009302168411]
  We propose FedACS, a new PFL algorithm with an Attention-based Client Selection mechanism. FedACS integrates an attention mechanism to enhance collaboration among clients with similar data distributions. Experiments on CIFAR10 and FMNIST validate FedACS's superiority.
  arXiv  Detail & Related papers  (2023-12-23T03:31:46Z)
• A Survey of Federated Unlearning: A Taxonomy, Challenges and Future Directions [71.16718184611673]
  The evolution of privacy-preserving Federated Learning (FL) has led to an increasing demand for implementing the right to be forgotten. The implementation of selective forgetting is particularly challenging in FL due to its decentralized nature. Federated Unlearning (FU) emerges as a strategic solution to address the increasing need for data privacy.
  arXiv  Detail & Related papers  (2023-10-30T01:34:33Z)
• Heterogeneous Federated Learning: State-of-the-art and Research Challenges [117.77132819796105]
  Heterogeneous Federated Learning (HFL) is much more challenging and corresponding solutions are diverse and complex. New advances in HFL are reviewed and a new taxonomy of existing HFL methods is proposed. Several critical and promising future research directions in HFL are discussed.
  arXiv  Detail & Related papers  (2023-07-20T06:32:14Z)
• Towards Interpretable Federated Learning [19.764172768506132]
  Federated learning (FL) enables multiple data owners to build machine learning models collaboratively without exposing their private local data. It is important to balance the need for performance, privacy-preservation and interpretability, especially in mission critical applications such as finance and healthcare. We conduct comprehensive analysis of the representative IFL approaches, the commonly adopted performance evaluation metrics, and promising directions towards building versatile IFL techniques.
  arXiv  Detail & Related papers  (2023-02-27T02:06:18Z)
• Towards Federated Long-Tailed Learning [76.50892783088702]
  Data privacy and class imbalance are the norm rather than the exception in many machine learning tasks. Recent attempts have been launched to, on one side, address the problem of learning from pervasive private data, and on the other side, learn from long-tailed data. This paper focuses on learning with long-tailed (LT) data distributions under the context of the popular privacy-preserved federated learning (FL) framework.
  arXiv  Detail & Related papers  (2022-06-30T02:34:22Z)
• Towards Personalized Federated Learning [20.586573091790665]
  We present a unique taxonomy dividing PFL techniques into data-based and model-based approaches. We highlight their key ideas, and envision promising future trajectories of research towards new PFL architectural design.
  arXiv  Detail & Related papers  (2021-03-01T02:45:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.