Towards Personalized Federated Learning

• URL: http://arxiv.org/abs/2103.00710v1
• Date: Mon, 1 Mar 2021 02:45:19 GMT
• Title: Towards Personalized Federated Learning
• Authors: Alysa Ziying Tan, Han Yu, Lizhen Cui, Qiang Yang
• Abstract summary: We present a unique taxonomy dividing PFL techniques into data-based and model-based approaches. We highlight their key ideas, and envision promising future trajectories of research towards new PFL architectural design.
• Score: 20.586573091790665
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: As artificial intelligence (AI)-empowered applications become widespread, there is growing awareness and concern for user privacy and data confidentiality. This has contributed to the popularity of federated learning (FL). FL applications often face data distribution and device capability heterogeneity across data owners. This has stimulated the rapid development of Personalized FL (PFL). In this paper, we complement existing surveys, which largely focus on the methods and applications of FL, with a review of recent advances in PFL. We discuss hurdles to PFL under the current FL settings, and present a unique taxonomy dividing PFL techniques into data-based and model-based approaches. We highlight their key ideas, and envision promising future trajectories of research towards new PFL architectural design, realistic PFL benchmarking, and trustworthy PFL approaches.

Related papers

• FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusion [48.90879664138855]
  One-shot Federated Learning (OFL) significantly reduces communication costs in FL by aggregating trained models only once. However, the performance of advanced OFL methods is far behind the normal FL. We propose a novel learning approach to endow OFL with superb performance and low communication and storage costs, termed as FuseFL.
  arXiv  Detail & Related papers  (2024-10-27T09:07:10Z)
• A Survey on Efficient Federated Learning Methods for Foundation Model Training [62.473245910234304]
  Federated Learning (FL) has become an established technique to facilitate privacy-preserving collaborative training across a multitude of clients. In the wake of Foundation Models (FM), the reality is different for many deep learning applications. We discuss the benefits and drawbacks of parameter-efficient fine-tuning (PEFT) for FL applications.
  arXiv  Detail & Related papers  (2024-01-09T10:22:23Z)
• PFLlib: Personalized Federated Learning Algorithm Library [27.954706790789434]
  PFLlib is a comprehensive pFL algorithm library with an integrated evaluation platform. We implement 34 state-of-the-art FL algorithms, including 7 classic tFL algorithms and 27 pFL algorithms. PFLlib has already gained 850 stars and 199 forks on GitHub.
  arXiv  Detail & Related papers  (2023-12-08T12:03:08Z)
• PFL-GAN: When Client Heterogeneity Meets Generative Models in Personalized Federated Learning [55.930403371398114]
  We propose a novel generative adversarial network (GAN) sharing and aggregation strategy for personalized learning (PFL) PFL-GAN addresses the client heterogeneity in different scenarios. More specially, we first learn the similarity among clients and then develop an weighted collaborative data aggregation. The empirical results through the rigorous experimentation on several well-known datasets demonstrate the effectiveness of PFL-GAN.
  arXiv  Detail & Related papers  (2023-08-23T22:38:35Z)
• GPFL: Simultaneously Learning Global and Personalized Feature Information for Personalized Federated Learning [32.884949308979465]
  We propose a new pFL method, named GPFL, to simultaneously learn global and personalized feature information on each client. GPFL mitigates overfitting and outperforms the baselines by up to 8.99% in accuracy.
  arXiv  Detail & Related papers  (2023-08-20T14:25:31Z)
• Decentralized Federated Learning: A Survey and Perspective [45.81975053649379]
  Decentralized FL (DFL) is a decentralized network architecture that eliminates the need for a central server. DFL enables direct communication between clients, resulting in significant savings in communication resources.
  arXiv  Detail & Related papers  (2023-06-02T15:12:58Z)
• Bayesian Federated Learning: A Survey [54.40136267717288]
  Federated learning (FL) demonstrates its advantages in integrating distributed infrastructure, communication, computing and learning in a privacy-preserving manner. The robustness and capabilities of existing FL methods are challenged by limited and dynamic data and conditions. BFL has emerged as a promising approach to address these issues.
  arXiv  Detail & Related papers  (2023-04-26T03:41:17Z)
• Vertical Federated Learning: A Structured Literature Review [0.0]
  Federated learning (FL) has emerged as a promising distributed learning paradigm with an added advantage of data privacy. In this paper, we present a structured literature review discussing the state-of-the-art approaches in VFL.
  arXiv  Detail & Related papers  (2022-12-01T16:16:41Z)
• pFL-Bench: A Comprehensive Benchmark for Personalized Federated Learning [42.819532536636835]
  We propose the first comprehensive pFL benchmark, pFL-Bench, for rapid, reproducible, standardized and thorough pFL evaluation. The proposed benchmark contains more than 10 datasets in diverse application domains with unified data partition and realistic heterogeneous settings. We highlight the benefits and potential of state-of-the-art pFL methods and hope pFL-Bench enables further pFL research and broad applications.
  arXiv  Detail & Related papers  (2022-06-08T02:51:59Z)
• Achieving Personalized Federated Learning with Sparse Local Models [75.76854544460981]
  Federated learning (FL) is vulnerable to heterogeneously distributed data. To counter this issue, personalized FL (PFL) was proposed to produce dedicated local models for each individual user. Existing PFL solutions either demonstrate unsatisfactory generalization towards different model architectures or cost enormous extra computation and memory. We proposeFedSpa, a novel PFL scheme that employs personalized sparse masks to customize sparse local models on the edge.
  arXiv  Detail & Related papers  (2022-01-27T08:43:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.