A Survey on Federated Unlearning: Challenges, Methods, and Future Directions

• URL: http://arxiv.org/abs/2310.20448v4
• Date: Tue, 16 Jul 2024 06:29:20 GMT
• Title: A Survey on Federated Unlearning: Challenges, Methods, and Future Directions
• Authors: Ziyao Liu, Yu Jiang, Jiyuan Shen, Minyi Peng, Kwok-Yan Lam, Xingliang Yuan, Xiaoning Liu,
• Abstract summary: In recent years, the notion of the right to be forgotten" (RTBF) has become a crucial aspect of data privacy for digital trust and AI safety. Machine unlearning (MU) has gained considerable attention which allows an ML model to selectively eliminate identifiable information. FU has emerged to confront the challenge of data erasure within federated learning settings.
• Score: 21.90319100485268
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In recent years, the notion of ``the right to be forgotten" (RTBF) has become a crucial aspect of data privacy for digital trust and AI safety, requiring the provision of mechanisms that support the removal of personal data of individuals upon their requests. Consequently, machine unlearning (MU) has gained considerable attention which allows an ML model to selectively eliminate identifiable information. Evolving from MU, federated unlearning (FU) has emerged to confront the challenge of data erasure within federated learning (FL) settings, which empowers the FL model to unlearn an FL client or identifiable information pertaining to the client. Nevertheless, the distinctive attributes of federated learning introduce specific challenges for FU techniques. These challenges necessitate a tailored design when developing FU algorithms. While various concepts and numerous federated unlearning schemes exist in this field, the unified workflow and tailored design of FU are not yet well understood. Therefore, this comprehensive survey delves into the techniques and methodologies in FU providing an overview of fundamental concepts and principles, evaluating existing federated unlearning algorithms, and reviewing optimizations tailored to federated learning. Additionally, it discusses practical applications and assesses their limitations. Finally, it outlines promising directions for future research.

Related papers

• Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metrics [2.7456900944642686]
  Federated unlearning (FU) algorithms efficiently remove clients' contributions without full model retraining. This article provides background concepts, empirical evidence, and practical guidelines to design/implement efficient FU schemes.
  arXiv  Detail & Related papers  (2024-01-10T13:26:19Z)
• A Comprehensive Study on Model Initialization Techniques Ensuring Efficient Federated Learning [0.0]
  Federated learning(FL) has emerged as a promising paradigm for training machine learning models in a distributed and privacy-preserving manner. The choice of methods used for models plays a crucial role in the performance, convergence speed, communication efficiency, privacy guarantees of federated learning systems. Our research meticulously compares, categorizes, and delineates the merits and demerits of each technique, examining their applicability across diverse FL scenarios.
  arXiv  Detail & Related papers  (2023-10-31T23:26:58Z)
• A Survey of Federated Unlearning: A Taxonomy, Challenges and Future Directions [71.16718184611673]
  The evolution of privacy-preserving Federated Learning (FL) has led to an increasing demand for implementing the right to be forgotten. The implementation of selective forgetting is particularly challenging in FL due to its decentralized nature. Federated Unlearning (FU) emerges as a strategic solution to address the increasing need for data privacy.
  arXiv  Detail & Related papers  (2023-10-30T01:34:33Z)
• Deep Equilibrium Models Meet Federated Learning [71.57324258813675]
  This study explores the problem of Federated Learning (FL) by utilizing the Deep Equilibrium (DEQ) models instead of conventional deep learning networks. We claim that incorporating DEQ models into the federated learning framework naturally addresses several open problems in FL. To the best of our knowledge, this study is the first to establish a connection between DEQ models and federated learning.
  arXiv  Detail & Related papers  (2023-05-29T22:51:40Z)
• A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacy [47.89042524852868]
  Federated Learning (FL) stands out as a promising solution for diverse real-world scenarios. However, challenges around data isolation and privacy threaten the trustworthiness of FL systems.
  arXiv  Detail & Related papers  (2023-02-21T12:52:12Z)
• Federated Learning and Meta Learning: Approaches, Applications, and Directions [94.68423258028285]
  In this tutorial, we present a comprehensive review of FL, meta learning, and federated meta learning (FedMeta) Unlike other tutorial papers, our objective is to explore how FL, meta learning, and FedMeta methodologies can be designed, optimized, and evolved, and their applications over wireless networks.
  arXiv  Detail & Related papers  (2022-10-24T10:59:29Z)
• VeriFi: Towards Verifiable Federated Unlearning [59.169431326438676]
  Federated learning (FL) is a collaborative learning paradigm where participants jointly train a powerful model without sharing their private data. Leaving participant has the right to request to delete its private data from the global model. We propose VeriFi, a unified framework integrating federated unlearning and verification.
  arXiv  Detail & Related papers  (2022-05-25T12:20:02Z)
• Federated Learning: Balancing the Thin Line Between Data Intelligence and Privacy [0.0]
  Federated learning holds great promise in learning from fragmented sensitive data. This article provides a systematic overview and detailed taxonomy of federated learning. We investigate the existing security challenges in federated learning and provide an overview of established defense techniques for data poisoning, inference attacks, and model poisoning attacks.
  arXiv  Detail & Related papers  (2022-04-22T23:39:16Z)
• RoFL: Attestable Robustness for Secure Federated Learning [59.63865074749391]
  Federated Learning allows a large number of clients to train a joint model without the need to share their private data. To ensure the confidentiality of the client updates, Federated Learning systems employ secure aggregation. We present RoFL, a secure Federated Learning system that improves robustness against malicious clients.
  arXiv  Detail & Related papers  (2021-07-07T15:42:49Z)
• Federated Edge Learning : Design Issues and Challenges [1.916348196696894]
  Federated Learning (FL) is a distributed machine learning technique, where each device contributes to the learning model by independently computing the gradient based on its local training data. implementing FL at the network edge is challenging due to system and data heterogeneity and resources constraints. This article proposes a general framework for the data-aware scheduling as a guideline for future research directions.
  arXiv  Detail & Related papers  (2020-08-31T19:56:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.