FederatedScope: A Comprehensive and Flexible Federated Learning Platform via Message Passing

• URL: http://arxiv.org/abs/2204.05011v1
• Date: Mon, 11 Apr 2022 11:24:21 GMT
• Title: FederatedScope: A Comprehensive and Flexible Federated Learning Platform via Message Passing
• Authors: Yuexiang Xie, Zhen Wang, Daoyuan Chen, Dawei Gao, Liuyi Yao, Weirui Kuang, Yaliang Li, Bolin Ding, Jingren Zhou
• Abstract summary: We propose a novel and comprehensive federated learning platform, named FederatedScope, which is based on a message-oriented framework. Compared to the procedural framework, the proposed message-oriented framework is more flexible to express heterogeneous message exchange. We conduct a series of experiments on the provided easy-to-use and comprehensive FL benchmarks to validate the correctness and efficiency of FederatedScope.
• Score: 63.87056362712879
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although remarkable progress has been made by the existing federated learning (FL) platforms to provide fundamental functionalities for development, these FL platforms cannot well satisfy burgeoning demands from rapidly growing FL tasks in both academia and industry. To fill this gap, in this paper, we propose a novel and comprehensive federated learning platform, named FederatedScope, which is based on a message-oriented framework. Towards more handy and flexible support for various FL tasks, FederatedScope frames an FL course into several rounds of message passing among participants, and allows developers to customize new types of exchanged messages and the corresponding handlers for various FL applications. Compared to the procedural framework, the proposed message-oriented framework is more flexible to express heterogeneous message exchange and the rich behaviors of participants, and provides a unified view for both simulation and deployment. Besides, we also include several functional components in FederatedScope, such as personalization, auto-tuning, and privacy protection, to satisfy the requirements of frontier studies in FL. We conduct a series of experiments on the provided easy-to-use and comprehensive FL benchmarks to validate the correctness and efficiency of FederatedScope. We have released FederatedScope for users on https://github.com/alibaba/FederatedScope to promote research and industrial deployment of federated learning in a variety of real-world applications.

Related papers

• FLEX: FLEXible Federated Learning Framework [6.112199274064954]
  This paper introduces FLEX: a FLEXible Federated Learning Framework designed to provide maximum flexibility in FL research experiments. By offering customizable features for data distribution, privacy parameters, and communication strategies, FLEX empowers researchers to innovate and develop novel FL techniques.
  arXiv  Detail & Related papers  (2024-04-09T08:51:05Z)
• A Survey on Efficient Federated Learning Methods for Foundation Model Training [66.19763977571114]
  Federated Learning (FL) has become an established technique to facilitate privacy-preserving collaborative training across a multitude of clients. In the wake of Foundation Models (FM), the reality is different for many deep learning applications. We discuss the benefits and drawbacks of parameter-efficient fine-tuning (PEFT) for FL applications.
  arXiv  Detail & Related papers  (2024-01-09T10:22:23Z)
• Towards Open Federated Learning Platforms: Survey and Vision from Technical and Legal Perspectives [34.0620974123791]
  Traditional Federated Learning (FL) follows a server-dominated cooperation paradigm. We advocate rethinking the design of current FL frameworks and extending it to a more general concept: Open Federated Learning Platforms.
  arXiv  Detail & Related papers  (2023-07-05T09:30:14Z)
• FS-Real: Towards Real-World Cross-Device Federated Learning [60.91678132132229]
  Federated Learning (FL) aims to train high-quality models in collaboration with distributed clients while not uploading their local data. There is still a considerable gap between the flourishing FL research and real-world scenarios, mainly caused by the characteristics of heterogeneous devices and its scales. We propose an efficient and scalable prototyping system for real-world cross-device FL, FS-Real.
  arXiv  Detail & Related papers  (2023-03-23T15:37:17Z)
• ModularFed: Leveraging Modularity in Federated Learning Frameworks [8.139264167572213]
  We propose a research-focused framework that addresses the complexity of Federated Learning (FL) implementations. Within this architecture, protocols are blueprints that strictly define the framework's components' design. Our protocols aim to enable modularity in FL, supporting third-party plug-and-play architecture and dynamic simulators.
  arXiv  Detail & Related papers  (2022-10-31T10:21:19Z)
• Vertical Semi-Federated Learning for Efficient Online Advertising [50.18284051956359]
  Semi-VFL (Vertical Semi-Federated Learning) is proposed to achieve a practical industry application fashion for VFL. We build an inference-efficient single-party student model applicable to the whole sample space. New representation distillation methods are designed to extract cross-party feature correlations for both the overlapped and non-overlapped data.
  arXiv  Detail & Related papers  (2022-09-30T17:59:27Z)
• UniFed: All-In-One Federated Learning Platform to Unify Open-Source Frameworks [53.20176108643942]
  We present UniFed, the first unified platform for standardizing open-source Federated Learning (FL) frameworks. UniFed streamlines the end-to-end workflow for distributed experimentation and deployment, encompassing 11 popular open-source FL frameworks. We evaluate and compare 11 popular FL frameworks from the perspectives of functionality, privacy protection, and performance.
  arXiv  Detail & Related papers  (2022-07-21T05:03:04Z)
• FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learning [65.48760613529033]
  Federated graph learning (FGL) has not been well supported due to its unique characteristics and requirements. We first discuss the challenges in creating an easy-to-use FGL package and accordingly present our implemented package FederatedScope-GNN (FS-G) We validate the effectiveness of FS-G by conducting extensive experiments, which simultaneously gains many valuable insights about FGL for the community.
  arXiv  Detail & Related papers  (2022-04-12T06:48:06Z)
• FLUTE: A Scalable, Extensible Framework for High-Performance Federated Learning Simulations [12.121967768185684]
  "Federated Learning Utilities and Tools for Experimentation" (FLUTE) is a high-performance open source platform for federated learning research and offline simulations. We describe the architecture of FLUTE, enabling arbitrary federated modeling schemes to be realized. We demonstrate the effectiveness of the platform with a series of experiments for text prediction and speech recognition.
  arXiv  Detail & Related papers  (2022-03-25T17:15:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.