FLRA: A Reference Architecture for Federated Learning Systems

• URL: http://arxiv.org/abs/2106.11570v1
• Date: Tue, 22 Jun 2021 06:59:19 GMT
• Title: FLRA: A Reference Architecture for Federated Learning Systems
• Authors: Sin Kit Lo, Qinghua Lu, Hye-Young Paik, and Liming Zhu
• Abstract summary: Federated learning is an emerging machine learning paradigm that enables multiple devices to train models locally and formulate a global model, without sharing the clients' local data. We propose FLRA, a reference architecture for federated learning systems, which provides a template design for federated learning-based solutions.
• Score: 8.180947044673639
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Federated learning is an emerging machine learning paradigm that enables multiple devices to train models locally and formulate a global model, without sharing the clients' local data. A federated learning system can be viewed as a large-scale distributed system, involving different components and stakeholders with diverse requirements and constraints. Hence, developing a federated learning system requires both software system design thinking and machine learning knowledge. Although much effort has been put into federated learning from the machine learning perspectives, our previous systematic literature review on the area shows that there is a distinct lack of considerations for software architecture design for federated learning. In this paper, we propose FLRA, a reference architecture for federated learning systems, which provides a template design for federated learning-based solutions. The proposed FLRA reference architecture is based on an extensive review of existing patterns of federated learning systems found in the literature and existing industrial implementation. The FLRA reference architecture consists of a pool of architectural patterns that could address the frequently recurring design problems in federated learning architectures. The FLRA reference architecture can serve as a design guideline to assist architects and developers with practical solutions for their problems, which can be further customised.

Related papers

• Handling Data Heterogeneity via Architectural Design for Federated Visual Recognition [16.50490537786593]
  We study 19 visual recognition models from five different architectural families on four challenging FL datasets. Our findings emphasize the importance of architectural design for computer vision tasks in practical scenarios.
  arXiv  Detail & Related papers  (2023-10-23T17:59:16Z)
• Serving Deep Learning Model in Relational Databases [70.53282490832189]
  Serving deep learning (DL) models on relational data has become a critical requirement across diverse commercial and scientific domains. We highlight three pivotal paradigms: The state-of-the-art DL-centric architecture offloads DL computations to dedicated DL frameworks. The potential UDF-centric architecture encapsulates one or more tensor computations into User Defined Functions (UDFs) within the relational database management system (RDBMS)
  arXiv  Detail & Related papers  (2023-10-07T06:01:35Z)
• Machine Learning-Enabled Software and System Architecture Frameworks [48.87872564630711]
  The stakeholders with data science and Machine Learning related concerns, such as data scientists and data engineers, are yet to be included in existing architecture frameworks. We surveyed 61 subject matter experts from over 25 organizations in 10 countries.
  arXiv  Detail & Related papers  (2023-08-09T21:54:34Z)
• Deep Equilibrium Models Meet Federated Learning [71.57324258813675]
  This study explores the problem of Federated Learning (FL) by utilizing the Deep Equilibrium (DEQ) models instead of conventional deep learning networks. We claim that incorporating DEQ models into the federated learning framework naturally addresses several open problems in FL. To the best of our knowledge, this study is the first to establish a connection between DEQ models and federated learning.
  arXiv  Detail & Related papers  (2023-05-29T22:51:40Z)
• A Compositional Approach to Creating Architecture Frameworks with an Application to Distributed AI Systems [16.690434072032176]
  We show how compositional thinking can provide rules for the creation and management of architectural frameworks for complex systems. The aim of the paper is not to provide viewpoints or architecture models specific to AI systems, but instead to provide guidelines on how a consistent framework can be built up with existing, or newly created, viewpoints.
  arXiv  Detail & Related papers  (2022-12-27T18:05:02Z)
• FedHeN: Federated Learning in Heterogeneous Networks [52.29110497518558]
  We propose a novel training recipe for federated learning with heterogeneous networks. We introduce training with a side objective to the devices of higher complexities to jointly train different architectures in a federated setting.
  arXiv  Detail & Related papers  (2022-07-07T01:08:35Z)
• Decision Models for Selecting Federated Learning Architecture Patterns [7.468413169676602]
  We present a set of decision models for the selection of patterns for federated machine learning architecture design. Each decision model maps functional and non-functional requirements of federated machine learning systems to a set of patterns.
  arXiv  Detail & Related papers  (2022-04-28T05:07:26Z)
• Architectural Patterns for the Design of Federated Learning Systems [12.330671239159102]
  Federated learning has received fast-growing interests from academia and industry to tackle the challenges of data hungriness and privacy in machine learning. This paper presents a collection of architectural patterns to deal with the design challenges of federated learning systems.
  arXiv  Detail & Related papers  (2021-01-07T05:11:09Z)
• Edge-assisted Democratized Learning Towards Federated Analytics [67.44078999945722]
  We show the hierarchical learning structure of the proposed edge-assisted democratized learning mechanism, namely Edge-DemLearn. We also validate Edge-DemLearn as a flexible model training mechanism to build a distributed control and aggregation methodology in regions.
  arXiv  Detail & Related papers  (2020-12-01T11:46:03Z)
• A Systematic Literature Review on Federated Machine Learning: From A Software Engineering Perspective [9.315446698757768]
  Federated learning is an emerging machine learning paradigm where clients train models locally and formulate a global model based on the local model updates. We perform a systematic literature review from a software engineering perspective, based on 231 primary studies. Our data synthesis covers the lifecycle of federated learning system development that includes background understanding, requirement analysis, architecture design, implementation, and evaluation.
  arXiv  Detail & Related papers  (2020-07-22T11:59:54Z)
• Self-organizing Democratized Learning: Towards Large-scale Distributed Learning Systems [71.14339738190202]
  democratized learning (Dem-AI) lays out a holistic philosophy with underlying principles for building large-scale distributed and democratized machine learning systems. Inspired by Dem-AI philosophy, a novel distributed learning approach is proposed in this paper. The proposed algorithms demonstrate better results in the generalization performance of learning models in agents compared to the conventional FL algorithms.
  arXiv  Detail & Related papers  (2020-07-07T08:34:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.