PeerFL: A Simulator for Peer-to-Peer Federated Learning at Scale

• URL: http://arxiv.org/abs/2405.17839v1
• Date: Tue, 28 May 2024 05:30:18 GMT
• Title: PeerFL: A Simulator for Peer-to-Peer Federated Learning at Scale
• Authors: Alka Luqman, Shivanshu Shekhar, Anupam Chattopadhyay,
• Abstract summary: This work integrates peer-to-peer federated learning tools with NS3, a widely used network simulator. Our experiments showcase the simulator's efficiency in computational resource utilization at scale. The framework is open source and available for use and extension to the community.
• Score: 3.7338201977027885
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This work integrates peer-to-peer federated learning tools with NS3, a widely used network simulator, to create a novel simulator designed to allow heterogeneous device experiments in federated learning. This cross-platform adaptability addresses a critical gap in existing simulation tools, enhancing the overall utility and user experience. NS3 is leveraged to simulate WiFi dynamics to facilitate federated learning experiments with participants that move around physically during training, leading to dynamic network characteristics. Our experiments showcase the simulator's efficiency in computational resource utilization at scale, with a maximum of 450 heterogeneous devices modelled as participants in federated learning. This positions it as a valuable tool for simulation-based investigations in peer-to-peer federated learning. The framework is open source and available for use and extension to the community.

Related papers

• Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networks [93.38375271826202]
  We present a method to improve generalization and robustness to distribution shifts in sim-to-real visual quadrotor navigation tasks. We first build a simulator by integrating Gaussian splatting with quadrotor flight dynamics, and then, train robust navigation policies using Liquid neural networks. In this way, we obtain a full-stack imitation learning protocol that combines advances in 3D Gaussian splatting radiance field rendering, programming of expert demonstration training data, and the task understanding capabilities of Liquid networks.
  arXiv  Detail & Related papers  (2024-06-21T13:48:37Z)
• KAUCUS: Knowledge Augmented User Simulators for Training Language Model Assistants [3.724713116252253]
  An effective instruction-following assistant can be developed by creating a simulator that can generate useful interaction data. Previous user simulators generally lacked diversity, were mostly closed domain, and necessitated rigid schema. We introduce Kaucus, a Knowledge-Augmented User Simulator framework, to outline a process of creating diverse user simulators.
  arXiv  Detail & Related papers  (2024-01-29T06:57:02Z)
• Tackling Computational Heterogeneity in FL: A Few Theoretical Insights [68.8204255655161]
  We introduce and analyse a novel aggregation framework that allows for formalizing and tackling computational heterogeneous data. Proposed aggregation algorithms are extensively analyzed from a theoretical, and an experimental prospective.
  arXiv  Detail & Related papers  (2023-07-12T16:28:21Z)
• In Situ Framework for Coupling Simulation and Machine Learning with Application to CFD [51.04126395480625]
  Recent years have seen many successful applications of machine learning (ML) to facilitate fluid dynamic computations. As simulations grow, generating new training datasets for traditional offline learning creates I/O and storage bottlenecks. This work offers a solution by simplifying this coupling and enabling in situ training and inference on heterogeneous clusters.
  arXiv  Detail & Related papers  (2023-06-22T14:07:54Z)
• An Empirical Study of Federated Learning on IoT-Edge Devices: Resource Allocation and Heterogeneity [2.055204980188575]
  Federated Learning (FL) is a distributed approach in which a single server and multiple clients collaboratively build an ML model without moving data away from clients. In this study, we systematically conduct extensive experiments on a large network of IoT and edge devices (called IoT-Edge devices) to present FL real-world characteristics.
  arXiv  Detail & Related papers  (2023-05-31T13:16:07Z)
• Continual learning autoencoder training for a particle-in-cell simulation via streaming [52.77024349608834]
  upcoming exascale era will provide a new generation of physics simulations with high resolution. These simulations will have a high resolution, which will impact the training of machine learning models since storing a high amount of simulation data on disk is nearly impossible. This work presents an approach that trains a neural network concurrently to a running simulation without data on a disk.
  arXiv  Detail & Related papers  (2022-11-09T09:55:14Z)
• A Discrete-event-based Simulator for Deep Learning at Edge [7.096287095663305]
  We propose a discrete-event-based edge learning simulator. It includes a deep learning module and a network simulation module. Our framework is generic and can be used in various deep learning problems before the deep learning model is deployed.
  arXiv  Detail & Related papers  (2021-12-02T03:13:53Z)
• Sim-to-Real Transfer in Multi-agent Reinforcement Networking for Federated Edge Computing [11.3251009653699]
  Federated Learning (FL) over wireless multi-hop edge computing networks is a cost-effective distributed on-device deep learning paradigm. This paper presents FedEdge simulator, a high-fidelity Linux-based simulator, which enables fast prototyping, sim-to-real code, and knowledge transfer for multi-hop FL systems.
  arXiv  Detail & Related papers  (2021-10-18T00:21:07Z)
• Mobility-Aware Cluster Federated Learning in Hierarchical Wireless Networks [81.83990083088345]
  We develop a theoretical model to characterize the hierarchical federated learning (HFL) algorithm in wireless networks. Our analysis proves that the learning performance of HFL deteriorates drastically with highly-mobile users. To circumvent these issues, we propose a mobility-aware cluster federated learning (MACFL) algorithm.
  arXiv  Detail & Related papers  (2021-08-20T10:46:58Z)
• From Federated to Fog Learning: Distributed Machine Learning over Heterogeneous Wireless Networks [71.23327876898816]
  Federated learning has emerged as a technique for training ML models at the network edge by leveraging processing capabilities across the nodes that collect the data. We advocate a new learning paradigm called fog learning which will intelligently distribute ML model training across the continuum of nodes from edge devices to cloud servers.
  arXiv  Detail & Related papers  (2020-06-07T05:11:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.