One-Shot Federated Learning for LEO Constellations that Reduces Convergence Time from Days to 90 Minutes

• URL: http://arxiv.org/abs/2305.12316v1
• Date: Sun, 21 May 2023 01:57:56 GMT
• Title: One-Shot Federated Learning for LEO Constellations that Reduces Convergence Time from Days to 90 Minutes
• Authors: Mohamed Elmahallawy, Tie Luo
• Abstract summary: A Low Earth orbit (LEO) satellite constellation consists of a large number of small satellites traveling in space with high mobility. Federated Learning (FL) is a promising approach because it eliminates the need for transmitting raw data and hence is both bandwidth and privacy-friendly. We propose a novel one-shot FL approach for LEO satellites, called LEOShot, that needs only a single communication round to complete the entire learning process.
• Score: 3.096615629099617
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: A Low Earth orbit (LEO) satellite constellation consists of a large number of small satellites traveling in space with high mobility and collecting vast amounts of mobility data such as cloud movement for weather forecast, large herds of animals migrating across geo-regions, spreading of forest fires, and aircraft tracking. Machine learning can be utilized to analyze these mobility data to address global challenges, and Federated Learning (FL) is a promising approach because it eliminates the need for transmitting raw data and hence is both bandwidth and privacy-friendly. However, FL requires many communication rounds between clients (satellites) and the parameter server (PS), leading to substantial delays of up to several days in LEO constellations. In this paper, we propose a novel one-shot FL approach for LEO satellites, called LEOShot, that needs only a single communication round to complete the entire learning process. LEOShot comprises three processes: (i) synthetic data generation, (ii) knowledge distillation, and (iii) virtual model retraining. We evaluate and benchmark LEOShot against the state of the art and the results show that it drastically expedites FL convergence by more than an order of magnitude. Also surprisingly, despite the one-shot nature, its model accuracy is on par with or even outperforms regular iterative FL schemes by a large margin

Related papers

• Hyperdimensional Computing Empowered Federated Foundation Model over Wireless Networks for Metaverse [56.384390765357004]
  We propose an integrated federated split learning and hyperdimensional computing framework for emerging foundation models. This novel approach reduces communication costs, computation load, and privacy risks, making it suitable for resource-constrained edge devices in the Metaverse.
  arXiv  Detail & Related papers  (2024-08-26T17:03:14Z)
• LiveHPS: LiDAR-based Scene-level Human Pose and Shape Estimation in Free Environment [59.320414108383055]
  We present LiveHPS, a novel single-LiDAR-based approach for scene-level human pose and shape estimation. We propose a huge human motion dataset, named FreeMotion, which is collected in various scenarios with diverse human poses.
  arXiv  Detail & Related papers  (2024-02-27T03:08:44Z)
• FedSN: A Federated Learning Framework over Heterogeneous LEO Satellite Networks [18.213174641216884]
  A large number of Low Earth Orbit (LEO) satellites have been launched and deployed successfully in space by commercial companies, such as SpaceX. Due to multimodal sensors equipped by the LEO satellites, they serve not only for communication but also for various machine learning applications, such as space modulation recognition, remote sensing image classification, etc. We propose FedSN as a general FL framework to tackle the above challenges, and fully explore data diversity on LEO satellites.
  arXiv  Detail & Related papers  (2023-11-02T14:47:06Z)
• Optimizing Federated Learning in LEO Satellite Constellations via Intra-Plane Model Propagation and Sink Satellite Scheduling [3.096615629099617]
  Satellite edge computing (SEC) allows each satellite to train an ML model onboard and uploads only the model to the ground station. This paper proposes FedLEO, a novel federated learning (FL) framework that overcomes the limitation (slow convergence) of existing FL-based solutions. Our results show that FedLEO drastically expedites FL convergence, without sacrificing -- in fact it considerably increases -- the model accuracy.
  arXiv  Detail & Related papers  (2023-02-27T00:32:01Z)
• AsyncFLEO: Asynchronous Federated Learning for LEO Satellite Constellations with High-Altitude Platforms [3.096615629099617]
  Federated Learning (FL) allows data to stay in-situ (never leaving satellites) FL can take several days to train a single FL model in the context of satellite communication (Satcom) We propose an asynchronous FL framework for LEO constellations called AsyncFLEO to improve FL efficiency in Satcom.
  arXiv  Detail & Related papers  (2022-12-22T07:52:30Z)
• Online Data Selection for Federated Learning with Limited Storage [53.46789303416799]
  Federated Learning (FL) has been proposed to achieve distributed machine learning among networked devices. The impact of on-device storage on the performance of FL is still not explored. In this work, we take the first step to consider the online data selection for FL with limited on-device storage.
  arXiv  Detail & Related papers  (2022-09-01T03:27:33Z)
• Federated learning for LEO constellations via inter-HAP links [0.0]
  Low Earth Obit (LEO) satellite constellations have seen a sharp increase of deployment in recent years. To apply machine learning (ML) in such applications, the traditional way of downloading satellite data such as imagery to a ground station (GS) is not desirable. We show that existing FL solutions do not fit well in such LEO constellation scenarios because of significant challenges such as excessive convergence delay and unreliable wireless channels.
  arXiv  Detail & Related papers  (2022-05-15T08:22:52Z)
• Parallel Successive Learning for Dynamic Distributed Model Training over Heterogeneous Wireless Networks [50.68446003616802]
  Federated learning (FedL) has emerged as a popular technique for distributing model training over a set of wireless devices. We develop parallel successive learning (PSL), which expands the FedL architecture along three dimensions. Our analysis sheds light on the notion of cold vs. warmed up models, and model inertia in distributed machine learning.
  arXiv  Detail & Related papers  (2022-02-07T05:11:01Z)
• FedSpace: An Efficient Federated Learning Framework at Satellites and Ground Stations [10.250105527148731]
  Large-scale deployments of low Earth orbit (LEO) satellites collect massive amount of Earth imageries and sensor data. It is often infeasible to download all the high-resolution images and train these machine learning models on the ground because of limited downlink bandwidth, sparse connectivity, and regularization constraints on the imagery resolution. We propose Federated Learning (FL), where ground stations and satellites collaboratively train a global ML model without sharing the captured images on the satellites.
  arXiv  Detail & Related papers  (2022-02-02T20:09:27Z)
• Integrating LEO Satellite and UAV Relaying via Reinforcement Learning for Non-Terrestrial Networks [51.05735925326235]
  A mega-constellation of low-earth orbit (LEO) satellites has the potential to enable long-range communication with low latency. We study the problem of forwarding packets between two faraway ground terminals, through an LEO satellite selected from an orbiting constellation. To maximize the end-to-end data rate, the satellite association and HAP location should be optimized. We tackle this problem using deep reinforcement learning (DRL) with a novel action dimension reduction technique.
  arXiv  Detail & Related papers  (2020-05-26T05:39:27Z)
• Federated Learning in the Sky: Joint Power Allocation and Scheduling with UAV Swarms [98.78553146823829]
  Unmanned aerial vehicle (UAV) swarms must exploit machine learning (ML) in order to execute various tasks. In this paper, a novel framework is proposed to implement distributed learning (FL) algorithms within a UAV swarm.
  arXiv  Detail & Related papers  (2020-02-19T14:04:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.