Implementation of Big AI Models for Wireless Networks with Collaborative Edge Computing

• URL: http://arxiv.org/abs/2404.17766v1
• Date: Sat, 27 Apr 2024 03:09:39 GMT
• Title: Implementation of Big AI Models for Wireless Networks with Collaborative Edge Computing
• Authors: Liekang Zeng, Shengyuan Ye, Xu Chen, Yang Yang,
• Abstract summary: Training big AI models poses significant challenges to edge devices. Traditional approaches usually resort to aggregating training data and sending it to a remote cloud for centralized training. We propose collaborative edge training, a novel training mechanism that orchestrates a group of trusted edge devices as a resource pool.
• Score: 10.524645516703643
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Big Artificial Intelligence (AI) models have emerged as a crucial element in various intelligent applications at the edge, such as voice assistants in smart homes and autonomous robotics in smart factories. Training big AI models, e.g., for personalized fine-tuning and continual model refinement, poses significant challenges to edge devices due to the inherent conflict between limited computing resources and intensive workload associated with training. Despite the constraints of on-device training, traditional approaches usually resort to aggregating training data and sending it to a remote cloud for centralized training. Nevertheless, this approach is neither sustainable, which strains long-range backhaul transmission and energy-consuming datacenters, nor safely private, which shares users' raw data with remote infrastructures. To address these challenges, we alternatively observe that prevalent edge environments usually contain a diverse collection of trusted edge devices with untapped idle resources, which can be leveraged for edge training acceleration. Motivated by this, in this article, we propose collaborative edge training, a novel training mechanism that orchestrates a group of trusted edge devices as a resource pool for expedited, sustainable big AI model training at the edge. As an initial step, we present a comprehensive framework for building collaborative edge training systems and analyze in-depth its merits and sustainable scheduling choices following its workflow. To further investigate the impact of its parallelism design, we empirically study a case of four typical parallelisms from the perspective of energy demand with realistic testbeds. Finally, we discuss open challenges for sustainable collaborative edge training to point to future directions of edge-centric big AI model training.

Related papers

• Aquatic Navigation: A Challenging Benchmark for Deep Reinforcement Learning [53.3760591018817]
  We propose a new benchmarking environment for aquatic navigation using recent advances in the integration between game engines and Deep Reinforcement Learning. Specifically, we focus on PPO, one of the most widely accepted algorithms, and we propose advanced training techniques. Our empirical evaluation shows that a well-designed combination of these ingredients can achieve promising results.
  arXiv  Detail & Related papers  (2024-05-30T23:20:23Z)
• Privacy-Enhanced Training-as-a-Service for On-Device Intelligence: Concept, Architectural Scheme, and Open Problems [13.538116586216718]
  On-device intelligence (ODI) enables AI applications to run on end devices, providing real-time and customized AI inference without relying on remote servers. Training models for on-device deployment face challenges due to the decentralized and privacy-sensitive nature of users' data. We propose Privacy-Enhanced Training-as-a-Service (PT), a novel service computing paradigm that provides privacy-friendly, customized AI model training for end devices.
  arXiv  Detail & Related papers  (2024-04-16T03:18:27Z)
• Uncertainty Estimation in Multi-Agent Distributed Learning for AI-Enabled Edge Devices [0.0]
  Edge IoT devices have seen a paradigm shift with the introduction of FPGAs and AI accelerators. This advancement has vastly amplified their computational capabilities, emphasizing the practicality of edge AI. Our study explores methods that enable distributed data processing through AI-enabled edge devices, enhancing collaborative learning capabilities.
  arXiv  Detail & Related papers  (2024-03-14T07:40:32Z)
• Green Edge AI: A Contemporary Survey [46.11332733210337]
  The transformative power of AI is derived from the utilization of deep neural networks (DNNs) Deep learning (DL) is increasingly being transitioned to wireless edge networks in proximity to end-user devices (EUDs) Despite its potential, edge AI faces substantial challenges, mostly due to the dichotomy between the resource limitations of wireless edge networks and the resource-intensive nature of DL.
  arXiv  Detail & Related papers  (2023-12-01T04:04:37Z)
• Leveraging The Edge-to-Cloud Continuum for Scalable Machine Learning on Decentralized Data [3.448338949969246]
  This work tries to highlight the key challenges that prohibit Edge AI/ML from seeing wide-range adoption. The new design is envisioned to be model-centric in which the trained models are treated as a commodity. It is expected that this design will provide a decentralized framework for efficient collaborative learning at scale.
  arXiv  Detail & Related papers  (2023-06-19T10:59:41Z)
• Personalizing Federated Learning with Over-the-Air Computations [84.8089761800994]
  Federated edge learning is a promising technology to deploy intelligence at the edge of wireless networks in a privacy-preserving manner. Under such a setting, multiple clients collaboratively train a global generic model under the coordination of an edge server. This paper presents a distributed training paradigm that employs analog over-the-air computation to address the communication bottleneck.
  arXiv  Detail & Related papers  (2023-02-24T08:41:19Z)
• Edge-Cloud Polarization and Collaboration: A Comprehensive Survey [61.05059817550049]
  We conduct a systematic review for both cloud and edge AI. We are the first to set up the collaborative learning mechanism for cloud and edge modeling. We discuss potentials and practical experiences of some on-going advanced edge AI topics.
  arXiv  Detail & Related papers  (2021-11-11T05:58:23Z)
• Computational Intelligence and Deep Learning for Next-Generation Edge-Enabled Industrial IoT [51.68933585002123]
  We investigate how to deploy computational intelligence and deep learning (DL) in edge-enabled industrial IoT networks. In this paper, we propose a novel multi-exit-based federated edge learning (ME-FEEL) framework. In particular, the proposed ME-FEEL can achieve an accuracy gain up to 32.7% in the industrial IoT networks with the severely limited resources.
  arXiv  Detail & Related papers  (2021-10-28T08:14:57Z)
• Deep Learning for Ultra-Reliable and Low-Latency Communications in 6G Networks [84.2155885234293]
  We first summarize how to apply data-driven supervised deep learning and deep reinforcement learning in URLLC. To address these open problems, we develop a multi-level architecture that enables device intelligence, edge intelligence, and cloud intelligence for URLLC.
  arXiv  Detail & Related papers  (2020-02-22T14:38:11Z)
• Communication-Efficient Edge AI: Algorithms and Systems [39.28788394839187]
  Wide scale deployment of edge devices (e.g., IoT devices) generates an unprecedented scale of data. Such enormous data cannot all be sent from end devices to the cloud for processing. By pushing inference and training processes of AI models to edge nodes, edge AI has emerged as a promising alternative.
  arXiv  Detail & Related papers  (2020-02-22T09:27:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.