Exploring the Potential of Wireless-enabled Multi-Chip AI Accelerators

• URL: http://arxiv.org/abs/2501.17567v2
• Date: Mon, 28 Apr 2025 05:42:09 GMT
• Title: Exploring the Potential of Wireless-enabled Multi-Chip AI Accelerators
• Abstract summary: We show that wireless interconnects can lead to speedups of 10% on average and 20% maximum.<n>We highlight the importance of load balancing between the wired and wireless interconnects.
• Score: 2.2305608711864555
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The insatiable appetite of Artificial Intelligence (AI) workloads for computing power is pushing the industry to develop faster and more efficient accelerators. The rigidity of custom hardware, however, conflicts with the need for scalable and versatile architectures capable of catering to the needs of the evolving and heterogeneous pool of Machine Learning (ML) models in the literature. In this context, multi-chiplet architectures assembling multiple (perhaps heterogeneous) accelerators are an appealing option that is unfortunately hindered by the still rigid and inefficient chip-to-chip interconnects. In this paper, we explore the potential of wireless technology as a complement to existing wired interconnects in this multi-chiplet approach. Using an evaluation framework from the state-of-the-art, we show that wireless interconnects can lead to speedups of 10% on average and 20% maximum. We also highlight the importance of load balancing between the wired and wireless interconnects, which will be further explored in future work.

Related papers

• Power-Flexible AI Data Centers: A New Paradigm for Grid-Responsive Compute [0.7399816551817894]
  Traditional power-system planning treats large computing facilities as inflexible peak loads, leading to costly infrastructure upgrades and long delays in grid interconnection.<n>Recent work has shown that AI clusters can reduce electricity consumption during peak demand through software-based workload orchestration.<n>We describe an architecture integrating grid signals, workload scheduling, and power telemetry for fine-grained cluster power control.<n> Experimental results from a real-world deployment on a 130 kW GPU cluster demonstrate multiple forms of flexibility, including rapid load reduction, sustained curtailment, and carbon-aware operation while preserving service levels for priority jobs.
  arXiv  Detail & Related papers  (2026-06-23T19:13:19Z)
• Networking-Aware Energy Efficiency in Agentic AI Inference: A Survey [64.20429885919701]
  We propose an energy accounting framework identifying computational and communication costs across the Perception-Reasoning-Action cycle.<n>We establish a unified taxonomy spanning model simplification, computation control, input and attention optimization, and hardware-aware inference.<n>We identify open challenges of federated green learning, carbon-aware agency, 6th generation mobile communication (6G)-native Agentic AI, and self-sustaining systems.
  arXiv  Detail & Related papers  (2026-04-09T06:13:59Z)
• Federated Agentic AI for Wireless Networks: Fundamentals, Approaches, and Applications [60.721304295812445]
  Federated learning (FL) has the potential to improve the overall loop of agentic AI.<n>We first summarize fundamentals of agentic AI and mainstream FL types. Then, we illustrate how each FL type can strengthen a specific component of agentic AI's loop.<n>We conduct a case study on using FRL to improve the performance of agentic AI's action decision in low-altitude wireless networks.
  arXiv  Detail & Related papers  (2026-03-02T11:26:56Z)
• Pinching Antennas Meet AI in Next-Generation Wireless Networks [95.7524555556776]
  Next-generation (NG) wireless networks must embrace innate intelligence in support of emerging applications.<n>This article explores the "win-win" cooperation between AI and Pinching antennas (PAs)
  arXiv  Detail & Related papers  (2025-11-03T21:32:00Z)
• When Routers, Switches and Interconnects Compute: A processing-in-interconnect Paradigm for Scalable Neuromorphic AI [14.546627978614707]
  We show that operations required for typical AI workloads can be mapped onto delays, causality, time-outs, packet drop, and broadcast operations.<n>We show that existing buffering and traffic-shaping embedded algorithms can be leveraged to implement neuron models and synaptic operations.<n>We predict that by leveraging trends in interconnect technology, a pi2 architecture can be more easily scaled to execute brain-scale AI inference workloads.
  arXiv  Detail & Related papers  (2025-08-27T03:46:46Z)
• An Open-Source HW-SW Co-Development Framework Enabling Efficient Multi-Accelerator Systems [2.869405001718283]
  Heterogeneous accelerator-centric compute clusters are emerging as efficient solutions for diverse AI workloads.<n>We present SNAX, an open-source integrated HW-SW framework enabling efficient multi-accelerator platforms.
  arXiv  Detail & Related papers  (2025-08-20T10:04:21Z)
• AI Flow: Perspectives, Scenarios, and Approaches [51.38621621775711]
  We introduce AI Flow, a framework that integrates cutting-edge IT and CT advancements.<n>First, device-edge-cloud framework serves as the foundation, which integrates end devices, edge servers, and cloud clusters.<n>Second, we introduce the concept of familial models, which refers to a series of different-sized models with aligned hidden features.<n>Third, connectivity- and interaction-based intelligence emergence is a novel paradigm of AI Flow.
  arXiv  Detail & Related papers  (2025-06-14T12:43:07Z)
• Joint Resource Management for Energy-efficient UAV-assisted SWIPT-MEC: A Deep Reinforcement Learning Approach [50.52139512096988]
  6G Internet of Things (IoT) networks face challenges in remote areas and disaster scenarios where ground infrastructure is unavailable.<n>This paper proposes a novel aerial unmanned vehicle (UAV)-assisted computing (MEC) system enhanced by directional antennas to provide both computational and energy support for ground edge terminals.
  arXiv  Detail & Related papers  (2025-05-06T06:46:19Z)
• Current Opinions on Memristor-Accelerated Machine Learning Hardware [6.670055193544993]
  This manuscript reviews the current status of memristor-based machine learning accelerators.<n>It discusses our opinion on current key challenges that remain in this field, such as device variation, the need for efficient peripheral circuitry, and systematic co-design and optimization.<n>Memristor-based accelerators could significantly advance the capabilities of AI hardware, particularly for edge applications where power efficiency is paramount.
  arXiv  Detail & Related papers  (2025-01-22T05:10:47Z)
• SCAR: Scheduling Multi-Model AI Workloads on Heterogeneous Multi-Chiplet Module Accelerators [12.416683044819955]
  Multi-model workloads with heavy models like recent large language models significantly increased the compute and memory demands on hardware. To address such increasing demands, designing a scalable hardware architecture became a key problem. We develop a set of schedulers to navigate the huge scheduling space and codify them into a scheduler, SCAR, with advanced techniques such as inter-chiplet pipelining.
  arXiv  Detail & Related papers  (2024-05-01T18:02:25Z)
• Green Edge AI: A Contemporary Survey [46.11332733210337]
  The transformative power of AI is derived from the utilization of deep neural networks (DNNs) Deep learning (DL) is increasingly being transitioned to wireless edge networks in proximity to end-user devices (EUDs) Despite its potential, edge AI faces substantial challenges, mostly due to the dichotomy between the resource limitations of wireless edge networks and the resource-intensive nature of DL.
  arXiv  Detail & Related papers  (2023-12-01T04:04:37Z)
• Artificial Intelligence Empowered Multiple Access for Ultra Reliable and Low Latency THz Wireless Networks [76.89730672544216]
  Terahertz (THz) wireless networks are expected to catalyze the beyond fifth generation (B5G) era. To satisfy the ultra-reliability and low-latency demands of several B5G applications, novel mobility management approaches are required. This article presents a holistic MAC layer approach that enables intelligent user association and resource allocation, as well as flexible and adaptive mobility management.
  arXiv  Detail & Related papers  (2022-08-17T03:00:24Z)
• Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces [56.35676570414731]
  The emerging technology of Reconfigurable Intelligent Surfaces (RISs) is provisioned as an enabler of smart wireless environments. RISs offer a highly scalable, low-cost, hardware-efficient, and almost energy-neutral solution for dynamic control of the propagation of electromagnetic signals over the wireless medium. One of the major challenges with the envisioned dense deployment of RISs in such reconfigurable radio environments is the efficient configuration of multiple metasurfaces.
  arXiv  Detail & Related papers  (2022-05-08T06:21:33Z)
• Multicore Quantum Computing [0.0]
  We explore interlinked multicore architectures through analytic and numerical modelling. We model shuttling and microwave-based interlinks and estimate the achievable fidelities, finding values that are encouraging but markedly inferior to intra-core operations. We then assess the prospects for quantum advantage using such devices in the NISQ-era and beyond.
  arXiv  Detail & Related papers  (2022-01-21T19:00:15Z)
• Collaborative Learning over Wireless Networks: An Introductory Overview [84.09366153693361]
  We will mainly focus on collaborative training across wireless devices. Many distributed optimization algorithms have been developed over the last decades. They provide data locality; that is, a joint model can be trained collaboratively while the data available at each participating device remains local.
  arXiv  Detail & Related papers  (2021-12-07T20:15:39Z)
• Computational Intelligence and Deep Learning for Next-Generation Edge-Enabled Industrial IoT [51.68933585002123]
  We investigate how to deploy computational intelligence and deep learning (DL) in edge-enabled industrial IoT networks. In this paper, we propose a novel multi-exit-based federated edge learning (ME-FEEL) framework. In particular, the proposed ME-FEEL can achieve an accuracy gain up to 32.7% in the industrial IoT networks with the severely limited resources.
  arXiv  Detail & Related papers  (2021-10-28T08:14:57Z)
• Towards Hybrid Classical-Quantum Computation Structures in Wirelessly-Networked Systems [6.63697821097848]
  This paper explores the boundary between the two types of computation---classical-quantum hybrid processing for optimization problems in wireless systems. We explore the feasibility of a hybrid system with a real hardware prototype using one of the most advanced experimentally available techniques.
  arXiv  Detail & Related papers  (2020-10-01T21:00:12Z)
• One-step regression and classification with crosspoint resistive memory arrays [62.997667081978825]
  High speed, low energy computing machines are in demand to enable real-time artificial intelligence at the edge. One-step learning is supported by simulations of the prediction of the cost of a house in Boston and the training of a 2-layer neural network for MNIST digit recognition. Results are all obtained in one computational step, thanks to the physical, parallel, and analog computing within the crosspoint array.
  arXiv  Detail & Related papers  (2020-05-05T08:00:07Z)
• Deep Learning for Ultra-Reliable and Low-Latency Communications in 6G Networks [84.2155885234293]
  We first summarize how to apply data-driven supervised deep learning and deep reinforcement learning in URLLC. To address these open problems, we develop a multi-level architecture that enables device intelligence, edge intelligence, and cloud intelligence for URLLC.
  arXiv  Detail & Related papers  (2020-02-22T14:38:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.