Communication-Efficient Edge AI: Algorithms and Systems
- URL: http://arxiv.org/abs/2002.09668v1
- Date: Sat, 22 Feb 2020 09:27:55 GMT
- Title: Communication-Efficient Edge AI: Algorithms and Systems
- Authors: Yuanming Shi, Kai Yang, Tao Jiang, Jun Zhang, and Khaled B. Letaief
- Abstract summary: Wide scale deployment of edge devices (e.g., IoT devices) generates an unprecedented scale of data.
Such enormous data cannot all be sent from end devices to the cloud for processing.
By pushing inference and training processes of AI models to edge nodes, edge AI has emerged as a promising alternative.
- Score: 39.28788394839187
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Artificial intelligence (AI) has achieved remarkable breakthroughs in a wide
range of fields, ranging from speech processing, image classification to drug
discovery. This is driven by the explosive growth of data, advances in machine
learning (especially deep learning), and easy access to vastly powerful
computing resources. Particularly, the wide scale deployment of edge devices
(e.g., IoT devices) generates an unprecedented scale of data, which provides
the opportunity to derive accurate models and develop various intelligent
applications at the network edge. However, such enormous data cannot all be
sent from end devices to the cloud for processing, due to the varying channel
quality, traffic congestion and/or privacy concerns. By pushing inference and
training processes of AI models to edge nodes, edge AI has emerged as a
promising alternative. AI at the edge requires close cooperation among edge
devices, such as smart phones and smart vehicles, and edge servers at the
wireless access points and base stations, which however result in heavy
communication overheads. In this paper, we present a comprehensive survey of
the recent developments in various techniques for overcoming these
communication challenges. Specifically, we first identify key communication
challenges in edge AI systems. We then introduce communication-efficient
techniques, from both algorithmic and system perspectives for training and
inference tasks at the network edge. Potential future research directions are
also highlighted.
Related papers
- Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and
Applications [39.223546118441476]
6G will revolutionize the evolution of wireless from "connected things" to "connected intelligence"
Deep learning and big data analytics based AI systems require tremendous computation and communication resources.
edge AI stands out as a disruptive technology for 6G to seamlessly integrate sensing, communication, computation, and intelligence.
arXiv Detail & Related papers (2021-11-24T11:47:16Z) - Edge-Cloud Polarization and Collaboration: A Comprehensive Survey [61.05059817550049]
We conduct a systematic review for both cloud and edge AI.
We are the first to set up the collaborative learning mechanism for cloud and edge modeling.
We discuss potentials and practical experiences of some on-going advanced edge AI topics.
arXiv Detail & Related papers (2021-11-11T05:58:23Z) - How to Reach Real-Time AI on Consumer Devices? Solutions for
Programmable and Custom Architectures [7.085772863979686]
Deep neural networks (DNNs) have led to large strides in various Artificial Intelligence (AI) inference tasks, such as object and speech recognition.
deploying such AI models across commodity devices faces significant challenges.
We present techniques for achieving real-time performance following a cross-stack approach.
arXiv Detail & Related papers (2021-06-21T11:23:12Z) - Pervasive AI for IoT Applications: Resource-efficient Distributed
Artificial Intelligence [45.076180487387575]
Artificial intelligence (AI) has witnessed a substantial breakthrough in a variety of Internet of Things (IoT) applications and services.
This is driven by the easier access to sensory data and the enormous scale of pervasive/ubiquitous devices that generate zettabytes (ZB) of real-time data streams.
The confluence of pervasive computing and artificial intelligence, Pervasive AI, expanded the role of ubiquitous IoT systems.
arXiv Detail & Related papers (2021-05-04T23:42:06Z) - Empowering Things with Intelligence: A Survey of the Progress,
Challenges, and Opportunities in Artificial Intelligence of Things [98.10037444792444]
We show how AI can empower the IoT to make it faster, smarter, greener, and safer.
First, we present progress in AI research for IoT from four perspectives: perceiving, learning, reasoning, and behaving.
Finally, we summarize some promising applications of AIoT that are likely to profoundly reshape our world.
arXiv Detail & Related papers (2020-11-17T13:14:28Z) - Towards Self-learning Edge Intelligence in 6G [143.1821636135413]
Edge intelligence, also called edge-native artificial intelligence (AI), is an emerging technological framework focusing on seamless integration of AI, communication networks, and mobile edge computing.
In this article, we identify the key requirements and challenges of edge-native AI in 6G.
arXiv Detail & Related papers (2020-10-01T02:16:40Z) - Artificial Intelligence for UAV-enabled Wireless Networks: A Survey [72.10851256475742]
Unmanned aerial vehicles (UAVs) are considered as one of the promising technologies for the next-generation wireless communication networks.
Artificial intelligence (AI) is growing rapidly nowadays and has been very successful.
We provide a comprehensive overview of some potential applications of AI in UAV-based networks.
arXiv Detail & Related papers (2020-09-24T07:11:31Z) - CLAN: Continuous Learning using Asynchronous Neuroevolution on Commodity
Edge Devices [3.812706195714961]
We build a prototype distributed system of Raspberry Pis communicating via WiFi running NeuroEvolutionary (NE) learning and inference.
We evaluate the performance of such a collaborative system and detail the compute/communication characteristics of different arrangements of the system.
arXiv Detail & Related papers (2020-08-27T01:49:21Z) - Federated Machine Learning for Intelligent IoT via Reconfigurable
Intelligent Surface [35.64178319119883]
We develop an over-the-air based communication-efficient federated machine learning framework for intelligent IoT networks.
We exploit the waveform superposition property of a multi-access channel to reduce the model aggregation error.
arXiv Detail & Related papers (2020-04-13T09:48:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.