Dynamic Distribution of Edge Intelligence at the Node Level for Internet
of Things
- URL: http://arxiv.org/abs/2107.05828v1
- Date: Tue, 13 Jul 2021 03:26:36 GMT
- Title: Dynamic Distribution of Edge Intelligence at the Node Level for Internet
of Things
- Authors: Hawzhin Mohammed, Tolulope A. Odetola, Nan Guo, Syed Rafay Hasan
- Abstract summary: Dynamic deployment of Convolutional Neural Network (CNN) architecture is proposed utilizing only IoT-level devices.
By partitioning and pipelining the CNN, it horizontally distributes the computation load among resource-constrained devices.
Results show that throughput can be increased by 1.55x to 1.75x for sharing the CNN into two and three resource-constrained devices.
- Score: 1.4026258162876617
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, dynamic deployment of Convolutional Neural Network (CNN)
architecture is proposed utilizing only IoT-level devices. By partitioning and
pipelining the CNN, it horizontally distributes the computation load among
resource-constrained devices (called horizontal collaboration), which in turn
increases the throughput. Through partitioning, we can decrease the computation
and energy consumption on individual IoT devices and increase the throughput
without sacrificing accuracy. Also, by processing the data at the generation
point, data privacy can be achieved. The results show that throughput can be
increased by 1.55x to 1.75x for sharing the CNN into two and three
resource-constrained devices, respectively.
Related papers
- Neuromorphic Wireless Split Computing with Multi-Level Spikes [69.73249913506042]
Neuromorphic computing uses spiking neural networks (SNNs) to perform inference tasks.
embedding a small payload within each spike exchanged between spiking neurons can enhance inference accuracy without increasing energy consumption.
split computing - where an SNN is partitioned across two devices - is a promising solution.
This paper presents the first comprehensive study of a neuromorphic wireless split computing architecture that employs multi-level SNNs.
arXiv Detail & Related papers (2024-11-07T14:08:35Z) - AirDnD -- Asynchronous In-Range Dynamic and Distributed Network Orchestration Framework [1.8590097948961688]
This research aims to improve and utilize the usage of computing resources in distributed edge devices by forming a dynamic mesh network.
The proposed solution consists of three models that transform growing amounts of geographically distributed edge devices into a living organism.
arXiv Detail & Related papers (2024-07-15T07:43:56Z) - Evolution of Convolutional Neural Network (CNN): Compute vs Memory
bandwidth for Edge AI [0.0]
This article explores the relationship between CNN compute requirements and memory bandwidth in the context of Edge AI.
We examine the impact of increasing model complexity on both computational requirements and memory access patterns.
This analysis provides insights into designing efficient architectures and potential hardware accelerators in enhancing CNN performance on edge devices.
arXiv Detail & Related papers (2023-09-24T09:11:22Z) - Attention-based Feature Compression for CNN Inference Offloading in Edge
Computing [93.67044879636093]
This paper studies the computational offloading of CNN inference in device-edge co-inference systems.
We propose a novel autoencoder-based CNN architecture (AECNN) for effective feature extraction at end-device.
Experiments show that AECNN can compress the intermediate data by more than 256x with only about 4% accuracy loss.
arXiv Detail & Related papers (2022-11-24T18:10:01Z) - Fluid Batching: Exit-Aware Preemptive Serving of Early-Exit Neural
Networks on Edge NPUs [74.83613252825754]
"smart ecosystems" are being formed where sensing happens concurrently rather than standalone.
This is shifting the on-device inference paradigm towards deploying neural processing units (NPUs) at the edge.
We propose a novel early-exit scheduling that allows preemption at run time to account for the dynamicity introduced by the arrival and exiting processes.
arXiv Detail & Related papers (2022-09-27T15:04:01Z) - Dynamic Split Computing for Efficient Deep Edge Intelligence [78.4233915447056]
We introduce dynamic split computing, where the optimal split location is dynamically selected based on the state of the communication channel.
We show that dynamic split computing achieves faster inference in edge computing environments where the data rate and server load vary over time.
arXiv Detail & Related papers (2022-05-23T12:35:18Z) - An Adaptive Device-Edge Co-Inference Framework Based on Soft
Actor-Critic [72.35307086274912]
High-dimension parameter model and large-scale mathematical calculation restrict execution efficiency, especially for Internet of Things (IoT) devices.
We propose a new Deep Reinforcement Learning (DRL)-Soft Actor Critic for discrete (SAC-d), which generates the emphexit point, emphexit point, and emphcompressing bits by soft policy iterations.
Based on the latency and accuracy aware reward design, such an computation can well adapt to the complex environment like dynamic wireless channel and arbitrary processing, and is capable of supporting the 5G URL
arXiv Detail & Related papers (2022-01-09T09:31:50Z) - Computational Intelligence and Deep Learning for Next-Generation
Edge-Enabled Industrial IoT [51.68933585002123]
We investigate how to deploy computational intelligence and deep learning (DL) in edge-enabled industrial IoT networks.
In this paper, we propose a novel multi-exit-based federated edge learning (ME-FEEL) framework.
In particular, the proposed ME-FEEL can achieve an accuracy gain up to 32.7% in the industrial IoT networks with the severely limited resources.
arXiv Detail & Related papers (2021-10-28T08:14:57Z) - DynO: Dynamic Onloading of Deep Neural Networks from Cloud to Device [17.43467167013752]
We present DynO, a distributed inference framework that combines the best of both worlds to address several challenges.
We show that DynO outperforms the current state-of-the-art, improving throughput by over an order of magnitude over device-only execution.
arXiv Detail & Related papers (2021-04-20T13:20:15Z) - The Internet of Things as a Deep Neural Network [16.78220721167574]
This article proposes to model the measurement compression at IoT nodes and the inference at the base station or cloud as a deep neural network (DNN)
We show how to learn the model parameters of the DNN and study the trade-off between the communication rate and the inference accuracy.
Our findings have the potentiality to enable many new IoT data analysis applications generating large amount of measurements.
arXiv Detail & Related papers (2020-03-23T20:36:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.