A Fast Edge-Based Synchronizer for Tasks in Real-Time Artificial Intelligence Applications

• URL: http://arxiv.org/abs/2012.11731v1
• Date: Mon, 21 Dec 2020 23:02:21 GMT
• Title: A Fast Edge-Based Synchronizer for Tasks in Real-Time Artificial Intelligence Applications
• Authors: Richard Olaniyan and Muthucumaru Maheswaran
• Abstract summary: Task synchronization across devices is an important problem that affects the timely progress of an AI application. We develop a fast edge-based synchronization scheme that can time align the execution of input-output tasks as well compute tasks.
• Score: 0.8122270502556374
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Real-time artificial intelligence (AI) applications mapped onto edge computing need to perform data capture, process data, and device actuation within given bounds while using the available devices. Task synchronization across the devices is an important problem that affects the timely progress of an AI application by determining the quality of the captured data, time to process the data, and the quality of actuation. In this paper, we develop a fast edge-based synchronization scheme that can time align the execution of input-output tasks as well compute tasks. The primary idea of the fast synchronizer is to cluster the devices into groups that are highly synchronized in their task executions and statically determine few synchronization points using a game-theoretic solver. The cluster of devices use a late notification protocol to select the best point among the pre-computed synchronization points to reach a time aligned task execution as quickly as possible. We evaluate the performance of our synchronization scheme using trace-driven simulations and we compare the performance with existing distributed synchronization schemes for real-time AI application tasks. We implement our synchronization scheme and compare its training accuracy and training time with other parameter server synchronization frameworks.

Related papers

• Asynchronous Tool Usage for Real-Time Agents [61.3041983544042]
  We introduce asynchronous AI agents capable of parallel processing and real-time tool-use. Our key contribution is an event-driven finite-state machine architecture for agent execution and prompting. This work presents both a conceptual framework and practical tools for creating AI agents capable of fluid, multitasking interactions.
  arXiv  Detail & Related papers  (2024-10-28T23:57:19Z)
• Event-ECC: Asynchronous Tracking of Events with Continuous Optimization [1.9446776999250501]
  We propose a tracking algorithm that computes a 2D motion warp per single event, called event-ECC (eECC) The computational burden of event-wise processing is alleviated through a lightweight version that benefits from incremental processing and updating scheme. We report improvements in tracking accuracy and feature age over state-of-the-art event-based asynchronous trackers.
  arXiv  Detail & Related papers  (2024-09-22T19:03:19Z)
• Synchformer: Efficient Synchronization from Sparse Cues [100.89656994681934]
  Our contributions include a novel audio-visual synchronization model, and training that decouples extraction from synchronization modelling. This approach achieves state-of-the-art performance in both dense and sparse settings. We also extend synchronization model training to AudioSet a million-scale 'in-the-wild' dataset, investigate evidence attribution techniques for interpretability, and explore a new capability for synchronization models: audio-visual synchronizability.
  arXiv  Detail & Related papers  (2024-01-29T18:59:55Z)
• Efficient Asynchronous Federated Learning with Sparsification and Quantization [55.6801207905772]
  Federated Learning (FL) is attracting more and more attention to collaboratively train a machine learning model without transferring raw data. FL generally exploits a parameter server and a large number of edge devices during the whole process of the model training. We propose TEASQ-Fed to exploit edge devices to asynchronously participate in the training process by actively applying for tasks.
  arXiv  Detail & Related papers  (2023-12-23T07:47:07Z)
• Motion2Language, unsupervised learning of synchronized semantic motion segmentation [0.0]
  We investigate building a sequence to sequence architecture for motion to language translation and synchronization. The aim is to translate motion capture inputs into English natural-language descriptions, such that the descriptions are generated synchronously with the actions performed. We propose a new recurrent formulation of local attention that is suited for synchronous/live text generation, as well as an improved motion encoder architecture.
  arXiv  Detail & Related papers  (2023-10-16T17:16:32Z)
• Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors [103.21152156339484]
  The objective of this paper is audio-visual synchronisation of general videos 'in the wild' We make four contributions: (i) in order to handle longer temporal sequences required for sparse synchronisation signals, we design a multi-modal transformer model that employs'selectors' We identify artefacts that can arise from the compression codecs used for audio and video and can be used by audio-visual models in training to artificially solve the synchronisation task.
  arXiv  Detail & Related papers  (2022-10-13T14:25:37Z)
• Asynchronous Execution of Heterogeneous Tasks in ML-driven HPC Workflows [1.376408511310322]
  Asynchronous execution is crucial to improve resource utilization, task throughput and reduce' makespan. We investigate the requirements and properties of the asynchronous task execution of machine learning (ML)-driven high performance computing. Our experiments represent relevant scientific drivers, we perform them at scale on Summit, and we show that the performance enhancements due to asynchronous execution are consistent with our model.
  arXiv  Detail & Related papers  (2022-08-23T16:25:48Z)
• Asynchronous Optimisation for Event-based Visual Odometry [53.59879499700895]
  Event cameras open up new possibilities for robotic perception due to their low latency and high dynamic range. We focus on event-based visual odometry (VO) We propose an asynchronous structure-from-motion optimisation back-end.
  arXiv  Detail & Related papers  (2022-03-02T11:28:47Z)
• Self-timed Reinforcement Learning using Tsetlin Machine [1.104960878651584]
  We present a hardware design for the learning datapath of the Tsetlin machine algorithm, along with a latency analysis of the inference datapath. Results illustrate the advantages of asynchronous design in applications such as personalized healthcare and battery-powered internet of things devices.
  arXiv  Detail & Related papers  (2021-09-02T11:24:23Z)
• Event-based Asynchronous Sparse Convolutional Networks [54.094244806123235]
  Event cameras are bio-inspired sensors that respond to per-pixel brightness changes in the form of asynchronous and sparse "events" We present a general framework for converting models trained on synchronous image-like event representations into asynchronous models with identical output. We show both theoretically and experimentally that this drastically reduces the computational complexity and latency of high-capacity, synchronous neural networks.
  arXiv  Detail & Related papers  (2020-03-20T08:39:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.