Reproducible Performance Optimization of Complex Applications on the
Edge-to-Cloud Continuum
- URL: http://arxiv.org/abs/2108.04033v1
- Date: Wed, 4 Aug 2021 07:35:14 GMT
- Title: Reproducible Performance Optimization of Complex Applications on the
Edge-to-Cloud Continuum
- Authors: Daniel Rosendo (KerData), Alexandru Costan, Gabriel Antoniu, Matthieu
Simonin, Jean-Christophe Lombardo, Alexis Joly, Patrick Valduriez
- Abstract summary: We propose a methodology to support the optimization of real-life applications on the Edge-to-Cloud Continuum.
Our approach relies on a rigorous analysis of possible configurations in a controlled testbed environment to understand their behaviour.
Our methodology can be generalized to other applications in the Edge-to-Cloud Continuum.
- Score: 55.6313942302582
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In more and more application areas, we are witnessing the emergence of
complex workflows that combine computing, analytics and learning. They often
require a hybrid execution infrastructure with IoT devices interconnected to
cloud/HPC systems (aka Computing Continuum). Such workflows are subject to
complex constraints and requirements in terms of performance, resource usage,
energy consumption and financial costs. This makes it challenging to optimize
their configuration and deployment. We propose a methodology to support the
optimization of real-life applications on the Edge-to-Cloud Continuum. We
implement it as an extension of E2Clab, a previously proposed framework
supporting the complete experimental cycle across the Edge-to-Cloud Continuum.
Our approach relies on a rigorous analysis of possible configurations in a
controlled testbed environment to understand their behaviour and related
performance trade-offs. We illustrate our methodology by optimizing Pl@ntNet, a
world-wide plant identification application. Our methodology can be generalized
to other applications in the Edge-to-Cloud Continuum.
Related papers
- Statically Inferring Usage Bounds for Infrastructure as Code [0.9886108751871757]
Infrastructure as Code (IaC) has enabled cloud customers to have more agility in creating and modifying complex deployments of cloud-provisioned resources.
We propose a tool for fine-grained static usage analysis that works by modeling the inter-resource interactions in an IaC deployment as a set of constraints.
arXiv Detail & Related papers (2024-02-23T22:27:56Z) - Distributed intelligence on the Edge-to-Cloud Continuum: A systematic
literature review [62.997667081978825]
This review aims at providing a comprehensive vision of the main state-of-the-art libraries and frameworks for machine learning and data analytics available today.
The main simulation, emulation, deployment systems, and testbeds for experimental research on the Edge-to-Cloud Continuum available today are also surveyed.
arXiv Detail & Related papers (2022-04-29T08:06:05Z) - ACE: Towards Application-Centric Edge-Cloud Collaborative Intelligence [14.379967483688834]
Intelligent applications based on machine learning are impacting many parts of our lives.
Current implementations running in the Cloud are unable to satisfy all these constraints.
The Edge-Cloud Collaborative Intelligence paradigm has become a popular approach to address such issues.
arXiv Detail & Related papers (2022-03-24T13:12:33Z) - SOLIS -- The MLOps journey from data acquisition to actionable insights [62.997667081978825]
In this paper we present a unified deployment pipeline and freedom-to-operate approach that supports all requirements while using basic cross-platform tensor framework and script language engines.
This approach however does not supply the needed procedures and pipelines for the actual deployment of machine learning capabilities in real production grade systems.
arXiv Detail & Related papers (2021-12-22T14:45:37Z) - Accelerating GAN training using highly parallel hardware on public cloud [0.3694429692322631]
This work explores different types of cloud services to train a Geneversarative Adversarial Network (GAN) in a parallel environment.
We parallelize the training process on multiple GPU and Google Processing Units (TPU)
Linear speed-up of the training process is obtained, while retaining most of the performance in terms of physics results.
arXiv Detail & Related papers (2021-11-08T16:59:15Z) - Auto-Split: A General Framework of Collaborative Edge-Cloud AI [49.750972428032355]
This paper describes the techniques and engineering practice behind Auto-Split, an edge-cloud collaborative prototype of Huawei Cloud.
To the best of our knowledge, there is no existing industry product that provides the capability of Deep Neural Network (DNN) splitting.
arXiv Detail & Related papers (2021-08-30T08:03:29Z) - Towards AIOps in Edge Computing Environments [60.27785717687999]
This paper describes the system design of an AIOps platform which is applicable in heterogeneous, distributed environments.
It is feasible to collect metrics with a high frequency and simultaneously run specific anomaly detection algorithms directly on edge devices.
arXiv Detail & Related papers (2021-02-12T09:33:00Z) - Edge-assisted Democratized Learning Towards Federated Analytics [67.44078999945722]
We show the hierarchical learning structure of the proposed edge-assisted democratized learning mechanism, namely Edge-DemLearn.
We also validate Edge-DemLearn as a flexible model training mechanism to build a distributed control and aggregation methodology in regions.
arXiv Detail & Related papers (2020-12-01T11:46:03Z) - Improving IoT Analytics through Selective Edge Execution [0.0]
We propose to improve the performance of analytics by leveraging edge infrastructure.
We devise an algorithm that enables the IoT devices to execute their routines locally.
We then outsource them to cloudlet servers, only if they predict they will gain a significant performance improvement.
arXiv Detail & Related papers (2020-03-07T15:02:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.