CARISMA: CAR-Integrated Service Mesh Architecture
- URL: http://arxiv.org/abs/2403.04378v1
- Date: Thu, 7 Mar 2024 10:10:34 GMT
- Title: CARISMA: CAR-Integrated Service Mesh Architecture
- Authors: Kevin Klein, Pascal Hirmer and Steffen Becker
- Abstract summary: The amount of software in modern cars is increasing continuously with traditional electric/electronic (E/E) architectures reaching their limit.
To mitigate this situation, more powerful computing platforms are being employed and applications are developed as distributed applications.
We present an architecture applying the service mesh prototypical approach to automotive E/E platforms comprising multiple interlinked High-Performance Computers.
- Score: 0.9834663375961437
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The amount of software in modern cars is increasing continuously with
traditional electric/electronic (E/E) architectures reaching their limit when
deploying complex applications, e.g., regarding bandwidth or computational
power. To mitigate this situation, more powerful computing platforms are being
employed and applications are developed as distributed applications, e.g.,
involving microservices. Microservices received widespread adoption and changed
the way modern applications are developed. However, they also introduce
additional complexity regarding inter-service communication. This has led to
the emergence of service meshes, a promising approach to cope with this
complexity. In this paper, we present an architecture applying the service mesh
approach to automotive E/E platforms comprising multiple interlinked
High-Performance Computers (HPCs). We validate the feasibility of our approach
through a prototypical implementation.
Related papers
- Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning [49.997801914237094]
We introduce the Fire-Flyer AI- HPC architecture, a synergistic hardware-software co-design framework and its best practices.
For Deep Learning (DL) training, we deployed the Fire-Flyer 2 with 10,000 PCIe A100 GPUs, achieved performance approximating the DGX-A100 while reducing costs by half and energy consumption by 40%.
Through our software stack, including HaiScale, 3FS, and HAI-Platform, we achieved substantial scalability by overlapping computation and communication.
arXiv Detail & Related papers (2024-08-26T10:11:56Z) - An Infrastructure Cost Optimised Algorithm for Partitioning of Microservices [20.638612359627952]
As migrating applications into the cloud is universally adopted by the software industry, have proven to be the most suitable and widely accepted architecture pattern for applications deployed on distributed cloud.
Their efficacy is enabled by both technical benefits like reliability, fault isolation, scalability and productivity benefits like ease of asset maintenance and clear ownership boundaries.
In some cases, the complexity of migrating an existing application into the architecture becomes overwhelmingly complex and expensive.
arXiv Detail & Related papers (2024-08-13T02:08:59Z) - Inference Optimization of Foundation Models on AI Accelerators [68.24450520773688]
Powerful foundation models, including large language models (LLMs), with Transformer architectures have ushered in a new era of Generative AI.
As the number of model parameters reaches to hundreds of billions, their deployment incurs prohibitive inference costs and high latency in real-world scenarios.
This tutorial offers a comprehensive discussion on complementary inference optimization techniques using AI accelerators.
arXiv Detail & Related papers (2024-07-12T09:24:34Z) - CARLOS: An Open, Modular, and Scalable Simulation Framework for the Development and Testing of Software for C-ITS [0.0]
We propose CARLOS - an open, modular, and scalable simulation framework for the development and testing of software in C-ITS.
We provide core building blocks for this framework and explain how it can be used and extended by the community.
In our paper, we motivate the architecture by describing important design principles and showcasing three major use cases.
arXiv Detail & Related papers (2024-04-02T10:48:36Z) - AgentScope: A Flexible yet Robust Multi-Agent Platform [66.64116117163755]
AgentScope is a developer-centric multi-agent platform with message exchange as its core communication mechanism.
The abundant syntactic tools, built-in agents and service functions, user-friendly interfaces for application demonstration and utility monitor, zero-code programming workstation, and automatic prompt tuning mechanism significantly lower the barriers to both development and deployment.
arXiv Detail & Related papers (2024-02-21T04:11:28Z) - OS-Copilot: Towards Generalist Computer Agents with Self-Improvement [48.29860831901484]
We introduce OS-Copilot, a framework to build generalist agents capable of interfacing with comprehensive elements in an operating system (OS)
We use OS-Copilot to create FRIDAY, a self-improving embodied agent for automating general computer tasks.
On GAIA, a general AI assistants benchmark, FRIDAY outperforms previous methods by 35%, showcasing strong generalization to unseen applications via accumulated skills from previous tasks.
arXiv Detail & Related papers (2024-02-12T07:29:22Z) - A microservice architecture for real-time IoT data processing: A
reusable Web of things approach for smart ports [4.612539452170667]
We propose a fully reusable microservice architecture, standardized through the use of the Web of things paradigm.
We present a fully reusable implementation of the architecture in the field of air quality monitoring and alerting smart ports.
arXiv Detail & Related papers (2024-01-27T11:40:38Z) - Serving Deep Learning Model in Relational Databases [70.53282490832189]
Serving deep learning (DL) models on relational data has become a critical requirement across diverse commercial and scientific domains.
We highlight three pivotal paradigms: The state-of-the-art DL-centric architecture offloads DL computations to dedicated DL frameworks.
The potential UDF-centric architecture encapsulates one or more tensor computations into User Defined Functions (UDFs) within the relational database management system (RDBMS)
arXiv Detail & Related papers (2023-10-07T06:01:35Z) - The Jaseci Programming Paradigm and Runtime Stack: Building Scale-out
Production Applications Easy and Fast [2.803752331206309]
We develop a novel co-designed runtime system, Jaseci, and programming language, Jac.
Key design principle is to move as much of the scale-out data management, microservice componentization, and live update complexity into the runtime stack to be automated and optimized automatically.
We use real-world AI applications to demonstrate Jaseci's benefit for application performance and developer productivity.
arXiv Detail & Related papers (2023-05-17T00:34:36Z) - ACE: Towards Application-Centric Edge-Cloud Collaborative Intelligence [14.379967483688834]
Intelligent applications based on machine learning are impacting many parts of our lives.
Current implementations running in the Cloud are unable to satisfy all these constraints.
The Edge-Cloud Collaborative Intelligence paradigm has become a popular approach to address such issues.
arXiv Detail & Related papers (2022-03-24T13:12:33Z) - A backend-agnostic, quantum-classical framework for simulations of
chemistry in C++ [62.997667081978825]
We present the XACC system-level quantum computing framework as a platform for prototyping, developing, and deploying quantum-classical software.
A series of examples demonstrating some of the state-of-the-art chemistry algorithms currently implemented in XACC are presented.
arXiv Detail & Related papers (2021-05-04T16:53:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.