The Jaseci Programming Paradigm and Runtime Stack: Building Scale-out Production Applications Easy and Fast

• URL: http://arxiv.org/abs/2305.09864v1
• Date: Wed, 17 May 2023 00:34:36 GMT
• Title: The Jaseci Programming Paradigm and Runtime Stack: Building Scale-out Production Applications Easy and Fast
• Authors: jason Mars, Yiping Kang, Roland Daynauth, Baichuan Li, Ashish Mahendra, Krisztian Flautner, Lingjia tang
• Abstract summary: We develop a novel co-designed runtime system, Jaseci, and programming language, Jac. Key design principle is to move as much of the scale-out data management, microservice componentization, and live update complexity into the runtime stack to be automated and optimized automatically. We use real-world AI applications to demonstrate Jaseci's benefit for application performance and developer productivity.
• Score: 2.803752331206309
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Today's production scale-out applications include many sub-application components, such as storage backends, logging infrastructure and AI models. These components have drastically different characteristics, are required to work in collaboration, and interface with each other as microservices. This leads to increasingly high complexity in developing, optimizing, configuring, and deploying scale-out applications, raising the barrier to entry for most individuals and small teams. We developed a novel co-designed runtime system, Jaseci, and programming language, Jac, which aims to reduce this complexity. The key design principle throughout Jaseci's design is to raise the level of abstraction by moving as much of the scale-out data management, microservice componentization, and live update complexity into the runtime stack to be automated and optimized automatically. We use real-world AI applications to demonstrate Jaseci's benefit for application performance and developer productivity.

Related papers

• Inference Optimization of Foundation Models on AI Accelerators [68.24450520773688]
  Powerful foundation models, including large language models (LLMs), with Transformer architectures have ushered in a new era of Generative AI. As the number of model parameters reaches to hundreds of billions, their deployment incurs prohibitive inference costs and high latency in real-world scenarios. This tutorial offers a comprehensive discussion on complementary inference optimization techniques using AI accelerators.
  arXiv  Detail & Related papers  (2024-07-12T09:24:34Z)
• CARLOS: An Open, Modular, and Scalable Simulation Framework for the Development and Testing of Software for C-ITS [0.0]
  We propose CARLOS - an open, modular, and scalable simulation framework for the development and testing of software in C-ITS. We provide core building blocks for this framework and explain how it can be used and extended by the community. In our paper, we motivate the architecture by describing important design principles and showcasing three major use cases.
  arXiv  Detail & Related papers  (2024-04-02T10:48:36Z)
• CARISMA: CAR-Integrated Service Mesh Architecture [0.9834663375961437]
  The amount of software in modern cars is increasing continuously with traditional electric/electronic (E/E) architectures reaching their limit. To mitigate this situation, more powerful computing platforms are being employed and applications are developed as distributed applications. We present an architecture applying the service mesh prototypical approach to automotive E/E platforms comprising multiple interlinked High-Performance Computers.
  arXiv  Detail & Related papers  (2024-03-07T10:10:34Z)
• AgentScope: A Flexible yet Robust Multi-Agent Platform [66.64116117163755]
  AgentScope is a developer-centric multi-agent platform with message exchange as its core communication mechanism. The abundant syntactic tools, built-in agents and service functions, user-friendly interfaces for application demonstration and utility monitor, zero-code programming workstation, and automatic prompt tuning mechanism significantly lower the barriers to both development and deployment.
  arXiv  Detail & Related papers  (2024-02-21T04:11:28Z)
• CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets [75.64181719386497]
  We present CRAFT, a tool creation and retrieval framework for large language models (LLMs) It creates toolsets specifically curated for the tasks and equips LLMs with a component that retrieves tools from these sets to enhance their capability to solve complex tasks. Our method is designed to be flexible and offers a plug-and-play approach to adapt off-the-shelf LLMs to unseen domains and modalities, without any finetuning.
  arXiv  Detail & Related papers  (2023-09-29T17:40:26Z)
• Multi-Agent Reinforcement Learning for Microprocessor Design Space Exploration [71.95914457415624]
  Microprocessor architects are increasingly resorting to domain-specific customization in the quest for high-performance and energy-efficiency. We propose an alternative formulation that leverages Multi-Agent RL (MARL) to tackle this problem. Our evaluation shows that the MARL formulation consistently outperforms single-agent RL baselines.
  arXiv  Detail & Related papers  (2022-11-29T17:10:24Z)
• The Case for a Wholistic Serverless Programming Paradigm and Full Stack Automation for AI and Beyond -- The Philosophy of Jaseci and Jac [2.466612244988994]
  We re-envision the system stack from the programming language level down through the system architecture to bridge this complexity gap. The key goal of our design is to address the critical need for the programmer to articulate solutions with higher level abstractions at the problem level. This work also presents the design of a production-grade realization of such a system stack architecture called Jaseci, and corresponding programming language Jac.
  arXiv  Detail & Related papers  (2022-06-16T20:28:37Z)
• Composing Complex and Hybrid AI Solutions [52.00820391621739]
  We describe an extension of the Acumos system towards enabling the above features for general AI applications. Our extensions include support for more generic components with gRPC/Protobuf interfaces. We provide examples of deployable solutions and their interfaces.
  arXiv  Detail & Related papers  (2022-02-25T08:57:06Z)
• YMIR: A Rapid Data-centric Development Platform for Vision Applications [82.67319997259622]
  This paper introduces an open source platform for rapid development of computer vision applications. The platform puts the efficient data development at the center of the machine learning development process.
  arXiv  Detail & Related papers  (2021-11-19T05:02:55Z)
• iPaaS in Agriculture 4.0: An Industrial Case [0.0]
  We propose a generic i architecture based on several open source solutions boasting integration, interoperability, and automated decision-making capabilities. A proof-of-concept based on these solutions is presented, as well as a case study on MA"ISADOUR's grain storage process with a comparison with the currently human-operated tasks.
  arXiv  Detail & Related papers  (2020-10-08T07:52:37Z)
• Workflow Automation for Cyber Physical System Development Processes [1.6735240552964108]
  Development of Cyber Physical Systems (CPSs) requires close interaction between developers with expertise in many domains. We introduce a workflow modeling language for the automation of complex CPS development processes. We implement a platform for execution of these models in the Assurance-based Learning-enabled CPS Toolchain.
  arXiv  Detail & Related papers  (2020-04-12T17:32:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.