Multi-tenant Kubernetes Use Cases for AI, Secure Computing and Data Services, and More

• URL: http://arxiv.org/abs/2608.00742v1
• Date: Sat, 01 Aug 2026 16:24:11 GMT
• Title: Multi-tenant Kubernetes Use Cases for AI, Secure Computing and Data Services, and More
• Abstract summary: container orchestration engine widely used in cloud-native ecosystems for several years.<n> increasing diversity of use cases such as AI, secure and confidential computing for sensitive data, and mixed workload orchestration.<n>We evaluate a deployment on a Hewlett Packard Enterprise (HPE) Cray EX supercomputer with interconnect, called Isambard-AI, with co-design use cases.
• Score: 0.3250512744763587
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Kubernetes, as a container orchestration engine, has been widely used in cloud-native ecosystems for several years. In supercomputing ecosystems, especially where bare-metal performance for compute and network devices are considered, the adoption is somewhat limited. However, with the increasing diversity of use cases such as AI, secure and confidential computing for sensitive data, and mixed workload orchestration, a traditional, single-tenant batch computing system does not offer the flexibility and reproducibility to which public cloud users are accustomed. Note that Kubernetes is not considered a replacement for batch scheduling systems, which have powerful features for large-scale MPI jobs with thousands of network end points. Rather, it is a complementary service provided as part of a national AI Research Resource. We evaluate Kubernetes deployment on a Hewlett Packard Enterprise (HPE) Cray EX supercomputerwith HPE Slingshot interconnect, called Isambard-AI, with co-design use cases. One is a Trusted Research Environment used for medical and health sciences. The other combines KubeRay, Ray, and vLLM to provide a distributed, sandboxed, persistent AI model hosting service targeting multi-tenant confidential computing. We discuss challenges and lessons learned, and where further development is needed to offer a production Kubernetes-as-a-Service on HPE Cray EX (and later) platforms.

Related papers

• iOS as Acceleration [51.56484100374058]
  We present a proof-of-concept system demonstrating a novel approach to harness an iOS device via distributed pipeline parallelism.<n>The findings of this paper highlight the potential for the improving commonplace mobile devices to provide greater contributions to machine learning.
  arXiv  Detail & Related papers  (2025-12-19T13:30:44Z)
• A Survey on Cloud-Edge-Terminal Collaborative Intelligence in AIoT Networks [49.90474228895655]
  Cloud-edge-terminal collaborative intelligence (CETCI) is a fundamental paradigm within the artificial intelligence of things (AIoT) community.<n>CETCI has made significant progress with emerging AIoT applications, moving beyond isolated layer optimization to deployable collaborative intelligence systems.<n>This survey describes foundational architectures, enabling technologies, and scenarios of CETCI paradigms, offering a tutorial-style review for CISAIOT beginners.
  arXiv  Detail & Related papers  (2025-08-26T08:38:01Z)
• Apple Intelligence Foundation Language Models: Tech Report 2025 [230.86919268176976]
  We introduce two foundation language models that power Apple Intelligence features across Apple devices and services.<n>Both models are trained on large-scale multilingual and multimodal datasets sourced via responsible web crawling.<n>A new Swift-centric Foundation Models framework exposes guided generation, constrained tool calling, and LoRA adapter fine-tuning.
  arXiv  Detail & Related papers  (2025-07-17T23:37:19Z)
• A Scalable Clustered Architecture for Cyber-Physical Systems [0.0]
  Cyber-Physical Systems (CPS) play a vital role in the operation of interconnected systems. CPS integrates physical and software components capable of sensing, monitoring, and controlling physical assets and processes. The development of this project aims to contribute to the design and implementation of a solution to the CPS challenges.
  arXiv  Detail & Related papers  (2024-07-08T13:37:00Z)
• OS-Copilot: Towards Generalist Computer Agents with Self-Improvement [48.29860831901484]
  We introduce OS-Copilot, a framework to build generalist agents capable of interfacing with comprehensive elements in an operating system (OS) We use OS-Copilot to create FRIDAY, a self-improving embodied agent for automating general computer tasks. On GAIA, a general AI assistants benchmark, FRIDAY outperforms previous methods by 35%, showcasing strong generalization to unseen applications via accumulated skills from previous tasks.
  arXiv  Detail & Related papers  (2024-02-12T07:29:22Z)
• HasTEE+ : Confidential Cloud Computing and Analytics with Haskell [50.994023665559496]
  Confidential computing enables the protection of confidential code and data in a co-tenanted cloud deployment using specialized hardware isolation units called Trusted Execution Environments (TEEs) TEEs offer low-level C/C++-based toolchains that are susceptible to inherent memory safety vulnerabilities and lack language constructs to monitor explicit and implicit information-flow leaks. We address the above with HasTEE+, a domain-specific language (cla) embedded in Haskell that enables programming TEEs in a high-level language with strong type-safety.
  arXiv  Detail & Related papers  (2024-01-17T00:56:23Z)
• RobotKube: Orchestrating Large-Scale Cooperative Multi-Robot Systems with Kubernetes and ROS [0.0]
  We present RobotKube, an approach to orchestrating a large-scale cooperative multi-robot system as a whole. We present two main components of such a system: an event detector capable of, e.g., requesting the deployment of additional applications, and an application manager capable of automatically configuring the required changes in the cluster. By combining the widely adopted platform with the Robot Operating System, we enable the use of standard tools and practices for developing, deploying, scaling, and monitoring in CITS.
  arXiv  Detail & Related papers  (2023-08-14T10:27:20Z)
• Auto-Split: A General Framework of Collaborative Edge-Cloud AI [49.750972428032355]
  This paper describes the techniques and engineering practice behind Auto-Split, an edge-cloud collaborative prototype of Huawei Cloud. To the best of our knowledge, there is no existing industry product that provides the capability of Deep Neural Network (DNN) splitting.
  arXiv  Detail & Related papers  (2021-08-30T08:03:29Z)
• Machine Learning Algorithms for Active Monitoring of High Performance Computing as a Service (HPCaaS) Cloud Environments [0.0]
  This paper explores the viability of engineering applications running on a cloud infrastructure configured as an HPC platform. The engineering applications considered in this work include MCNP6, a radiation transport code developed by Los Alamos National Laboratory, OpenFOAM, an open source computational fluid dynamics code, and CADONFS, a numerical implementation of the general number field sieve algorithm used for prime number factorization.
  arXiv  Detail & Related papers  (2020-09-26T01:29:19Z)
• KubeEdge.AI: AI Platform for Edge Devices [4.337396433660794]
  KubeEdge.AI is an edge AI framework on top of KubeEdge. It provides a set of key modules and interfaces: a data handling and processing engine, a concise AI runtime, a decision engine, and a distributed data query interface.
  arXiv  Detail & Related papers  (2020-07-07T23:36:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.