Institutional Platform for Secure Self-Service Large Language Model Exploration

• URL: http://arxiv.org/abs/2402.00913v2
• Date: Mon, 23 Sep 2024 15:24:09 GMT
• Title: Institutional Platform for Secure Self-Service Large Language Model Exploration
• Authors: V. K. Cody Bumgardner, Mitchell A. Klusty, W. Vaiden Logan, Samuel E. Armstrong, Caylin Hickey, Jeff Talbert,
• Abstract summary: The paper outlines the system's architecture and key features, encompassing dataset curation, model training, secure inference, and text-based feature extraction. The platform strives to deliver secure LLM services, emphasizing process and data isolation, end-to-end encryption, and role-based resource authentication.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: This paper introduces a user-friendly platform developed by the University of Kentucky Center for Applied AI, designed to make large, customized language models (LLMs) more accessible. By capitalizing on recent advancements in multi-LoRA inference, the system efficiently accommodates custom adapters for a diverse range of users and projects. The paper outlines the system's architecture and key features, encompassing dataset curation, model training, secure inference, and text-based feature extraction. We illustrate the establishment of a tenant-aware computational network using agent-based methods, securely utilizing islands of isolated resources as a unified system. The platform strives to deliver secure LLM services, emphasizing process and data isolation, end-to-end encryption, and role-based resource authentication. This contribution aligns with the overarching goal of enabling simplified access to cutting-edge AI models and technology in support of scientific discovery.

Related papers

• Forging Spatial Intelligence: A Roadmap of Multi-Modal Data Pre-Training for Autonomous Systems [75.78934957242403]
  Self-driving vehicles and drones require true Spatial Intelligence from multi-modal onboard sensor data.<n>This paper presents a framework for multi-modal pre-training, identifying the core set of techniques driving progress toward this goal.
  arXiv  Detail & Related papers  (2025-12-30T17:58:01Z)
• AI4EOSC: a Federated Cloud Platform for Artificial Intelligence in Scientific Research [44.97138432029079]
  We describe a federated compute platform dedicated to support Artificial Intelligence in scientific workloads.<n>It delivers consistent, transparent access to a federation of physically distributed e-Infrastructures.<n>The platform is able to offer an integrated user experience covering the full Machine Learning lifecycle.
  arXiv  Detail & Related papers  (2025-12-18T12:20:31Z)
• Fetch.ai: An Architecture for Modern Multi-Agent Systems [10.4021644658645]
  Recent surges in LLM-driven intelligent systems largely overlook decades of foundational multi-agent systems (MAS) research.<n>Fetch.ai is an industrial-strength platform designed to bridge this gap by facilitating the integration of classical MAS principles with modern AI capabilities.<n>We present a novel, multi-layered solution built on a decentralized foundation of on-chain blockchain services for verifiable identity, discovery, and transactions.
  arXiv  Detail & Related papers  (2025-10-21T14:53:56Z)
• Context-Aware Visual Prompting: Automating Geospatial Web Dashboards with Large Language Models and Agent Self-Validation for Decision Support [1.506501956463029]
  Development of web-based dashboards for risk analysis and decision making often challenged by difficulty in big, multidimensional data.<n>We introduce a generative AI framework that automates the creation of interactive geospatial dashboards from user-defined inputs.
  arXiv  Detail & Related papers  (2025-10-10T10:58:15Z)
• A Survey on Cloud-Edge-Terminal Collaborative Intelligence in AIoT Networks [49.90474228895655]
  Cloud-edge-terminal collaborative intelligence (CETCI) is a fundamental paradigm within the artificial intelligence of things (AIoT) community.<n>CETCI has made significant progress with emerging AIoT applications, moving beyond isolated layer optimization to deployable collaborative intelligence systems.<n>This survey describes foundational architectures, enabling technologies, and scenarios of CETCI paradigms, offering a tutorial-style review for CISAIOT beginners.
  arXiv  Detail & Related papers  (2025-08-26T08:38:01Z)
• Capability-Driven Skill Generation with LLMs: A RAG-Based Approach for Reusing Existing Libraries and Interfaces [40.638726615548954]
  We present a method that treats capabilities as contracts for skill implementations and leverages large language models to generate code based on natural language user input.<n>A key feature of our approach is the integration of existing software libraries and interface technologies.<n>We introduce a framework that allows users to incorporate their own libraries and resource interfaces into the code generation process.
  arXiv  Detail & Related papers  (2025-05-06T08:27:04Z)
• Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey [59.52058740470727]
  Edge-cloud collaborative computing (ECCC) has emerged as a pivotal paradigm for addressing the computational demands of modern intelligent applications.<n>Recent advancements in AI, particularly deep learning and large language models (LLMs), have dramatically enhanced the capabilities of these distributed systems.<n>This survey provides a structured tutorial on fundamental architectures, enabling technologies, and emerging applications.
  arXiv  Detail & Related papers  (2025-05-03T13:55:38Z)
• Large Language Models for Base Station Siting: Intelligent Deployment based on Prompt or Agent [62.16747639440893]
  Large language models (LLMs) and their associated technologies advance, particularly in the realms of prompt engineering and agent engineering. This approach entails the strategic use of well-crafted prompts to infuse human experience and knowledge into these sophisticated LLMs. This integration represents the future paradigm of artificial intelligence (AI) as a service and AI for more ease.
  arXiv  Detail & Related papers  (2024-08-07T08:43:32Z)
• A Blueprint Architecture of Compound AI Systems for Enterprise [18.109450556443782]
  We introduce a blueprint architecture for compound AI systems to operate in enterprise settings cost-effectively and feasibly. Our proposed architecture aims for seamless integration with existing compute and data infrastructure, with stream'' serving as the key orchestration concept.
  arXiv  Detail & Related papers  (2024-06-02T01:16:32Z)
• LLMs as On-demand Customizable Service [8.440060524215378]
  We introduce a concept of hierarchical, distributed Large Language Models (LLMs) By introducing a "layered" approach, the proposed architecture enables on-demand accessibility to LLMs as a customizable service. We envision that the concept of hierarchical LLM will empower extensive, crowd-sourced user bases to harness the capabilities of LLMs.
  arXiv  Detail & Related papers  (2024-01-29T21:24:10Z)
• SimplyRetrieve: A Private and Lightweight Retrieval-Centric Generative AI Tool [0.14777718769290524]
  Large Language Model (LLM) based Generative AI systems have seen significant progress in recent years. Integrating a knowledge retrieval architecture allows for seamless integration of private data into publicly available Generative AI systems. Retrieval-Centric Generation (RCG) approach separates roles of LLMs and retrievers in context interpretation and knowledge memorization. SimplyRetrieve is an open-source tool with the goal of providing a localized, lightweight, and user-friendly interface to these sophisticated advancements.
  arXiv  Detail & Related papers  (2023-08-08T02:00:43Z)
• VEDLIoT -- Next generation accelerated AIoT systems and applications [4.964750143168832]
  The VEDLIoT project aims to develop energy-efficient Deep Learning methodologies for distributed Artificial Intelligence of Things (AIoT) applications. We propose a holistic approach that focuses on optimizing algorithms while addressing safety and security challenges inherent to AIoT systems.
  arXiv  Detail & Related papers  (2023-05-09T12:35:00Z)
• Developing an AI-enabled IIoT platform -- Lessons learned from early use case validation [47.37985501848305]
  We introduce the design of this platform and discuss an early evaluation in terms of a demonstrator for AI-enabled visual quality inspection. This is complemented by insights and lessons learned during this early evaluation activity.
  arXiv  Detail & Related papers  (2022-07-10T18:51:12Z)
• YMIR: A Rapid Data-centric Development Platform for Vision Applications [82.67319997259622]
  This paper introduces an open source platform for rapid development of computer vision applications. The platform puts the efficient data development at the center of the machine learning development process.
  arXiv  Detail & Related papers  (2021-11-19T05:02:55Z)
• Reconfigurable Intelligent Surface Assisted Mobile Edge Computing with Heterogeneous Learning Tasks [53.1636151439562]
  Mobile edge computing (MEC) provides a natural platform for AI applications. We present an infrastructure to perform machine learning tasks at an MEC with the assistance of a reconfigurable intelligent surface (RIS) Specifically, we minimize the learning error of all participating users by jointly optimizing transmit power of mobile users, beamforming vectors of the base station, and the phase-shift matrix of the RIS.
  arXiv  Detail & Related papers  (2020-12-25T07:08:50Z)
• Edge-assisted Democratized Learning Towards Federated Analytics [67.44078999945722]
  We show the hierarchical learning structure of the proposed edge-assisted democratized learning mechanism, namely Edge-DemLearn. We also validate Edge-DemLearn as a flexible model training mechanism to build a distributed control and aggregation methodology in regions.
  arXiv  Detail & Related papers  (2020-12-01T11:46:03Z)
• A Privacy-Preserving Distributed Architecture for Deep-Learning-as-a-Service [68.84245063902908]
  This paper introduces a novel distributed architecture for deep-learning-as-a-service. It is able to preserve the user sensitive data while providing Cloud-based machine and deep learning services.
  arXiv  Detail & Related papers  (2020-03-30T15:12:03Z)
• LIMITS: Lightweight Machine Learning for IoT Systems with Resource Limitations [8.647853543335662]
  We present the novel open source framework LIghtweight Machine learning for IoT Systems (LIMITS) LIMITS applies a platform-in-the-loop approach explicitly considering the actual compilation toolchain of the target IoT platform. We apply and validate LIMITS in two case studies focusing on cellular data rate prediction and radio-based vehicle classification.
  arXiv  Detail & Related papers  (2020-01-28T06:34:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.