Platform for Situated Intelligence

• URL: http://arxiv.org/abs/2103.15975v1
• Date: Mon, 29 Mar 2021 22:30:15 GMT
• Title: Platform for Situated Intelligence
• Authors: Dan Bohus, Sean Andrist, Ashley Feniello, Nick Saw, Mihai Jalobeanu, Patrick Sweeney, Anne Loomis Thompson, Eric Horvitz
• Abstract summary: We introduce Platform for Situated Intelligence, an open-source framework created to support the rapid development and study of multimodal, integrative-AI systems. The framework provides infrastructure for sensing, fusing, and making inferences from temporal streams of data across different modalities.
• Score: 19.208956579428296
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We introduce Platform for Situated Intelligence, an open-source framework created to support the rapid development and study of multimodal, integrative-AI systems. The framework provides infrastructure for sensing, fusing, and making inferences from temporal streams of data across different modalities, a set of tools that enable visualization and debugging, and an ecosystem of components that encapsulate a variety of perception and processing technologies. These assets jointly provide the means for rapidly constructing and refining multimodal, integrative-AI systems, while retaining the efficiency and performance characteristics required for deployment in open-world settings.

Related papers

• Estuary: A Framework For Building Multimodal Low-Latency Real-Time Socially Interactive Agents [0.4711628883579317]
  Estuary is a framework for the development of low-latency, real-time Socially Interactive Agents. It can be run entirely off-cloud to maximize configurability, controllability, of studies, and speed of agent response times.
  arXiv  Detail & Related papers  (2024-10-26T08:08:12Z)
• A Blueprint Architecture of Compound AI Systems for Enterprise [18.109450556443782]
  We introduce a blueprint architecture for compound AI systems to operate in enterprise settings cost-effectively and feasibly. Our proposed architecture aims for seamless integration with existing compute and data infrastructure, with stream'' serving as the key orchestration concept.
  arXiv  Detail & Related papers  (2024-06-02T01:16:32Z)
• An Interactive Agent Foundation Model [49.77861810045509]
  We propose an Interactive Agent Foundation Model that uses a novel multi-task agent training paradigm for training AI agents. Our training paradigm unifies diverse pre-training strategies, including visual masked auto-encoders, language modeling, and next-action prediction. We demonstrate the performance of our framework across three separate domains -- Robotics, Gaming AI, and Healthcare.
  arXiv  Detail & Related papers  (2024-02-08T18:58:02Z)
• Institutional Platform for Secure Self-Service Large Language Model Exploration [0.0]
  The paper outlines the system's architecture and key features, encompassing dataset curation, model training, secure inference, and text-based feature extraction. The platform strives to deliver secure LLM services, emphasizing process and data isolation, end-to-end encryption, and role-based resource authentication.
  arXiv  Detail & Related papers  (2024-02-01T10:58:10Z)
• UnifiedVisionGPT: Streamlining Vision-Oriented AI through Generalized Multimodal Framework [51.01581167257862]
  UnifiedVisionGPT is a novel framework designed to consolidate and automate the integration of SOTA vision models. This paper outlines the architecture and capabilities of UnifiedVisionGPT, demonstrating its potential to revolutionize the field of computer vision.
  arXiv  Detail & Related papers  (2023-11-16T13:01:25Z)
• Distributed intelligence on the Edge-to-Cloud Continuum: A systematic literature review [62.997667081978825]
  This review aims at providing a comprehensive vision of the main state-of-the-art libraries and frameworks for machine learning and data analytics available today. The main simulation, emulation, deployment systems, and testbeds for experimental research on the Edge-to-Cloud Continuum available today are also surveyed.
  arXiv  Detail & Related papers  (2022-04-29T08:06:05Z)
• Unified Structure Generation for Universal Information Extraction [58.89057387608414]
  UIE can universally model different IE tasks, adaptively generate targeted structures, and collaboratively learn general IE abilities from different knowledge sources. Experiments show that UIE achieved the state-of-the-art performance on 4 IE tasks, 13 datasets, and on all supervised, low-resource, and few-shot settings.
  arXiv  Detail & Related papers  (2022-03-23T08:49:29Z)
• YMIR: A Rapid Data-centric Development Platform for Vision Applications [82.67319997259622]
  This paper introduces an open source platform for rapid development of computer vision applications. The platform puts the efficient data development at the center of the machine learning development process.
  arXiv  Detail & Related papers  (2021-11-19T05:02:55Z)
• Modular approach to data preprocessing in ALOHA and application to a smart industry use case [0.0]
  The paper addresses a modular approach, integrated into the ALOHA tool flow, to support the data preprocessing and transformation pipeline. To demonstrate the effectiveness of the approach, we present some experimental results related to a keyword spotting use case.
  arXiv  Detail & Related papers  (2021-02-02T06:48:51Z)
• Edge-assisted Democratized Learning Towards Federated Analytics [67.44078999945722]
  We show the hierarchical learning structure of the proposed edge-assisted democratized learning mechanism, namely Edge-DemLearn. We also validate Edge-DemLearn as a flexible model training mechanism to build a distributed control and aggregation methodology in regions.
  arXiv  Detail & Related papers  (2020-12-01T11:46:03Z)
• Accelerating the Development of Multimodal, Integrative-AI Systems with Platform for Situated Intelligence [1.595445991573573]
  We describe Platform for Situated Intelligence, an open-source framework for multimodal, integrative-AI systems. We provide a brief, high-level overview of the framework and its main affordances, and discuss its implications for HRI.
  arXiv  Detail & Related papers  (2020-10-12T23:53:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.