A Reference Architecture for Designing Foundation Model based Systems

• URL: http://arxiv.org/abs/2304.11090v5
• Date: Tue, 16 Jul 2024 08:35:43 GMT
• Title: A Reference Architecture for Designing Foundation Model based Systems
• Authors: Qinghua Lu, Liming Zhu, Xiwei Xu, Zhenchang Xing, Jon Whittle,
• Abstract summary: There is a broad consensus that foundations models will be the fundamental building blocks for future AI systems. incorporating foundations models into AI systems raises significant concerns about responsible and safe AI. The paper proposes a pattern-oriented reference architecture for designing responsible foundation-model-based systems.
• Score: 28.826700360670515
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The release of ChatGPT, Gemini, and other large language model has drawn huge interests on foundations models. There is a broad consensus that foundations models will be the fundamental building blocks for future AI systems. However, there is a lack of systematic guidance on the architecture design. Particularly, the the rapidly growing capabilities of foundations models can eventually absorb other components of AI systems, posing challenges of moving boundary and interface evolution in architecture design. Furthermore, incorporating foundations models into AI systems raises significant concerns about responsible and safe AI due to their opaque nature and rapidly advancing intelligence. To address these challenges, the paper first presents an architecture evolution of AI systems in the era of foundation models, transitioning from "foundation-model-as-a-connector" to "foundation-model-as-a-monolithic architecture". The paper then identifies key design decisions and proposes a pattern-oriented reference architecture for designing responsible foundation-model-based systems. The patterns can enable the potential of foundation models while ensuring associated risks.

Related papers

• A Taxonomy of Architecture Options for Foundation Model-based Agents: Analysis and Decision Model [25.78239568393706]
  This paper introduces a taxonomy focused on the architectures of foundation-model-based agents. By unifying and detailing these classifications, our taxonomy aims to improve the design of foundation-model-based agents.
  arXiv  Detail & Related papers  (2024-08-06T03:10:52Z)
• Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agents [22.94671478021277]
  Foundation model-enabled generative artificial intelligence facilitates the development and implementation of agents. There is a lack of systematic knowledge to guide practitioners in designing the agents. We present a pattern catalogue consisting of 18 architectural patterns with analyses of the context, forces, and trade-offs.
  arXiv  Detail & Related papers  (2024-05-16T23:24:48Z)
• Generative AI Models for Different Steps in Architectural Design: A Literature Review [14.910709576423576]
  It is essential to comprehend the principles and advancements of generative AI models and analyze their relevance in architecture applications. This paper first provides an overview of generative AI technologies, with a focus on probabilistic diffusion models (DDPMs), 3D generative models, and foundation models. We subdivide the architectural design process into six steps and review related research projects in each step from 2020 to the present.
  arXiv  Detail & Related papers  (2024-03-30T13:25:11Z)
• Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agents [28.406492378232695]
  Foundation model based agents derive their autonomy from the capabilities of foundation models. This paper presents a pattern-oriented reference architecture that serves as guidance when designing foundation model based agents.
  arXiv  Detail & Related papers  (2023-11-22T04:21:47Z)
• A Taxonomy of Foundation Model based Systems through the Lens of Software Architecture [35.20191493188642]
  We propose a taxonomy of foundation model based systems, which classifies and compares the characteristics of foundation models and design options. Our taxonomy comprises three categories: the pretraining and adaptation of foundation models, the architecture design of foundation model based systems, and responsible-AI-by-design.
  arXiv  Detail & Related papers  (2023-05-09T11:37:16Z)
• Kernel Based Cognitive Architecture for Autonomous Agents [91.3755431537592]
  This paper considers an evolutionary approach to creating a cognitive functionality. We consider a cognitive architecture which ensures the evolution of the agent on the basis of Symbol Emergence Problem solution.
  arXiv  Detail & Related papers  (2022-07-02T12:41:32Z)
• MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning [50.40151403246205]
  Huge language models (LMs) have ushered in a new era for AI, serving as a gateway to natural-language-based knowledge tasks. We define a flexible architecture with multiple neural models, complemented by discrete knowledge and reasoning modules. We describe this neuro-symbolic architecture, dubbed the Modular Reasoning, Knowledge and Language (MRKL) system.
  arXiv  Detail & Related papers  (2022-05-01T11:01:28Z)
• On the Opportunities and Risks of Foundation Models [256.61956234436553]
  We call these models foundation models to underscore their critically central yet incomplete character. This report provides a thorough account of the opportunities and risks of foundation models. To tackle these questions, we believe much of the critical research on foundation models will require deep interdisciplinary collaboration.
  arXiv  Detail & Related papers  (2021-08-16T17:50:08Z)
• Towards a Predictive Processing Implementation of the Common Model of Cognition [79.63867412771461]
  We describe an implementation of the common model of cognition grounded in neural generative coding and holographic associative memory. The proposed system creates the groundwork for developing agents that learn continually from diverse tasks as well as model human performance at larger scales.
  arXiv  Detail & Related papers  (2021-05-15T22:55:23Z)
• Model-Based Machine Learning for Communications [110.47840878388453]
  We review existing strategies for combining model-based algorithms and machine learning from a high level perspective. We focus on symbol detection, which is one of the fundamental tasks of communication receivers.
  arXiv  Detail & Related papers  (2021-01-12T19:55:34Z)
• Towards an Interface Description Template for AI-enabled Systems [77.34726150561087]
  Reuse is a common system architecture approach that seeks to instantiate a system architecture with existing components. There is currently no framework that guides the selection of necessary information to assess their portability to operate in a system different than the one for which the component was originally purposed. We present ongoing work on establishing an interface description template that captures the main information of an AI-enabled component.
  arXiv  Detail & Related papers  (2020-07-13T20:30:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.