Foundation Model Engineering: Engineering Foundation Models Just as Engineering Software

• URL: http://arxiv.org/abs/2407.08176v1
• Date: Thu, 11 Jul 2024 04:40:02 GMT
• Title: Foundation Model Engineering: Engineering Foundation Models Just as Engineering Software
• Authors: Dezhi Ran, Mengzhou Wu, Wei Yang, Tao Xie,
• Abstract summary: Foundation Models (FMs) become a new type of software by treating data and models as the source code. We outline our vision of introducing Foundation Model (FM) engineering, a strategic response to the anticipated FM crisis.
• Score: 8.14005646330662
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: By treating data and models as the source code, Foundation Models (FMs) become a new type of software. Mirroring the concept of software crisis, the increasing complexity of FMs making FM crisis a tangible concern in the coming decade, appealing for new theories and methodologies from the field of software engineering. In this paper, we outline our vision of introducing Foundation Model (FM) engineering, a strategic response to the anticipated FM crisis with principled engineering methodologies. FM engineering aims to mitigate potential issues in FM development and application through the introduction of declarative, automated, and unified programming interfaces for both data and model management, reducing the complexities involved in working with FMs by providing a more structured and intuitive process for developers. Through the establishment of FM engineering, we aim to provide a robust, automated, and extensible framework that addresses the imminent challenges, and discovering new research opportunities for the software engineering field.

Related papers

• The Fusion of Large Language Models and Formal Methods for Trustworthy AI Agents: A Roadmap [12.363424584297974]
  This paper outlines a roadmap for advancing the next generation of trustworthy AI systems. We show how FMs can help LLMs generate more reliable and formally certified outputs. We acknowledge that this integration has the potential to enhance both the trustworthiness and efficiency of software engineering practices.
  arXiv  Detail & Related papers  (2024-12-09T14:14:21Z)
• Software Performance Engineering for Foundation Model-Powered Software (FMware) [6.283211168007636]
  Foundation Models (FMs) like Large Language Models (LLMs) are revolutionizing software development. This paper highlights the significance of Software Performance Engineering (SPE) in FMware. We identify four key challenges: cognitive architecture design, communication protocols, tuning and optimization, and deployment.
  arXiv  Detail & Related papers  (2024-11-14T16:42:19Z)
• From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap [12.313710667597897]
  We conduct a semi-structured thematic synthesis to identify the key challenges in productionizing FMware across diverse data sources. We identify critical issues in FM selection, data and model alignment, prompt engineering, agent orchestration, system testing, and deployment. We discuss needed technologies and strategies to address these challenges and offer guidance on how to enable the transition from demonstration systems to scalable, production-ready FMware solutions.
  arXiv  Detail & Related papers  (2024-10-28T07:16:00Z)
• Foundation Models for the Electric Power Grid [53.02072064670517]
  Foundation models (FMs) currently dominate news headlines. We argue that an FM learning from diverse grid data and topologies could unlock transformative capabilities. We discuss a power grid FM concept, namely GridFM, based on graph neural networks and show how different downstream tasks benefit.
  arXiv  Detail & Related papers  (2024-07-12T17:09:47Z)
• Rethinking Software Engineering in the Foundation Model Era: A Curated Catalogue of Challenges in the Development of Trustworthy FMware [13.21876203209586]
  We identify 10 key SE4FMware challenges that have caused enterprise FMware development to be unproductive, costly, and risky. We present FMArts, which is our long-term effort towards creating a cradle-to-grave platform for the engineering of trustworthy FMware.
  arXiv  Detail & Related papers  (2024-02-25T00:53:16Z)
• Progress and Opportunities of Foundation Models in Bioinformatics [77.74411726471439]
  Foundations models (FMs) have ushered in a new era in computational biology, especially in the realm of deep learning. Central to our focus is the application of FMs to specific biological problems, aiming to guide the research community in choosing appropriate FMs for their research needs. Review analyses challenges and limitations faced by FMs in biology, such as data noise, model explainability, and potential biases.
  arXiv  Detail & Related papers  (2024-02-06T02:29:17Z)
• Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities [59.02391344178202]
  Vision foundation models (VFMs) serve as potent building blocks for a wide range of AI applications. The scarcity of comprehensive training data, the need for multi-sensor integration, and the diverse task-specific architectures pose significant obstacles to the development of VFMs. This paper delves into the critical challenge of forging VFMs tailored specifically for autonomous driving, while also outlining future directions.
  arXiv  Detail & Related papers  (2024-01-16T01:57:24Z)
• A Survey on Efficient Federated Learning Methods for Foundation Model Training [62.473245910234304]
  Federated Learning (FL) has become an established technique to facilitate privacy-preserving collaborative training across a multitude of clients. In the wake of Foundation Models (FM), the reality is different for many deep learning applications. We discuss the benefits and drawbacks of parameter-efficient fine-tuning (PEFT) for FL applications.
  arXiv  Detail & Related papers  (2024-01-09T10:22:23Z)
• Learning from models beyond fine-tuning [78.20895343699658]
  Learn From Model (LFM) focuses on the research, modification, and design of foundation models (FM) based on the model interface. The study of LFM techniques can be broadly categorized into five major areas: model tuning, model distillation, model reuse, meta learning and model editing. This paper gives a comprehensive review of the current methods based on FM from the perspective of LFM.
  arXiv  Detail & Related papers  (2023-10-12T10:20:36Z)
• The Role of Federated Learning in a Wireless World with Foundation Models [59.8129893837421]
  Foundation models (FMs) are general-purpose artificial intelligence (AI) models that have recently enabled multiple brand-new generative AI applications. Currently, the exploration of the interplay between FMs and federated learning (FL) is still in its nascent stage. This article explores the extent to which FMs are suitable for FL over wireless networks, including a broad overview of research challenges and opportunities.
  arXiv  Detail & Related papers  (2023-10-06T04:13:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.