Developing and Operating Artificial Intelligence Models in Trustworthy Autonomous Systems

• URL: http://arxiv.org/abs/2003.05434v2
• Date: Fri, 23 Apr 2021 09:21:38 GMT
• Title: Developing and Operating Artificial Intelligence Models in Trustworthy Autonomous Systems
• Authors: Silverio Mart\'inez-Fern\'andez, Xavier Franch, Andreas Jedlitschka, Marc Oriol, and Adam Trendowicz
• Abstract summary: This work-in-progress paper aims to close the gap between the development and operation of AI-based AS. We propose a novel, holistic DevOps approach to put it into practice.
• Score: 8.27310353898034
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Companies dealing with Artificial Intelligence (AI) models in Autonomous Systems (AS) face several problems, such as users' lack of trust in adverse or unknown conditions, gaps between software engineering and AI model development, and operation in a continuously changing operational environment. This work-in-progress paper aims to close the gap between the development and operation of trustworthy AI-based AS by defining an approach that coordinates both activities. We synthesize the main challenges of AI-based AS in industrial settings. We reflect on the research efforts required to overcome these challenges and propose a novel, holistic DevOps approach to put it into practice. We elaborate on four research directions: (a) increased users' trust by monitoring operational AI-based AS and identifying self-adaptation needs in critical situations; (b) integrated agile process for the development and evolution of AI models and AS; (c) continuous deployment of different context-specific instances of AI models in a distributed setting of AS; and (d) holistic DevOps-based lifecycle for AI-based AS.

Related papers

• Intelligent Mobile AI-Generated Content Services via Interactive Prompt Engineering and Dynamic Service Provisioning [55.641299901038316]
  AI-generated content can organize collaborative Mobile AIGC Service Providers (MASPs) at network edges to provide ubiquitous and customized content for resource-constrained users. Such a paradigm faces two significant challenges: 1) raw prompts often lead to poor generation quality due to users' lack of experience with specific AIGC models, and 2) static service provisioning fails to efficiently utilize computational and communication resources. We develop an interactive prompt engineering mechanism that leverages a Large Language Model (LLM) to generate customized prompt corpora and employs Inverse Reinforcement Learning (IRL) for policy imitation.
  arXiv  Detail & Related papers  (2025-02-17T03:05:20Z)
• Transforming the Hybrid Cloud for Emerging AI Workloads [81.15269563290326]
  This white paper envisions transforming hybrid cloud systems to meet the growing complexity of AI workloads. The proposed framework addresses critical challenges in energy efficiency, performance, and cost-effectiveness. This joint initiative aims to establish hybrid clouds as secure, efficient, and sustainable platforms.
  arXiv  Detail & Related papers  (2024-11-20T11:57:43Z)
• EARBench: Towards Evaluating Physical Risk Awareness for Task Planning of Foundation Model-based Embodied AI Agents [53.717918131568936]
  Embodied artificial intelligence (EAI) integrates advanced AI models into physical entities for real-world interaction. Foundation models as the "brain" of EAI agents for high-level task planning have shown promising results. However, the deployment of these agents in physical environments presents significant safety challenges. This study introduces EARBench, a novel framework for automated physical risk assessment in EAI scenarios.
  arXiv  Detail & Related papers  (2024-08-08T13:19:37Z)
• Integrating Artificial Intelligence into Operating Systems: A Comprehensive Survey on Techniques, Applications, and Future Directions [16.28550500194823]
  fusion of Artificial Intelligence with Operating Systems emerges as a critical frontier for innovation. Current status of AI-OS integration, accentuating its pivotal role in steering the evolution of advanced computing paradigms. Future prospects of Intelligent Operating Systems, debating how groundbreaking OS designs will usher in novel possibilities.
  arXiv  Detail & Related papers  (2024-07-19T05:29:34Z)
• Science based AI model certification for new operational environments with application in traffic state estimation [1.2186759689780324]
  The expanding role of Artificial Intelligence (AI) in diverse engineering domains highlights the challenges associated with deploying AI models in new operational environments. This paper proposes a science-based certification methodology to assess the viability of employing pre-trained data-driven models in new operational environments.
  arXiv  Detail & Related papers  (2024-05-13T16:28:00Z)
• Science based AI model certification for untrained operational environments with application in traffic state estimation [1.2186759689780324]
  The expanding role of Artificial Intelligence (AI) in diverse engineering domains highlights the challenges associated with deploying AI models in new operational environments. This paper proposes a science-based certification methodology to assess the viability of employing pre-trained data-driven models in untrained operational environments.
  arXiv  Detail & Related papers  (2024-03-21T03:01:25Z)
• Position Paper: Agent AI Towards a Holistic Intelligence [53.35971598180146]
  We emphasize developing Agent AI -- an embodied system that integrates large foundation models into agent actions. In this paper, we propose a novel large action model to achieve embodied intelligent behavior, the Agent Foundation Model.
  arXiv  Detail & Related papers  (2024-02-28T16:09:56Z)
• Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairness [53.91018508439669]
  The study explores the complexities of integrating Artificial Intelligence into Autonomous Vehicles (AVs) It examines the challenges introduced by AI components and the impact on testing procedures. The paper identifies significant challenges and suggests future directions for research and development of AI in AV technology.
  arXiv  Detail & Related papers  (2024-02-21T08:29:42Z)
• A Vision for Operationalising Diversity and Inclusion in AI [5.4897262701261225]
  This study seeks to envision the operationalization of the ethical imperatives of diversity and inclusion (D&I) within AI ecosystems. A significant challenge in AI development is the effective operationalization of D&I principles. This paper proposes a vision of a framework for developing a tool utilizing persona-based simulation by Generative AI (GenAI)
  arXiv  Detail & Related papers  (2023-12-11T02:44:39Z)
• Enabling Automated Machine Learning for Model-Driven AI Engineering [60.09869520679979]
  We propose a novel approach to enable Model-Driven Software Engineering and Model-Driven AI Engineering. In particular, we support Automated ML, thus assisting software engineers without deep AI knowledge in developing AI-intensive systems.
  arXiv  Detail & Related papers  (2022-03-06T10:12:56Z)
• Proceedings of the Robust Artificial Intelligence System Assurance (RAISA) Workshop 2022 [0.0]
  The RAISA workshop will focus on research, development and application of robust artificial intelligence (AI) and machine learning (ML) systems. Rather than studying robustness with respect to particular ML algorithms, our approach will be to explore robustness assurance at the system architecture level.
  arXiv  Detail & Related papers  (2022-02-10T01:15:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.