Designing Secure AI-based Systems: a Multi-Vocal Literature Review

• URL: http://arxiv.org/abs/2407.18584v1
• Date: Fri, 26 Jul 2024 08:04:05 GMT
• Title: Designing Secure AI-based Systems: a Multi-Vocal Literature Review
• Authors: Simon Schneider, Ananya Saha, Emanuele Mezzi, Katja Tuma, Riccardo Scandariato,
• Abstract summary: We present 16 architectural security guidelines for the design of AI-based systems. The guidelines could support practitioners with actionable advice on the secure development of AI-based systems.
• Score: 5.799668199535053
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: AI-based systems leverage recent advances in the field of AI/ML by combining traditional software systems with AI components. Applications are increasingly being developed in this way. Software engineers can usually rely on a plethora of supporting information on how to use and implement any given technology. For AI-based systems, however, such information is scarce. Specifically, guidance on how to securely design the architecture is not available to the extent as for other systems. We present 16 architectural security guidelines for the design of AI-based systems that were curated via a multi-vocal literature review. The guidelines could support practitioners with actionable advice on the secure development of AI-based systems. Further, we mapped the guidelines to typical components of AI-based systems and observed a high coverage where 6 out of 8 generic components have at least one guideline associated to them.

Related papers

• PADTHAI-MM: A Principled Approach for Designing Trustable, Human-centered AI systems using the MAST Methodology [5.38932801848643]
  The Multisource AI Scorecard Table (MAST), a checklist rating system, addresses this gap in designing and evaluating AI-enabled decision support systems. We propose the Principled Approach for Designing Trustable Human-centered AI systems using MAST methodology. We show that MAST-guided design can improve trust perceptions, and that MAST criteria can be linked to performance, process, and purpose information.
  arXiv  Detail & Related papers  (2024-01-24T23:15:44Z)
• A Graphical Modeling Language for Artificial Intelligence Applications in Automation Systems [69.50862982117127]
  An interdisciplinary graphical modeling language that enables the modeling of an AI application as an overall system comprehensible to all disciplines does not yet exist. This paper presents a graphical modeling language that enables consistent and understandable modeling of AI applications in automation systems at system level.
  arXiv  Detail & Related papers  (2023-06-20T12:06:41Z)
• Core and Periphery as Closed-System Precepts for Engineering General Intelligence [62.997667081978825]
  It is unclear if an AI system's inputs will be independent of its outputs, and, therefore, if AI systems can be treated as traditional components. This paper posits that engineering general intelligence requires new general systems precepts, termed the core and periphery.
  arXiv  Detail & Related papers  (2022-08-04T18:20:25Z)
• Enabling Automated Machine Learning for Model-Driven AI Engineering [60.09869520679979]
  We propose a novel approach to enable Model-Driven Software Engineering and Model-Driven AI Engineering. In particular, we support Automated ML, thus assisting software engineers without deep AI knowledge in developing AI-intensive systems.
  arXiv  Detail & Related papers  (2022-03-06T10:12:56Z)
• Responsible-AI-by-Design: a Pattern Collection for Designing Responsible AI Systems [12.825892132103236]
  Many ethical regulations, principles, and guidelines for responsible AI have been issued recently. This paper identifies one missing element as the system-level guidance: how to design the architecture of responsible AI systems. We present a summary of design patterns that can be embedded into the AI systems as product features to contribute to responsible-AI-by-design.
  arXiv  Detail & Related papers  (2022-03-02T07:30:03Z)
• Attacks, Defenses, And Tools: A Framework To Facilitate Robust AI/ML Systems [2.5137859989323528]
  Software systems are increasingly relying on Artificial Intelligence (AI) and Machine Learning (ML) components. This paper presents a framework to characterize attacks and weaknesses associated with AI-enabled systems.
  arXiv  Detail & Related papers  (2022-02-18T22:54:04Z)
• An interdisciplinary conceptual study of Artificial Intelligence (AI) for helping benefit-risk assessment practices: Towards a comprehensive qualification matrix of AI programs and devices (pre-print 2020) [55.41644538483948]
  This paper proposes a comprehensive analysis of existing concepts coming from different disciplines tackling the notion of intelligence. The aim is to identify shared notions or discrepancies to consider for qualifying AI systems.
  arXiv  Detail & Related papers  (2021-05-07T12:01:31Z)
• Software Engineering for AI-Based Systems: A Survey [8.550158373713906]
  There is limited synthesized knowledge on Software Engineering approaches for building, operating, and maintaining AI-based systems. SE for AI-based systems is an emerging research area, where more than 2/3 of the studies have been published since 2018. The most studied properties of AI-based systems are dependability and safety.
  arXiv  Detail & Related papers  (2021-05-05T11:22:08Z)
• Towards an Interface Description Template for AI-enabled Systems [77.34726150561087]
  Reuse is a common system architecture approach that seeks to instantiate a system architecture with existing components. There is currently no framework that guides the selection of necessary information to assess their portability to operate in a system different than the one for which the component was originally purposed. We present ongoing work on establishing an interface description template that captures the main information of an AI-enabled component.
  arXiv  Detail & Related papers  (2020-07-13T20:30:26Z)
• Technology Readiness Levels for AI & ML [79.22051549519989]
  Development of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end. Engineering systems follow well-defined processes and testing standards to streamline development for high-quality, reliable results. We propose a proven systems engineering approach for machine learning development and deployment.
  arXiv  Detail & Related papers  (2020-06-21T17:14:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.