Requirement Engineering Challenges for AI-intense Systems Development
- URL: http://arxiv.org/abs/2103.10270v2
- Date: Mon, 22 Mar 2021 07:29:58 GMT
- Title: Requirement Engineering Challenges for AI-intense Systems Development
- Authors: Hans-Martin Heyn, Eric Knauss, Amna Pir Muhammad, Olof Eriksson,
Jennifer Linder, Padmini Subbiah, Shameer Kumar Pradhan, Sagar Tungal
- Abstract summary: We argue that significant challenges relate to defining and ensuring behaviour and quality attributes of complex, AI-intense systems and applications.
We derive four challenge areas from relevant use cases of complex, AI-intense systems and applications related to industry, transportation, and home automation.
Solving these challenges will imply process support that integrates new requirements engineering methods into development approaches for complex, AI-intense systems and applications.
- Score: 1.6563993097383285
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Availability of powerful computation and communication technology as well as
advances in artificial intelligence enable a new generation of complex,
AI-intense systems and applications. Such systems and applications promise
exciting improvements on a societal level, yet they also bring with them new
challenges for their development. In this paper we argue that significant
challenges relate to defining and ensuring behaviour and quality attributes of
such systems and applications. We specifically derive four challenge areas from
relevant use cases of complex, AI-intense systems and applications related to
industry, transportation, and home automation: understanding, determining, and
specifying (i) contextual definitions and requirements, (ii) data attributes
and requirements, (iii) performance definition and monitoring, and (iv) the
impact of human factors on system acceptance and success. Solving these
challenges will imply process support that integrates new requirements
engineering methods into development approaches for complex, AI-intense systems
and applications. We present these challenges in detail and propose a research
roadmap.
Related papers
- OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI [73.75520820608232]
We introduce OlympicArena, which includes 11,163 bilingual problems across both text-only and interleaved text-image modalities.
These challenges encompass a wide range of disciplines spanning seven fields and 62 international Olympic competitions, rigorously examined for data leakage.
Our evaluations reveal that even advanced models like GPT-4o only achieve a 39.97% overall accuracy, illustrating current AI limitations in complex reasoning and multimodal integration.
arXiv Detail & Related papers (2024-06-18T16:20:53Z) - Artificial Intelligence in Industry 4.0: A Review of Integration Challenges for Industrial Systems [45.31340537171788]
Cyber-Physical Systems (CPS) generate vast data sets that can be leveraged by Artificial Intelligence (AI) for applications including predictive maintenance and production planning.
Despite the demonstrated potential of AI, its widespread adoption in sectors like manufacturing remains limited.
arXiv Detail & Related papers (2024-05-28T20:54:41Z) - Dealing with Data for RE: Mitigating Challenges while using NLP and
Generative AI [2.9189409618561966]
Book chapter explores the evolving landscape of Software Engineering in general, and Requirements Engineering (RE) in particular.
We discuss challenges that arise while integrating Natural Language Processing (NLP) and generative AI into enterprise-critical software systems.
Book provides practical insights, solutions, and examples to equip readers with the knowledge and tools necessary.
arXiv Detail & Related papers (2024-02-26T19:19:47Z) - Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairness [53.91018508439669]
The study explores the complexities of integrating Artificial Intelligence into Autonomous Vehicles (AVs)
It examines the challenges introduced by AI components and the impact on testing procedures.
The paper identifies significant challenges and suggests future directions for research and development of AI in AV technology.
arXiv Detail & Related papers (2024-02-21T08:29:42Z) - Edge AI Inference in Heterogeneous Constrained Computing: Feasibility
and Opportunities [9.156192191794567]
The proliferation of AI inference accelerators showcases innovation but also underscores challenges.
This paper outlines the requirements and components of a framework that accommodates hardware diversity.
Next, we assess the impact of device heterogeneity on AI inference performance, identifying strategies to optimize outcomes without compromising service quality.
arXiv Detail & Related papers (2023-10-27T16:46:59Z) - Efficient Machine Learning, Compilers, and Optimizations for Embedded
Systems [21.098443474303462]
Deep Neural Networks (DNNs) have achieved great success in a massive number of artificial intelligence (AI) applications by delivering high-quality computer vision, natural language processing, and virtual reality applications.
These emerging AI applications also come with increasing computation and memory demands, which are challenging to handle especially for the embedded systems where limited/memory resources, tight power budgets, and small form factors are demanded.
This book chapter introduces a series of effective design methods to enable efficient algorithms, compilers, and various optimizations for embedded systems.
arXiv Detail & Related papers (2022-06-06T02:54:05Z) - Proceedings of the Robust Artificial Intelligence System Assurance
(RAISA) Workshop 2022 [0.0]
The RAISA workshop will focus on research, development and application of robust artificial intelligence (AI) and machine learning (ML) systems.
Rather than studying robustness with respect to particular ML algorithms, our approach will be to explore robustness assurance at the system architecture level.
arXiv Detail & Related papers (2022-02-10T01:15:50Z) - Qlib: An AI-oriented Quantitative Investment Platform [86.8580406876954]
AI technologies have raised new challenges to the quantitative investment system.
Qlib aims to realize the potential, empower the research, and create the value of AI technologies in quantitative investment.
arXiv Detail & Related papers (2020-09-22T12:57:10Z) - Technology Readiness Levels for AI & ML [79.22051549519989]
Development of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end.
Engineering systems follow well-defined processes and testing standards to streamline development for high-quality, reliable results.
We propose a proven systems engineering approach for machine learning development and deployment.
arXiv Detail & Related papers (2020-06-21T17:14:34Z) - Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable
Claims [59.64274607533249]
AI developers need to make verifiable claims to which they can be held accountable.
This report suggests various steps that different stakeholders can take to improve the verifiability of claims made about AI systems.
We analyze ten mechanisms for this purpose--spanning institutions, software, and hardware--and make recommendations aimed at implementing, exploring, or improving those mechanisms.
arXiv Detail & Related papers (2020-04-15T17:15:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.