Requirements Debt in AI-Enabled Perception Systems Development: An Industrial RE4AI Perspective
- URL: http://arxiv.org/abs/2604.27825v1
- Date: Thu, 30 Apr 2026 13:11:35 GMT
- Title: Requirements Debt in AI-Enabled Perception Systems Development: An Industrial RE4AI Perspective
- Abstract summary: This study conceptualises and empirically investigates how evolving functional and non-functional requirements create and propagate Requirements Debt (ReD)<n>We conducted 16 semi-structured interviews with experts from 13 international automotive companies and 3 European research institutes.<n>As one of the first empirical studies connecting technical debt theory with RE4AI, the work identifies key ReD mechanisms.
- Score: 0.5729426778193398
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: AI integration in automotive perception systems shifts requirements from static specifications to continuously evolving entities shaped by data, models, and operating contexts. When such changes are not consistently documented, validated, and traced, they accumulate as Requirements Debt (ReD), an underexplored but critical subtype of technical debt. This study conceptualises and empirically investigates how evolving functional and non-functional requirements create and propagate ReD across the AI-enabled automotive perception system lifecycle. We conducted 16 semi-structured interviews with experts from 13 international automotive companies and 3 European research institutes, and analysed the data using thematic analysis. As one of the first empirical studies connecting technical debt theory with RE4AI, the work identifies key ReD mechanisms. Evolving functional requirements (e.g., algorithm updates, sensor fusion, architectural changes, real-time constraints) drive semantic drift, validation backlogs, and integration debt when verification lags behind rapid iteration. In parallel, evolving non-functional requirements (e.g., safety, cybersecurity, reliability, scalability, transparency, trustworthiness) create assurance lag, compliance misalignment, and transparency and reliability debt as standards and ethical expectations shift. These interacting mechanisms propagate ReD across data, models, and system artefacts, undermining auditability, reliability, and certification readiness in safety-critical perception systems.
Related papers
- Engineering Trustworthy Agentic AI for Critical Systems [1.8015174793525714]
The study adopts a trustworthiness model organized around five cross-cutting dimensions: safety and constraint satisfaction; robustness and reliability; transparency and interpretability; accountability and auditability; and privacy and security.<n>Building on this foundation, agentic systems architectures, threats, concrete trust mechanisms, and quantitative metrics are surveyed for direct application in agentic systems development and evaluation.<n>These principles are then examined across four constraint-bound engineering domains: power systems, autonomous vehicles/robotics/UAVs, high-performance computing, and communication networks.
arXiv Detail & Related papers (2026-07-20T22:28:16Z) - AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery [184.2309450554096]
AutoResearch is defined as the developmental spectrum of AI-powered scientific workflow automation.<n>We analyze how research systems redistribute control, evidence, execution, validation, and accountability across and organize the field.<n>We propose five evaluation dimensions--novelty, impact, reliability, and provenance--and show that AutoResearch autonomy is domain-conditioned.
arXiv Detail & Related papers (2026-05-22T03:40:30Z) - Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering [55.93186934265401]
Large language model (LLM) agents are increasingly built less by changing model weights than by reorganizing the runtime around them.<n>This paper reviews that shift through the lens of externalization.<n>We argue that agent infrastructure matters not merely because it adds auxiliary components, but because it transforms hard cognitive burdens into forms that the model can solve more reliably.
arXiv Detail & Related papers (2026-04-09T13:19:41Z) - Operationalising Artificial Intelligence Bills of Materials (AIBOMs) for Verifiable AI Provenance and Lifecycle Assurance [11.812618112854116]
This study presents an Artificial Intelligence Bill of Materials (AIBOM) schema extending the CycloneDX standard to capture AI-specific provenance.<n>An autonomous AI pipeline is developed to perform continuous environment inspection, vulnerability enrichment, and auditing using machine-verifiable provenance chains.
arXiv Detail & Related papers (2026-03-17T20:45:09Z) - AI-Assisted Engineering Should Track the Epistemic Status and Temporal Validity of Architectural Decisions [0.0]
LLM coding assistants generate decisions faster than teams can validate them.<n>No widely-adopted framework distinguishes conjecture from verified knowledge.<n>We propose three requirements for responsible AI-assisted engineering.
arXiv Detail & Related papers (2026-01-28T23:12:07Z) - RE for AI in Practice: Managing Data Annotation Requirements for AI Autonomous Driving Systems [3.9255502531644204]
High-quality data annotation requirements are crucial for the development of safe and reliable AI-enabled systems.<n>Our study investigates how annotation requirements are defined and used in practice.<n>Key challenges include ambiguity, edge case complexity, evolving requirements, inconsistencies, and resource constraints.
arXiv Detail & Related papers (2025-11-19T20:27:30Z) - Safe and Certifiable AI Systems: Concepts, Challenges, and Lessons Learned [45.44933002008943]
This white paper presents the T"UV AUSTRIA Trusted AI framework.<n>It is an end-to-end audit catalog and methodology for assessing and certifying machine learning systems.<n>Building on three pillars - Secure Software Development, Functional Requirements, and Ethics & Data Privacy - it translates the high-level obligations of the EU AI Act into specific, testable criteria.
arXiv Detail & Related papers (2025-09-08T17:52:08Z) - Never Compromise to Vulnerabilities: A Comprehensive Survey on AI Governance [211.5823259429128]
We propose a comprehensive framework integrating technical and societal dimensions, structured around three interconnected pillars: Intrinsic Security, Derivative Security, and Social Ethics.<n>We identify three core challenges: (1) the generalization gap, where defenses fail against evolving threats; (2) inadequate evaluation protocols that overlook real-world risks; and (3) fragmented regulations leading to inconsistent oversight.<n>Our framework offers actionable guidance for researchers, engineers, and policymakers to develop AI systems that are not only robust and secure but also ethically aligned and publicly trustworthy.
arXiv Detail & Related papers (2025-08-12T09:42:56Z) - The Architecture of Trust: A Framework for AI-Augmented Real Estate Valuation in the Era of Structured Data [0.0]
The Uniform Appraisal dataset (UAD) 3.6's mandatory 2026 implementation transforms residential property valuation from narrative reporting to machine-readable formats.<n>This paper provides the first comprehensive analysis of this regulatory shift alongside concurrent AI advances in computer vision, natural language processing, and autonomous systems.<n>We develop a three-layer framework for AI-augmented valuation addressing technical implementation and institutional trust requirements.
arXiv Detail & Related papers (2025-08-04T05:24:25Z) - Rethinking Data Protection in the (Generative) Artificial Intelligence Era [138.07763415496288]
We propose a four-level taxonomy that captures the diverse protection needs arising in modern (generative) AI models and systems.<n>Our framework offers a structured understanding of the trade-offs between data utility and control, spanning the entire AI pipeline.
arXiv Detail & Related papers (2025-07-03T02:45:51Z) - TVR: Automotive System Requirement Traceability Validation and Recovery Through Retrieval-Augmented Generation [6.254217675711076]
We introduce TVR, a requirement Traceability Validation and Recovery approach primarily targeting automotive systems.<n>TVR is designed to validate existing traceability links and recover missing ones with high accuracy.
arXiv Detail & Related papers (2025-04-21T20:37:23Z) - Trustworthy AI [75.99046162669997]
Brittleness to minor adversarial changes in the input data, ability to explain the decisions, address the bias in their training data, are some of the most prominent limitations.
We propose the tutorial on Trustworthy AI to address six critical issues in enhancing user and public trust in AI systems.
arXiv Detail & Related papers (2020-11-02T20:04:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.