Generative AI for trustworthy systems - Towards a health check model

• URL: http://arxiv.org/abs/2609.10595v1
• Date: Mon, 07 Sep 2026 09:48:58 GMT
• Title: Generative AI for trustworthy systems - Towards a health check model
• Abstract summary: The Trustworthy Autonomy Health Check Model is a structured, multidimensional instrument for characterizing how organizations establish trust in GenAI-assisted software engineering.<n>A cross-cutting overlay of four trust paradigms captures how trust is established, complementing the dimensions capturing what must be trustworthy.<n>The model is diagnostic rather than prescriptive: it supports cross-organizational comparison, surfaces configurational trade-offs, and locates an organization in a shared space without imposing a single progression path.
• Score: 9.729745750450874
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The adoption of generative AI in software-intensive systems is proceeding rapidly, but current analytical instruments - principally unidimensional maturity models - compress important configurational variation into a single progressive axis. Drawing on an inductive interview study of eighteen senior practitioners across telecommunications, automotive, defence, aviation, banking, energy, government, and enterprise software services, this paper presents the Trustworthy Autonomy Health Check Model: a structured, multidimensional instrument for characterizing how organizations establish trust in GenAI-assisted software engineering. The model organizes eight empirically grounded dimensions into a system layer (Scope of Agent Authority, Assurance Mechanisms, Data Trustworthiness, Architectural Containment, Traceability & Comprehensibility) and an organizational layer (Governance, Human Oversight Posture, Workforce Capability Sustainability), each on a five-level ordinal scale. A cross-cutting overlay of four trust paradigms - operational, engineering, statistical, and containment-based - captures how trust is established, complementing the dimensions capturing what must be trustworthy. The model is diagnostic rather than prescriptive: it supports cross-organizational comparison, surfaces configurational trade-offs, and locates an organization in a shared space without imposing a single progression path. Higher levels are not inherently better; the goal is alignment across dimensions appropriate to the organization's domain and chosen trust paradigm. This is formalized as the alignment hypothesis: effective trustworthiness is constrained by the fit between the scope of agent authority and the dimensions enabling it, with misalignment producing pathological risk or unnecessary friction. We discuss how practitioners can apply the model and outline directions for empirical validation.

Related papers

• ComBodied Agents: a New Paradigm of Human-Centric Agentic AI [121.60938707072069]
  We introduce Combodied Agents, a human-centered paradigm that perceives, models, predicts, and supports individual human-state trajectories over time.<n>We unify fragmented capabilities across personal assistants, health agents, AI companions, and adaptive human--AI systems into a closed loop.
  arXiv  Detail & Related papers  (2026-08-11T13:35:58Z)
• Towards Trustworthy Embodied Intelligence: A Systems Framework and Graded Trustworthiness Levels [53.63220028820581]
  Embodied intelligence integrates learned perception and decision making with real-time computation, control, and physical interaction.<n>We define trustworthy embodied intelligence as the sustained capacity to execute specified tasks reliably.
  arXiv  Detail & Related papers  (2026-07-28T17:50:44Z)
• Engineering Trustworthy Agentic AI for Critical Systems [1.8015174793525714]
  The study adopts a trustworthiness model organized around five cross-cutting dimensions: safety and constraint satisfaction; robustness and reliability; transparency and interpretability; accountability and auditability; and privacy and security.<n>Building on this foundation, agentic systems architectures, threats, concrete trust mechanisms, and quantitative metrics are surveyed for direct application in agentic systems development and evaluation.<n>These principles are then examined across four constraint-bound engineering domains: power systems, autonomous vehicles/robotics/UAVs, high-performance computing, and communication networks.
  arXiv  Detail & Related papers  (2026-07-20T22:28:16Z)
• Provably Secure Agent Guardrail [89.79561918065122]
  Existing defense architectures rely on empirical semantic guardrails and probabilistic large model adjudicators.<n>This paper proposes a new security paradigm for agents based on the fundamental limitations of logical reasoning.
  arXiv  Detail & Related papers  (2026-05-28T02:12:41Z)
• Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security [57.35851886874902]
  Agentic AI systems execute complex tasks autonomously, but their multi-step trajectories introduce new failure modes that challenge trustworthiness.<n>This survey provides a focused examination of trustworthy agentic AI through two core dimensions that are critical for high-risk deployments.<n>For each dimension, we clarify key concepts, identify where risks emerge along the agent workflow, and summarize stage-targeted mitigation strategies.
  arXiv  Detail & Related papers  (2026-05-17T10:26:37Z)
• AI Trust OS -- A Continuous Governance Framework for Autonomous AI Observability and Zero-Trust Compliance in Enterprise Environments [4.3073750462661256]
  This paper proposes AI Trust OS, a governance architecture for continuous, autonomous AI observability and zero-trust compliance.<n>The framework operates through a zero-trust telemetry boundary in which ephemeral read-only probes validate structural metadata.
  arXiv  Detail & Related papers  (2026-04-06T15:14:10Z)
• SYNAPSE: Framework for Neuron Analysis and Perturbation in Sequence Encoding [4.507191680687611]
  In sensitive domains such as healthcare or cybersecurity, ensuring transparency, trustworthiness, and robustness is essential.<n>This work proposes SYNAPSE, a systematic, training-free framework for understanding and testing the internal behavior of Transformer models.
  arXiv  Detail & Related papers  (2026-03-09T14:18:47Z)
• Trustworthy AI Posture (TAIP): A Framework for Continuous AI Assurance of Agentic Systems at Horizontal and Vertical scale [1.0896567381206714]
  Point-in-time, document-based audits cannot keep pace with non deterministic behaviour.<n>Crisis is dual-scale: vertically, governance and control obligations change faster than frameworks can operationalise them.<n>Risk-based regulation now requires organisations to demonstrate ongoing control adequacy and effectiveness.<n>This paper reframes trustworthiness as a continuously generated signal rather than a static certificate.
  arXiv  Detail & Related papers  (2026-02-15T10:49:47Z)
• Generative AI for Autonomous Driving: Frontiers and Opportunities [145.6465312554513]
  This survey delivers a comprehensive synthesis of the emerging role of GenAI across the autonomous driving stack.<n>We begin by distilling the principles and trade-offs of modern generative modeling, encompassing VAEs, GANs, Diffusion Models, and Large Language Models.<n>We categorize practical applications, such as synthetic data generalization, end-to-end driving strategies, high-fidelity digital twin systems, smart transportation networks, and cross-domain transfer to embodied AI.
  arXiv  Detail & Related papers  (2025-05-13T17:59:20Z)
• Human-AI Governance (HAIG): A Trust-Utility Approach [0.0]
  This paper introduces the HAIG framework for analysing trust dynamics across evolving human-AI relationships.<n>Our analysis reveals how technical advances in self-supervision, reasoning authority, and distributed decision-making drive non-uniform trust evolution.
  arXiv  Detail & Related papers  (2025-05-03T01:57:08Z)
• On the Trustworthiness of Generative Foundation Models: Guideline, Assessment, and Perspective [377.2483044466149]
  Generative Foundation Models (GenFMs) have emerged as transformative tools.<n>Their widespread adoption raises critical concerns regarding trustworthiness across dimensions.<n>This paper presents a comprehensive framework to address these challenges through three key contributions.
  arXiv  Detail & Related papers  (2025-02-20T06:20:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.