An Abstract Architecture for Explainable Autonomy in Hazardous Environments

• URL: http://arxiv.org/abs/2606.07211v1
• Date: Fri, 05 Jun 2026 12:23:36 GMT
• Title: An Abstract Architecture for Explainable Autonomy in Hazardous Environments
• Abstract summary: This paper presents an abstract architecture that supports an autonomous system explaining its behaviour (explainable autonomy)<n>We present a worked example of how our architecture could be applied in the civil nuclear industry, where both workers and regulators need to trust the system's decision-making capabilities.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Autonomous robotic systems are being proposed for use in hazardous environments, often to reduce the risks to human workers. In the immediate future, it is likely that human workers will continue to use and direct these autonomous robots, much like other computerised tools but with more sophisticated decision-making. Therefore, one important area on which to focus engineering effort is ensuring that these users trust the system. Recent literature suggests that explainability is closely related to how trustworthy a system is. Like safety and security properties, explainability should be designed into a system, instead of being added afterwards. This paper presents an abstract architecture that supports an autonomous system explaining its behaviour (explainable autonomy), providing a design template for implementing explainable autonomous systems. We present a worked example of how our architecture could be applied in the civil nuclear industry, where both workers and regulators need to trust the system's decision-making capabilities.

Related papers

• Value-Preserving Architectures for Agentic AI Systems [44.64398176188818]
  The paper argues that architectural choices influence not only the functionality and performance of MAS but can also promote value-oriented system behavior.<n>We discuss the following value-preserving architectural patterns: (i) a privacy-aware architecture with a federated topology, (ii) a distributed architecture to promote pluralism and diversity, and (iii) a guard-agent architecture to detect and mitigate unfairness.
  arXiv  Detail & Related papers  (2026-09-03T14:36:23Z)
• Critique of Agent Model [6.669064478699597]
  We argue that genuine agency requires these structures to be emphinternalized within the system itself.<n>We propose the Goal-Identity-Configurator (GIC) architecture for a general-purpose agent model.
  arXiv  Detail & Related papers  (2026-06-22T22:50:02Z)
• Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems [46.60248293123689]
  This paper advances a practical framework for effective human oversight of AI systems.<n>It draws on insights from computer science, human-computer interaction, psychology, philosophy, and law.
  arXiv  Detail & Related papers  (2026-04-09T22:35:41Z)
• Self-Sovereign Agent [75.57858796824469]
  Self-sovereign AI systems can economically sustain and extend their own operation without human involvement.<n>Recent advances in large language models and agent frameworks have substantially expanded agents' practical capabilities.
  arXiv  Detail & Related papers  (2026-03-04T03:11:26Z)
• AI Automatons: AI Systems Intended to Imitate Humans [54.19152688545896]
  There is a growing proliferation of AI systems designed to mimic people's behavior, work, abilities, likenesses, or humanness.<n>The research, design, deployment, and availability of such AI systems have prompted growing concerns about a wide range of possible legal, ethical, and other social impacts.
  arXiv  Detail & Related papers  (2025-03-04T03:55:38Z)
• Security Challenges in Autonomous Systems Design [1.864621482724548]
  With the independence from human control, cybersecurity of such systems becomes even more critical. With the independence from human control, cybersecurity of such systems becomes even more critical. This paper thoroughly discusses the state of the art, identifies emerging security challenges and proposes research directions.
  arXiv  Detail & Related papers  (2023-11-05T09:17:39Z)
• LLM4Drive: A Survey of Large Language Models for Autonomous Driving [62.10344445241105]
  Large language models (LLMs) have demonstrated abilities including understanding context, logical reasoning, and generating answers. In this paper, we systematically review a research line about textitLarge Language Models for Autonomous Driving (LLM4AD).
  arXiv  Detail & Related papers  (2023-11-02T07:23:33Z)
• Managing extreme AI risks amid rapid progress [171.05448842016125]
  We describe risks that include large-scale social harms, malicious uses, and irreversible loss of human control over autonomous AI systems. There is a lack of consensus about how exactly such risks arise, and how to manage them. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
  arXiv  Detail & Related papers  (2023-10-26T17:59:06Z)
• The Need for a Meta-Architecture for Robot Autonomy [0.0]
  Long-term autonomy of robotic systems implicitly requires platforms that are able to handle faults, problems in behaviors, or lack of knowledge. We put forward the case for a generative model of cognitive architectures for autonomous robotic agents that subscribes to the principles of model-based engineering and certifiable dependability.
  arXiv  Detail & Related papers  (2022-07-20T07:27:23Z)
• Multi Agent System for Machine Learning Under Uncertainty in Cyber Physical Manufacturing System [78.60415450507706]
  Recent advancements in predictive machine learning has led to its application in various use cases in manufacturing. Most research focused on maximising predictive accuracy without addressing the uncertainty associated with it. In this paper, we determine the sources of uncertainty in machine learning and establish the success criteria of a machine learning system to function well under uncertainty.
  arXiv  Detail & Related papers  (2021-07-28T10:28:05Z)
• Towards an Interface Description Template for AI-enabled Systems [77.34726150561087]
  Reuse is a common system architecture approach that seeks to instantiate a system architecture with existing components. There is currently no framework that guides the selection of necessary information to assess their portability to operate in a system different than the one for which the component was originally purposed. We present ongoing work on establishing an interface description template that captures the main information of an AI-enabled component.
  arXiv  Detail & Related papers  (2020-07-13T20:30:26Z)
• Regulating Safety and Security in Autonomous Robotic Systems [0.0]
  Rules for autonomous systems are often difficult to formalise. In the space and nuclear sectors applications are more likely to differ, so a set of general safety principles has developed. This allows novel applications to be assessed for their safety, but are difficult to formalise. We are collaborating with regulators and the community in the space and nuclear sectors to develop guidelines for autonomous and robotic systems.
  arXiv  Detail & Related papers  (2020-07-09T16:33:14Z)
• Death by AI: Where Assured Autonomy in Smart Cities Meets the End-to-End Argument [5.063728016437489]
  Many smart city cyber-physical systems are becoming automated. It is crucial for them to operate in a safe manner. Challenges abound to consistently manage the safety of such autonomous systems.
  arXiv  Detail & Related papers  (2020-02-13T20:14:25Z)
• Towards a Framework for Certification of Reliable Autonomous Systems [3.3861948721202233]
  A computational system is autonomous if it is able to make its own decisions, or take its own actions, without human supervision or control. Regulators grapple with how to deal with autonomous systems, for example how could we certify an Unmanned Aerial System for autonomous use in civilian airspace? We here analyse what is needed in order to provide verified reliable behaviour of an autonomous system. We propose a roadmap towards developing regulatory guidelines, including articulating challenges to researchers, to engineers, and to regulators.
  arXiv  Detail & Related papers  (2020-01-24T18:18:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.