Meaningful human command: Advance control directives as a method to enable moral and legal responsibility for autonomous weapons systems

• URL: http://arxiv.org/abs/2303.06813v3
• Date: Fri, 4 Aug 2023 01:09:44 GMT
• Title: Meaningful human command: Advance control directives as a method to enable moral and legal responsibility for autonomous weapons systems
• Authors: Susannah Kate Devitt
• Abstract summary: This chapter considers whether humans can authorise actions for autonomous systems by the prior establishment of a contract. The medical legal precdent found in 'advance care directives' suggests how the time-consuming deliberative process may be achievable outside real time. The chapter proposes 'autonomy command' scaffolded and legitimised through the construction of ACD ahead of the deployment of autonomous systems.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: 21st Century war is increasing in speed, with conventional forces combined with massed use of autonomous systems and human-machine integration. However, a significant challenge is how humans can ensure moral and legal responsibility for systems operating outside of normal temporal parameters. This chapter considers whether humans can stand outside of real time and authorise actions for autonomous systems by the prior establishment of a contract, for actions to occur in a future context particularly in faster than real time or in very slow operations where human consciousness and concentration could not remain well informed. The medical legal precdent found in 'advance care directives' suggests how the time-consuming, deliberative process required for accountability and responsibility of weapons systems may be achievable outside real time captured in an 'advance control driective' (ACD). The chapter proposes 'autonomy command' scaffolded and legitimised through the construction of ACD ahead of the deployment of autonomous systems.

Related papers

• Spotlight Session on Autonomous Weapons Systems at ICRC 34th International Conference [0.0]
  Governments are responsible for setting requirements for weapons systems. They are responsible for driving ethicality as well as lethality. The UN can advocate for compliance with IHL, human rights, human-centred use of weapons systems.
  arXiv  Detail & Related papers  (2024-10-28T05:36:41Z)
• A Measure for Level of Autonomy Based on Observable System Behavior [0.0]
  We present a potential measure for predicting level of autonomy using observable actions. We also present an algorithm incorporating the proposed measure. The measure and algorithm have significance to researchers and practitioners interested in a method to blind compare autonomous systems at runtime.
  arXiv  Detail & Related papers  (2024-07-20T20:34:20Z)
• Enabling High-Level Machine Reasoning with Cognitive Neuro-Symbolic Systems [67.01132165581667]
  We propose to enable high-level reasoning in AI systems by integrating cognitive architectures with external neuro-symbolic components. We illustrate a hybrid framework centered on ACT-R and we discuss the role of generative models in recent and future applications.
  arXiv  Detail & Related papers  (2023-11-13T21:20:17Z)
• Managing extreme AI risks amid rapid progress [171.05448842016125]
  We describe risks that include large-scale social harms, malicious uses, and irreversible loss of human control over autonomous AI systems. There is a lack of consensus about how exactly such risks arise, and how to manage them. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
  arXiv  Detail & Related papers  (2023-10-26T17:59:06Z)
• Assurance for Autonomy -- JPL's past research, lessons learned, and future directions [56.32768279109502]
  Autonomy is required when a wide variation in circumstances precludes responses being pre-planned. Mission assurance is a key contributor to providing confidence, yet assurance practices honed over decades of spaceflight have relatively little experience with autonomy. Researchers in JPL's software assurance group have been involved in the development of techniques specific to the assurance of autonomy.
  arXiv  Detail & Related papers  (2023-05-16T18:24:12Z)
• When to Ask for Help: Proactive Interventions in Autonomous Reinforcement Learning [57.53138994155612]
  A long-term goal of reinforcement learning is to design agents that can autonomously interact and learn in the world. A critical challenge is the presence of irreversible states which require external assistance to recover from, such as when a robot arm has pushed an object off of a table. We propose an algorithm that efficiently learns to detect and avoid states that are irreversible, and proactively asks for help in case the agent does enter them.
  arXiv  Detail & Related papers  (2022-10-19T17:57:24Z)
• Regulating human control over autonomous systems [1.2691047660244335]
  It is argued that the use of increasingly autonomous systems should be guided by the policy of human control. This article explores the notion of human control in the United States in the two domains of defense and transportation.
  arXiv  Detail & Related papers  (2020-07-22T06:05:41Z)
• A Model-Based, Decision-Theoretic Perspective on Automated Cyber Response [0.0]
  This paper describes an approach to automated cyber response that is designed along these lines. We combine a simulation of the system to be defended with an anytime online planner to solve cyber defense problems characterized as partially observable Markov decision problems (POMDPs)
  arXiv  Detail & Related papers  (2020-02-20T15:30:59Z)
• Hacia los Comit\'es de \'Etica en Inteligencia Artificial [68.8204255655161]
  It is priority to create the rules and specialized organizations that can oversight the following of such rules. This work proposes the creation, at the universities, of Ethical Committees or Commissions specialized on Artificial Intelligence.
  arXiv  Detail & Related papers  (2020-02-11T23:48:31Z)
• Towards a Framework for Certification of Reliable Autonomous Systems [3.3861948721202233]
  A computational system is autonomous if it is able to make its own decisions, or take its own actions, without human supervision or control. Regulators grapple with how to deal with autonomous systems, for example how could we certify an Unmanned Aerial System for autonomous use in civilian airspace? We here analyse what is needed in order to provide verified reliable behaviour of an autonomous system. We propose a roadmap towards developing regulatory guidelines, including articulating challenges to researchers, to engineers, and to regulators.
  arXiv  Detail & Related papers  (2020-01-24T18:18:35Z)
• Intelligent Roundabout Insertion using Deep Reinforcement Learning [68.8204255655161]
  We present a maneuver planning module able to negotiate the entering in busy roundabouts. The proposed module is based on a neural network trained to predict when and how entering the roundabout throughout the whole duration of the maneuver.
  arXiv  Detail & Related papers  (2020-01-03T11:16:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.