Death by AI: Where Assured Autonomy in Smart Cities Meets the End-to-End Argument

• URL: http://arxiv.org/abs/2002.11625v1
• Date: Thu, 13 Feb 2020 20:14:25 GMT
• Title: Death by AI: Where Assured Autonomy in Smart Cities Meets the End-to-End Argument
• Abstract summary: Many smart city cyber-physical systems are becoming automated. It is crucial for them to operate in a safe manner. Challenges abound to consistently manage the safety of such autonomous systems.
• Score: 5.063728016437489
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A smart city involves critical infrastructure systems that have been digitally enabled. Increasingly, many smart city cyber-physical systems are becoming automated. The extent of automation ranges from basic logic gates to sophisticated, artificial intelligence (AI) that enables fully autonomous systems. Because of modern society's reliance on autonomous systems in smart cities, it is crucial for them to operate in a safe manner; otherwise, it is feasible for these systems to cause considerable physical harm or even death. Because smart cities could involve thousands of autonomous systems operating in concert in densely populated areas, safety assurances are required. Challenges abound to consistently manage the safety of such autonomous systems due to their disparate developers, manufacturers, operators and users. A novel network and a sample of associated network functions for autonomous systems is proposed that aims to provide a baseline of safety for autonomous systems. This is accomplished by establishing a custom-designed network for autonomous systems that is separate from the Internet, and can handle certain functions that enable safety through active networking. Such a network design sits at the margins of the end-to-end principle, which is warranted considering the safety of autonomous systems is at stake as is argued in this paper. Without a scalable safety strategy for autonomous systems as proposed, assured autonomy in smart cities will remain elusive.

Related papers

• An Abstract Architecture for Explainable Autonomy in Hazardous Environments [0.0]
  This paper presents an abstract architecture that supports an autonomous system explaining its behaviour (explainable autonomy)<n>We present a worked example of how our architecture could be applied in the civil nuclear industry, where both workers and regulators need to trust the system's decision-making capabilities.
  arXiv  Detail & Related papers  (2026-06-05T12:23:36Z)
• Explainable Planning for Hybrid Systems [0.0]
  The recent advancement in artificial intelligence (AI) technologies facilitates a paradigm shift toward automation.<n> automated planning is now applied to many complex and safety-critical domains, including smart energy grids, self-driving cars, warehouse automation, urban and air traffic control, search and rescue operations, surveillance, robotics, and healthcare.<n>The thesis presents a comprehensive study on explainable artificial intelligence planning (XAIP) for hybrid systems that capture a representation of real-world problems closely.
  arXiv  Detail & Related papers  (2026-02-24T21:24:29Z)
• When Autonomy Goes Rogue: Preparing for Risks of Multi-Agent Collusion in Social Systems [78.04679174291329]
  We introduce a proof-of-concept to simulate the risks of malicious multi-agent systems (MAS)<n>We apply this framework to two high-risk fields: misinformation spread and e-commerce fraud.<n>Our findings show that decentralized systems are more effective at carrying out malicious actions than centralized ones.
  arXiv  Detail & Related papers  (2025-07-19T15:17:30Z)
• Generative AI for Autonomous Driving: Frontiers and Opportunities [145.6465312554513]
  This survey delivers a comprehensive synthesis of the emerging role of GenAI across the autonomous driving stack.<n>We begin by distilling the principles and trade-offs of modern generative modeling, encompassing VAEs, GANs, Diffusion Models, and Large Language Models.<n>We categorize practical applications, such as synthetic data generalization, end-to-end driving strategies, high-fidelity digital twin systems, smart transportation networks, and cross-domain transfer to embodied AI.
  arXiv  Detail & Related papers  (2025-05-13T17:59:20Z)
• Work-in-Progress: Crash Course: Can (Under Attack) Autonomous Driving Beat Human Drivers? [60.51287814584477]
  This paper evaluates the inherent risks in autonomous driving by examining the current landscape of AVs. We develop specific claims highlighting the delicate balance between the advantages of AVs and potential security challenges in real-world scenarios.
  arXiv  Detail & Related papers  (2024-05-14T09:42:21Z)
• Security Challenges in Autonomous Systems Design [1.864621482724548]
  With the independence from human control, cybersecurity of such systems becomes even more critical. With the independence from human control, cybersecurity of such systems becomes even more critical. This paper thoroughly discusses the state of the art, identifies emerging security challenges and proposes research directions.
  arXiv  Detail & Related papers  (2023-11-05T09:17:39Z)
• Managing extreme AI risks amid rapid progress [171.05448842016125]
  We describe risks that include large-scale social harms, malicious uses, and irreversible loss of human control over autonomous AI systems. There is a lack of consensus about how exactly such risks arise, and how to manage them. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
  arXiv  Detail & Related papers  (2023-10-26T17:59:06Z)
• Autonomous Vehicles an overview on system, cyber security, risks, issues, and a way forward [0.0]
  This chapter explores the complex realm of autonomous cars, analyzing their fundamental components and operational characteristics. The primary focus of this investigation lies in the realm of cybersecurity, specifically in the context of autonomous vehicles. A comprehensive analysis will be conducted to explore various risk management solutions aimed at protecting these vehicles from potential threats.
  arXiv  Detail & Related papers  (2023-09-25T15:19:09Z)
• When Authentication Is Not Enough: On the Security of Behavioral-Based Driver Authentication Systems [53.2306792009435]
  We develop two lightweight driver authentication systems based on Random Forest and Recurrent Neural Network architectures. We are the first to propose attacks against these systems by developing two novel evasion attacks, SMARTCAN and GANCAN. Through our contributions, we aid practitioners in safely adopting these systems, help reduce car thefts, and enhance driver security.
  arXiv  Detail & Related papers  (2023-06-09T14:33:26Z)
• Secure solutions for Smart City Command Control Centre using AIOT [1.1731001328350983]
  In Smart City IOT network, data collected from different log collectors or direct sources from cloud or edge should harness the potential of AI. The smart city command and control center team will leverage these models and deploy it in different city IOT network to help on intrusion prediction, network packet surge, potential botnet attacks from external network.
  arXiv  Detail & Related papers  (2021-07-29T23:30:02Z)
• On the Philosophical, Cognitive and Mathematical Foundations of Symbiotic Autonomous Systems (SAS) [87.3520234553785]
  Symbiotic Autonomous Systems (SAS) are advanced intelligent and cognitive systems exhibiting autonomous collective intelligence. This work presents a theoretical framework of SAS underpinned by the latest advances in intelligence, cognition, computer, and system sciences.
  arXiv  Detail & Related papers  (2021-02-11T05:44:25Z)
• AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehicles [76.46575807165729]
  We propose AdvSim, an adversarial framework to generate safety-critical scenarios for any LiDAR-based autonomy system. By simulating directly from sensor data, we obtain adversarial scenarios that are safety-critical for the full autonomy stack.
  arXiv  Detail & Related papers  (2021-01-16T23:23:12Z)
• Graph Neural Networks for Decentralized Controllers [171.6642679604005]
  Dynamical systems comprised of autonomous agents arise in many relevant problems such as robotics, smart grids, or smart cities. Optimal centralized controllers are readily available but face limitations in terms of scalability and practical implementation. We propose a framework using graph neural networks (GNNs) to learn decentralized controllers from data.
  arXiv  Detail & Related papers  (2020-03-23T13:51:18Z)
• A Model-Based, Decision-Theoretic Perspective on Automated Cyber Response [0.0]
  This paper describes an approach to automated cyber response that is designed along these lines. We combine a simulation of the system to be defended with an anytime online planner to solve cyber defense problems characterized as partially observable Markov decision problems (POMDPs)
  arXiv  Detail & Related papers  (2020-02-20T15:30:59Z)
• Towards a Framework for Certification of Reliable Autonomous Systems [3.3861948721202233]
  A computational system is autonomous if it is able to make its own decisions, or take its own actions, without human supervision or control. Regulators grapple with how to deal with autonomous systems, for example how could we certify an Unmanned Aerial System for autonomous use in civilian airspace? We here analyse what is needed in order to provide verified reliable behaviour of an autonomous system. We propose a roadmap towards developing regulatory guidelines, including articulating challenges to researchers, to engineers, and to regulators.
  arXiv  Detail & Related papers  (2020-01-24T18:18:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.