SoK: How Frontier AI Reshapes System-Level Security Risk Dynamics in Critical Infrastructure
- URL: http://arxiv.org/abs/2608.04033v1
- Date: Mon, 03 Aug 2026 01:30:35 GMT
- Title: SoK: How Frontier AI Reshapes System-Level Security Risk Dynamics in Critical Infrastructure
- Abstract summary: This paper introduces a five-dimensional risk-dynamics framework that characterizes how FAIs CI security across the lifecycle.<n>Rather than enumerating threats, the framework identifies recurring mechanisms that jointly determine system-level risk.
- Score: 8.022874342690155
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Frontier artificial intelligence (FAI), encompassing large-scale, general-purpose AI systems, including large language models, multimodal foundation models, and agentic systems, is increasingly integrated into critical infrastructure (CI). This challenges long-standing security assumptions of bounded behavior, segmented networks, component transparency, and human-paced decision-making. Existing AI-security literature typically organizes risks by attack type, lifecycle stage, or asset class, but fails to capture the system-level dynamics, such as how risk emerges, spreads, and is controlled, through which FAI reshapes CI security outcomes. This Systematization of Knowledge (SoK) introduces a five-dimensional risk-dynamics framework that characterizes how FAI reconfigures CI security across the lifecycle: (i) Capability Emergence through new FAI-enabled attack and defense capabilities, (ii) Infiltration Pathways through data, models and AI supply chains, (iii) Cross-System Propagation across interconnected infrastructures and dependencies, (iv) degradation of effective technical and human Control Authority, and (v) strain on institutional Response Capacity under operational pressure. Rather than enumerating threats, the framework identifies recurring mechanisms that jointly determine system-level risk. We further identify a structural mismatch between academic AI-security research and CI operational constraints, and derive a deployment-oriented research agenda grounded in system-level assurance criteria. Collectively, this work shifts attention from model-centric robustness to lifecycle-structured, system-level assurance in interconnected CI environments.
Related papers
- A data-driven security quantification framework for IoT-based systems [1.7499351967216337]
This study introduces a data-driven probabilistic security framework for IoT-based safety-critical systems.<n>It integrates Model-Based Systems Engineering (SEMB), Attack Tree Analysis (ATA) and empirical vulnerability data.<n>It quantifies system compromise probabilities, identifies likely causes of attacks, and prioritises mitigation strategies.
arXiv Detail & Related papers (2026-06-15T11:04:04Z) - Hierarchical Federated Learning with Dynamic Clustering and Adaptive Regularization for Robust Infrastructure Inspection [46.657161089480375]
This paper proposes a novel hierarchical federated learning framework.<n>The framework orchestrates a synergistic two-tier optimization strategy.<n> Comprehensive evaluations on a large-scale, real-world structural inspection dataset demonstrate that the hierarchical integration of macro-clustering and micro-regularization successfully neutralizes dual-level heterogeneity.
arXiv Detail & Related papers (2026-06-02T03:14:26Z) - The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey [46.278608570660005]
AI agents that combine large language models with non-AI system components are rapidly emerging in real-world applications.<n>This paper presents the first systematic and comprehensive survey of AI agent security.
arXiv Detail & Related papers (2026-03-11T05:25:55Z) - SAGE-LLM: Towards Safe and Generalizable LLM Controller with Fuzzy-CBF Verification and Graph-Structured Knowledge Retrieval for UAV Decision [46.089736018739295]
Large Language Models (LLM) lack domain-specific UAV control knowledge and formal safety assurances.<n>This paper proposes a train-free two-layer decision architecture based on LLMs, integrating high-level safety planning with low-level precise control.
arXiv Detail & Related papers (2026-02-27T06:41:04Z) - An Ontology-Based Approach to Security Risk Identification of Container Deployments in OT Contexts [1.826848871278733]
Security risk identification for OT container deployments is challenged by hybrid IT/OT architectures, fragmented stakeholder knowledge, and continuous system changes.<n>We propose a model-based approach, implemented as the Container Security Risk Ontology (CSRO)<n>CSRO integrates five key domains: adversarial behaviour, contextual assumptions, attack scenarios, risk assessment rules, and container security artefacts.
arXiv Detail & Related papers (2026-01-07T15:20:19Z) - STAMP/STPA informed characterization of Factors Leading to Loss of Control in AI Systems [0.0]
We set out to provide a more structured framework for discussing and characterizing loss of control.<n>We use this framework to assist those responsible for the safe operation of AI-containing socio-technical systems to identify causal factors leading to loss of control.
arXiv Detail & Related papers (2025-12-19T14:07:32Z) - A cybersecurity AI agent selection and decision support framework [0.0]
This paper presents a novel, structured decision support framework that aligns AI agent architectures, reactive, cognitive, hybrid, and learning.<n>By integrating agent theory with industry guidelines, this framework provides a transparent and stepwise methodology for selecting and deploying AI solutions.
arXiv Detail & Related papers (2025-10-02T07:38:21Z) - A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents [45.53643260046778]
Recent advances in large language models (LLMs) have catalyzed the rise of autonomous AI agents.<n>These large-model agents mark a paradigm shift from static inference systems to interactive, memory-augmented entities.
arXiv Detail & Related papers (2025-06-30T13:34:34Z) - Towards provable probabilistic safety for scalable embodied AI systems [79.31011047593492]
Embodied AI systems are increasingly prevalent across various applications.<n> Ensuring their safety in complex operating environments remains a major challenge.<n>This Perspective offers a pathway toward safer, large-scale adoption of embodied AI systems in safety-critical applications.
arXiv Detail & Related papers (2025-06-05T15:46:25Z) - EARBench: Towards Evaluating Physical Risk Awareness for Task Planning of Foundation Model-based Embodied AI Agents [53.717918131568936]
Embodied artificial intelligence (EAI) integrates advanced AI models into physical entities for real-world interaction.<n>Foundation models as the "brain" of EAI agents for high-level task planning have shown promising results.<n>However, the deployment of these agents in physical environments presents significant safety challenges.<n>This study introduces EARBench, a novel framework for automated physical risk assessment in EAI scenarios.
arXiv Detail & Related papers (2024-08-08T13:19:37Z) - Beyond Accidents and Misuse: Decoding the Structural Risk Dynamics of Artificial Intelligence [0.0]
This paper advances the concept of structural risk by introducing a framework grounded in complex systems research.<n>We classify structural risks into three categories: antecedent structural causes, antecedent AI system causes, and deleterious feedback loops.<n>To anticipate and govern these dynamics, the paper proposes a methodological agenda incorporating scenario mapping, simulation, and exploratory foresight.
arXiv Detail & Related papers (2024-06-21T05:44:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.