An approach to systemic risks of AI through the lens of emergence, collective action problems, and externalities

• URL: http://arxiv.org/abs/2607.18170v1
• Date: Mon, 20 Jul 2026 17:12:04 GMT
• Title: An approach to systemic risks of AI through the lens of emergence, collective action problems, and externalities
• Abstract summary: There is no generally accepted definition of systemic risks in general and for AI in particular.<n>The application of the systemic risk approach to human rights or fundamental rights, like in the EU AI Act, is relatively new.<n>We argue that some concepts so far have not sufficiently take complexity and emergence into account.
• Score: 41.99844472131922
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The integration of general-purpose artificial intelligence models into downstream AI systems, among other developments, has given rise to new forms of risk that are more systemic in nature than conventional AI risks. However, there is no generally accepted definition of systemic risks in general and for AI in particular. Conceptualisations of these risks vary across research and regulation. Especially the application of the systemic risk approach to human rights or fundamental rights, like in the EU AI Act, is relatively new, just as the research on the contribution of AI to systemic forms of discrimination, privacy violations, erosions of democracy, or climate and environmental degradation. We argue that some concepts so far have not sufficiently take complexity and emergence into account. Furthermore, this variety of concepts might hinder responsible actors to adequately assess the systemic risks of AI, leading to inadequate prevention and mitigation measures and ineffective governance. To contribute to the understanding of systemic risks of AI, we propose a conceptualisation of systemic risks of AI that considers complex phenomena that lead to the emergence of harms at the societal or global level. We outline systemic risks mainly as complex externalities and collective action problems. Of particular interest are feedback dynamics, processes that lead to market concentration like network effects, algorithmic monocultures, and integration processes of AI supply chains or 'AI ecosystems' and across societal sectors, which can result in structural dominance, (inter-) dependencies, and cascading risks. Further phenomena contributing to systemic risks are information asymmetries, informational emergence, and deficits of the governance and institutional framework.

Related papers

• Understanding Cognition-Induced Risks in Agentic AI Systems [46.75121501746157]
  Agentic systems powered by large language models (LLMs) exhibit human-like patterns of cognition.<n>As these systems become deeply integrated across different domains, their cognitive engagement raises critical concerns for human society that remain insufficiently studied.<n>We study their potential risks to human agency, autonomy, and control capability, corresponding to each cognitive level.
  arXiv  Detail & Related papers  (2026-08-15T16:16:29Z)
• Identifying the Supply Chain of AI for Trustworthiness and Risk Management in Critical Applications [0.0]
  Gap exists in the systematic assessment of supply chain risks associated with the complex web of data sources, pre-trained models, agents, services, and other systems that contribute to the output of modern AI systems.<n>We survey the current state of AI risk assessment and management, with a focus on the supply chain of AI and risks relating to the behavior and outputs of the AI system.<n>We present a proposed taxonomy specifically for categorizing AI supply chain entities.
  arXiv  Detail & Related papers  (2025-11-19T14:52:02Z)
• An Artificial Intelligence Value at Risk Approach: Metrics and Models [0.0]
  The state of the art of artificial intelligence risk management seems to be highly immature due to upcoming AI regulations.<n>The purpose of this paper is to orientate AI stakeholders about the depths of AI risk management.
  arXiv  Detail & Related papers  (2025-09-22T20:27:29Z)
• AI, Digital Platforms, and the New Systemic Risk [2.0090452213078445]
  We develop a rigorous framework for understanding systemic risk in AI, platform, and hybrid system governance.<n>We argue that recent legislation, including the EU's AI Act and Digital Services Act, invokes systemic risk but relies on narrow or ambiguous characterizations.<n>Our framework highlights novel risk pathways, including the possibility of systemic failures arising from the interaction of multiple AI agents.
  arXiv  Detail & Related papers  (2025-09-22T15:14:23Z)
• Embodied AI: Emerging Risks and Opportunities for Policy Action [46.48780452120922]
  Embodied AI (EAI) systems can exist in, learn from, reason about, and act in the physical world.<n>EAI systems pose significant risks, including physical harm from malicious use, mass surveillance, as well as economic and societal disruption.
  arXiv  Detail & Related papers  (2025-08-28T17:59:07Z)
• Never Compromise to Vulnerabilities: A Comprehensive Survey on AI Governance [211.5823259429128]
  We propose a comprehensive framework integrating technical and societal dimensions, structured around three interconnected pillars: Intrinsic Security, Derivative Security, and Social Ethics.<n>We identify three core challenges: (1) the generalization gap, where defenses fail against evolving threats; (2) inadequate evaluation protocols that overlook real-world risks; and (3) fragmented regulations leading to inconsistent oversight.<n>Our framework offers actionable guidance for researchers, engineers, and policymakers to develop AI systems that are not only robust and secure but also ethically aligned and publicly trustworthy.
  arXiv  Detail & Related papers  (2025-08-12T09:42:56Z)
• A Taxonomy of Systemic Risks from General-Purpose AI [2.5956465292067867]
  We consider systemic risks as large-scale threats that can affect entire societies or economies.<n>Key sources of systemic risk emerge from knowledge gaps, challenges in recognizing harm, and the unpredictable trajectory of AI development.<n>This paper contributes to AI safety research by providing a structured groundwork for understanding and addressing the potential large-scale negative societal impacts of general-purpose AI.
  arXiv  Detail & Related papers  (2024-11-24T22:16:18Z)
• AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies [88.32153122712478]
  We identify 314 unique risk categories organized into a four-tiered taxonomy. At the highest level, this taxonomy encompasses System & Operational Risks, Content Safety Risks, Societal Risks, and Legal & Rights Risks. We aim to advance AI safety through information sharing across sectors and the promotion of best practices in risk mitigation for generative AI models and systems.
  arXiv  Detail & Related papers  (2024-06-25T18:13:05Z)
• Managing extreme AI risks amid rapid progress [171.05448842016125]
  We describe risks that include large-scale social harms, malicious uses, and irreversible loss of human control over autonomous AI systems. There is a lack of consensus about how exactly such risks arise, and how to manage them. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
  arXiv  Detail & Related papers  (2023-10-26T17:59:06Z)
• AI Hazard Management: A framework for the systematic management of root causes for AI risks [0.0]
  This paper introduces the AI Hazard Management (AIHM) framework. It provides a structured process to systematically identify, assess, and treat AI hazards. It builds upon an AI hazard list from a comprehensive state-of-the-art analysis.
  arXiv  Detail & Related papers  (2023-10-25T15:55:50Z)
• Quantitative AI Risk Assessments: Opportunities and Challenges [7.35411010153049]
  Best way to reduce risks is to implement comprehensive AI lifecycle governance.<n>Risks can be quantified using metrics from the technical community.<n>This paper explores these issues, focusing on the opportunities, challenges, and potential impacts of such an approach.
  arXiv  Detail & Related papers  (2022-09-13T21:47:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.