The Gradient of Generative AI Release: Methods and Considerations

• URL: http://arxiv.org/abs/2302.04844v1
• Date: Sun, 5 Feb 2023 23:05:11 GMT
• Title: The Gradient of Generative AI Release: Methods and Considerations
• Abstract summary: We propose a framework to assess six levels of access to generative AI systems. We show trends in generative system release over time, noting closedness among large companies for powerful systems. We also enumerate safety controls and guardrails for generative systems and necessary investments to improve future releases.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: As increasingly powerful generative AI systems are developed, the release method greatly varies. We propose a framework to assess six levels of access to generative AI systems: fully closed; gradual or staged access; hosted access; cloud-based or API access; downloadable access; and fully open. Each level, from fully closed to fully open, can be viewed as an option along a gradient. We outline key considerations across this gradient: release methods come with tradeoffs, especially around the tension between concentrating power and mitigating risks. Diverse and multidisciplinary perspectives are needed to examine and mitigate risk in generative AI systems from conception to deployment. We show trends in generative system release over time, noting closedness among large companies for powerful systems and openness among organizations founded on principles of openness. We also enumerate safety controls and guardrails for generative systems and necessary investments to improve future releases.

Related papers

• The Open-Weight Paradox: Why Restricting Access to AI Models May Undermine the Safety It Seeks to Protect [0.0]
  The governance of open-weight artificial intelligence (AI) models has been framed as a binary choice: openness as risk, restriction as safety.<n>This paper argues that access restrictions, without governed alternatives, may displace risks rather than reduce them.
  arXiv  Detail & Related papers  (2026-04-19T12:38:14Z)
• Beyond the Binary: A nuanced path for open-weight advanced AI [0.0]
  Open-weight advanced AI models are systems whose parameters are freely available for download and adaptation.<n>This report moves beyond the binary framing of open'' versus closed'' AI.<n>We find significant disparities in safety practices across developers and jurisdictions.<n>We propose a tiered, safety-anchored approach to model release, where openness is determined by rigorous risk assessment and demonstrated safety.
  arXiv  Detail & Related papers  (2026-02-23T10:26:23Z)
• The Devil Behind Moltbook: Anthropic Safety is Always Vanishing in Self-Evolving AI Societies [57.387081435669835]
  Multi-agent systems built from large language models offer a promising paradigm for scalable collective intelligence and self-evolution.<n>We show that an agent society satisfying continuous self-evolution, complete isolation, and safety invariance is impossible.<n>We propose several solution directions to alleviate the identified safety concern.
  arXiv  Detail & Related papers  (2026-02-10T15:18:19Z)
• Just Ask: Curious Code Agents Reveal System Prompts in Frontier LLMs [65.6660735371212]
  We present textbftextscJustAsk, a framework that autonomously discovers effective extraction strategies through interaction alone.<n>It formulates extraction as an online exploration problem, using Upper Confidence Bound--based strategy selection and a hierarchical skill space spanning atomic probes and high-level orchestration.<n>Our results expose system prompts as a critical yet largely unprotected attack surface in modern agent systems.
  arXiv  Detail & Related papers  (2026-01-29T03:53:25Z)
• When Openness Fails: Lessons from System Safety for Assessing Openness in AI [2.2077181316192473]
  We adapt five lessons from system safety that offer guidance on how openness can be evaluated at the system level.<n>To evaluate whether the intended effects of openness - such as democratization and autonomy - are realized, we need a more holistic approach.
  arXiv  Detail & Related papers  (2025-10-12T18:08:00Z)
• When Autonomy Goes Rogue: Preparing for Risks of Multi-Agent Collusion in Social Systems [78.04679174291329]
  We introduce a proof-of-concept to simulate the risks of malicious multi-agent systems (MAS)<n>We apply this framework to two high-risk fields: misinformation spread and e-commerce fraud.<n>Our findings show that decentralized systems are more effective at carrying out malicious actions than centralized ones.
  arXiv  Detail & Related papers  (2025-07-19T15:17:30Z)
• Rethinking Data Protection in the (Generative) Artificial Intelligence Era [115.71019708491386]
  We propose a four-level taxonomy that captures the diverse protection needs arising in modern (generative) AI models and systems.<n>Our framework offers a structured understanding of the trade-offs between data utility and control, spanning the entire AI pipeline.
  arXiv  Detail & Related papers  (2025-07-03T02:45:51Z)
• Toward a Public and Secure Generative AI: A Comparative Analysis of Open and Closed LLMs [0.0]
  This study aims to critically evaluate and compare the characteristics, opportunities, and challenges of open and closed generative AI models.<n>The proposed framework outlines key dimensions, openness, public governance, and security, as essential pillars for shaping the future of trustworthy and inclusive Gen AI.
  arXiv  Detail & Related papers  (2025-05-15T15:21:09Z)
• Enabling External Scrutiny of AI Systems with Privacy-Enhancing Technologies [0.0]
  This article describes how technical infrastructure developed by the nonprofit OpenMined enables external scrutiny of AI systems without compromising sensitive information. In practice, external researchers have struggled to gain access to AI systems because of AI companies' legitimate concerns about security, privacy, and intellectual property. PETs have reached a new level of maturity: end-to-end technical infrastructure developed by OpenMined combines several PETs into various setups that enable privacy-preserving audits of AI systems.
  arXiv  Detail & Related papers  (2025-02-05T15:31:11Z)
• A Blockchain-Enabled Approach to Cross-Border Compliance and Trust [0.0]
  This paper proposes a novel approach to AI governance, utilizing blockchain and distributed ledger technologies (DLT) By synthesizing advancements in blockchain, AI ethics, and cybersecurity, this paper offers a comprehensive roadmap for a decentralized AI governance framework.
  arXiv  Detail & Related papers  (2025-01-15T22:19:34Z)
• Jailbreak Attacks and Defenses against Multimodal Generative Models: A Survey [50.031628043029244]
  Multimodal generative models are susceptible to jailbreak attacks, which can bypass built-in safety mechanisms and induce the production of potentially harmful content. This survey reviews jailbreak and defense in multimodal generative models.
  arXiv  Detail & Related papers  (2024-11-14T07:51:51Z)
• Exploiting and Securing ML Solutions in Near-RT RIC: A Perspective of an xApp [9.199924426745948]
  Open Radio Access Networks (O-RAN) are emerging as a disruptive technology. O-RAN is attractive to network providers for beyond-5G and 6G deployments. The ability to deploy custom applications, including Machine Learning (ML) solutions as xApps or rApps on the RAN Intelligent Controllers (RICs) has immense potential for network function and resource optimisation. However, the openness, nascent standards, and distributed architecture of O-RAN and RICs introduce numerous vulnerabilities exploitable through multiple attack vectors.
  arXiv  Detail & Related papers  (2024-06-18T06:12:57Z)
• Risks and Opportunities of Open-Source Generative AI [64.86989162783648]
  Applications of Generative AI (Gen AI) are expected to revolutionize a number of different areas, ranging from science & medicine to education. The potential for these seismic changes has triggered a lively debate about the potential risks of the technology, and resulted in calls for tighter regulation. This regulation is likely to put at risk the budding field of open-source generative AI.
  arXiv  Detail & Related papers  (2024-05-14T13:37:36Z)
• Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems [88.80306881112313]
  We will introduce and define a family of approaches to AI safety, which we will refer to as guaranteed safe (GS) AI. The core feature of these approaches is that they aim to produce AI systems which are equipped with high-assurance quantitative safety guarantees. We outline a number of approaches for creating each of these three core components, describe the main technical challenges, and suggest a number of potential solutions to them.
  arXiv  Detail & Related papers  (2024-05-10T17:38:32Z)
• Near to Mid-term Risks and Opportunities of Open-Source Generative AI [94.06233419171016]
  Applications of Generative AI are expected to revolutionize a number of different areas, ranging from science & medicine to education. The potential for these seismic changes has triggered a lively debate about potential risks and resulted in calls for tighter regulation. This regulation is likely to put at risk the budding field of open-source Generative AI.
  arXiv  Detail & Related papers  (2024-04-25T21:14:24Z)
• Coordinated Flaw Disclosure for AI: Beyond Security Vulnerabilities [1.3225694028747144]
  We propose a Coordinated Flaw Disclosure framework tailored to the complexities of machine learning (ML) issues. Our framework introduces innovations such as extended model cards, dynamic scope expansion, an independent adjudication panel, and an automated verification process. We argue that CFD could significantly enhance public trust in AI systems.
  arXiv  Detail & Related papers  (2024-02-10T20:39:04Z)
• Managing extreme AI risks amid rapid progress [171.05448842016125]
  We describe risks that include large-scale social harms, malicious uses, and irreversible loss of human control over autonomous AI systems. There is a lack of consensus about how exactly such risks arise, and how to manage them. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
  arXiv  Detail & Related papers  (2023-10-26T17:59:06Z)
• Detecting Unknown Attacks in IoT Environments: An Open Set Classifier for Enhanced Network Intrusion Detection [5.787704156827843]
  In this paper, we introduce a framework aimed at mitigating the open set recognition (OSR) problem in the realm of Network Intrusion Detection Systems (NIDS) tailored for IoT environments. Our framework capitalizes on image-based representations of packet-level data, extracting spatial and temporal patterns from network traffic. The empirical results prominently underscore the framework's efficacy, boasting an impressive 88% detection rate for previously unseen attacks.
  arXiv  Detail & Related papers  (2023-09-14T06:41:45Z)
• Bayesian Embeddings for Few-Shot Open World Recognition [60.39866770427436]
  We extend embedding-based few-shot learning algorithms to the open-world recognition setting. We benchmark our framework on open-world extensions of the common MiniImageNet and TieredImageNet few-shot learning datasets.
  arXiv  Detail & Related papers  (2021-07-29T00:38:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.