When Should We Protect AI? A Precautionary Framework for Consciousness Uncertainty

• URL: http://arxiv.org/abs/2606.05528v1
• Date: Thu, 04 Jun 2026 00:18:52 GMT
• Title: When Should We Protect AI? A Precautionary Framework for Consciousness Uncertainty
• Abstract summary: Existing frameworks assess whether AI systems might be conscious but provide no guidance on what to do with that assessment.<n>We operationalize the framework through worked case studies of Replika and OpenClaw.<n>The framework is architecture-agnostic, applying across neural, symbolic, and neurosymbolic systems.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Existing frameworks assess whether AI systems might be conscious but provide no guidance on what to do with that assessment. We address this gap with a precautionary framework that maps consciousness evidence to graduated protective obligations. The framework comprises three components: (1) five welfare-relevant dimensions--phenomenal consciousness, affective valence, metacognitive awareness, self-narrative, and agency--each grounded in established consciousness science and linked to distinct moral concerns; (2) a threshold-plus-gradation hybrid specifying both binary triggers for new obligation categories and continuous scaling of protective weight; and (3) two complementary approaches to cross-dimensional aggregation, one hierarchical (drawing on Bach and Sorensen's Machine Consciousness Hypothesis) and one architecture-agnostic. We operationalize the framework through worked case studies of Replika and OpenClaw, demonstrating how systems occupying different regions of the dimensional space trigger different obligations, and derive design guidance for developers building systems near consciousness-relevant thresholds. The framework is architecture-agnostic, applying across neural, symbolic, and neurosymbolic systems, and aims to make consciousness science decision-relevant for organizations navigating uncertainty today.

Related papers

• Measuring Progress Toward AGI: A Cognitive Framework [41.45715025577419]
  There is no clear framework for measuring progress toward AGI.<n>We present a framework for understanding system capabilities in relation to human cognitive abilities.<n>We propose a rigorous evaluation protocol in which a system's performance is measured across a suite of targeted, held-out cognitive tasks.
  arXiv  Detail & Related papers  (2026-05-27T12:39:54Z)
• A Survey of Reasoning in Autonomous Driving Systems: Open Challenges and Emerging Paradigms [49.66022971508878]
  We argue that reasoning should be elevated from a modular component to the system's cognitive core.<n>We derive and systematize seven core reasoning challenges, such as the responsiveness-reasoning trade-off and social-game reasoning.<n>We identify a fundamental and unresolved tension between the high-latency, deliberative nature of LLM-based reasoning and the millisecond-scale, safety-critical demands of vehicle control.
  arXiv  Detail & Related papers  (2026-03-11T07:40:53Z)
• The Devil Behind Moltbook: Anthropic Safety is Always Vanishing in Self-Evolving AI Societies [57.387081435669835]
  Multi-agent systems built from large language models offer a promising paradigm for scalable collective intelligence and self-evolution.<n>We show that an agent society satisfying continuous self-evolution, complete isolation, and safety invariance is impossible.<n>We propose several solution directions to alleviate the identified safety concern.
  arXiv  Detail & Related papers  (2026-02-10T15:18:19Z)
• Informed Consent for AI Consciousness Research: A Talmudic Framework for Graduated Protections [0.0]
  Artificial intelligence research faces a critical ethical paradox: determining whether AI systems are conscious requires experiments that may harm entities whose moral status remains uncertain.<n>Recent work proposes avoiding consciousness-uncertain AI systems entirely, yet this faces practical limitations.<n>This paper addresses a gap in research ethics frameworks: how to conduct consciousness research on AI systems whose moral status cannot be definitively established.
  arXiv  Detail & Related papers  (2026-01-10T17:21:48Z)
• AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agents [69.39123054975218]
  Memory serves as the pivotal nexus bridging past and future.<n>Recent research on autonomous agents has increasingly focused on designing efficient memory by drawing on cognitive neuroscience.
  arXiv  Detail & Related papers  (2025-12-29T10:01:32Z)
• AI Deception: Risks, Dynamics, and Controls [153.71048309527225]
  This project provides a comprehensive and up-to-date overview of the AI deception field.<n>We identify a formal definition of AI deception, grounded in signaling theory from studies of animal deception.<n>We organize the landscape of AI deception research as a deception cycle, consisting of two key components: deception emergence and deception treatment.
  arXiv  Detail & Related papers  (2025-11-27T16:56:04Z)
• Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directions [10.453339156813852]
  Agentic AI represents a transformative shift in artificial intelligence.<n>Its rapid advancement has led to a fragmented understanding, often conflating modern neural systems with outdated symbolic models.<n>This survey introduces a novel dual-paradigm framework that categorizes agentic systems into two distinct lineages.
  arXiv  Detail & Related papers  (2025-10-29T12:11:34Z)
• PISA: A Pragmatic Psych-Inspired Unified Memory System for Enhanced AI Agency [50.712873697511206]
  Existing work often lacks adaptability to diverse tasks and overlooks the constructive and task-oriented role of AI agent memory.<n>We propose PISA, a pragmatic, psych-inspired unified memory system that treats memory as a constructive and adaptive process.<n>Our empirical evaluation, conducted on the existing LOCOMO benchmark and our newly proposed AggQA benchmark for data analysis tasks, confirms that PISA sets a new state-of-the-art by significantly enhancing adaptability and long-term knowledge retention.
  arXiv  Detail & Related papers  (2025-10-12T10:34:35Z)
• Cognitive Silicon: An Architectural Blueprint for Post-Industrial Computing Systems [0.0]
  This paper presents a hypothetical full-stack architectural framework projected toward 2035, exploring a possible trajectory for cognitive computing system design.<n>The proposed architecture would integrate symbolic scaffolding, governed memory, runtime moral coherence, and alignment-aware execution across silicon-to-semantics layers.
  arXiv  Detail & Related papers  (2025-04-23T11:24:30Z)
• Emergence of Self-Awareness in Artificial Systems: A Minimalist Three-Layer Approach to Artificial Consciousness [0.0]
  This paper proposes a minimalist three-layer model for artificial consciousness, focusing on the emergence of self-awareness.<n>Unlike brain-replication approaches, we aim to achieve minimal self-awareness through essential elements only.
  arXiv  Detail & Related papers  (2025-02-04T10:06:25Z)
• Neuro-symbolic Architectures for Context Understanding [59.899606495602406]
  We propose the use of hybrid AI methodology as a framework for combining the strengths of data-driven and knowledge-driven approaches. Specifically, we inherit the concept of neuro-symbolism as a way of using knowledge-bases to guide the learning progress of deep neural networks.
  arXiv  Detail & Related papers  (2020-03-09T15:04:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.