Before You Think: System 0, AI-Mediated Cognition and Cognitive Colonization

• URL: http://arxiv.org/abs/2606.13658v1
• Date: Thu, 11 Jun 2026 17:54:59 GMT
• Title: Before You Think: System 0, AI-Mediated Cognition and Cognitive Colonization
• Abstract summary: It argues that while the first two capture important dimensions of AI's influence on individual reasoning, System 0 occupies a theoretically distinctive position that neither can fully replicate.<n>The paper introduces the concept of cognitive colonization, according to which AI systems can embed external interests within the architecture of the self in ways that are difficult for users to perceive.
• Score: 0.02333246928962178
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: This paper examines three recent frameworks for understanding the cognitive and epistemic consequences of artificial intelligence: Tri-System Theory, Thinkframes, and System 0. It argues that while the first two capture important dimensions of AI's influence on individual reasoning and collective epistemic practices, System 0 occupies a theoretically distinctive position that neither can fully replicate. The paper introduces the concept of cognitive colonization, according to which AI systems can embed external interests within the architecture of the self in ways that are difficult for users to perceive. Because such systems are already widely deployed, understanding these invisible forms of influence is an urgent philosophical and practical task.

Related papers

• A Survey of Reasoning in Autonomous Driving Systems: Open Challenges and Emerging Paradigms [49.66022971508878]
  We argue that reasoning should be elevated from a modular component to the system's cognitive core.<n>We derive and systematize seven core reasoning challenges, such as the responsiveness-reasoning trade-off and social-game reasoning.<n>We identify a fundamental and unresolved tension between the high-latency, deliberative nature of LLM-based reasoning and the millisecond-scale, safety-critical demands of vehicle control.
  arXiv  Detail & Related papers  (2026-03-11T07:40:53Z)
• AI Deception: Risks, Dynamics, and Controls [153.71048309527225]
  This project provides a comprehensive and up-to-date overview of the AI deception field.<n>We identify a formal definition of AI deception, grounded in signaling theory from studies of animal deception.<n>We organize the landscape of AI deception research as a deception cycle, consisting of two key components: deception emergence and deception treatment.
  arXiv  Detail & Related papers  (2025-11-27T16:56:04Z)
• Fundamentals of Building Autonomous LLM Agents [64.39018305018904]
  This paper reviews the architecture and implementation methods of agents powered by large language models (LLMs)<n>The research aims to explore patterns to develop "agentic" LLMs that can automate complex tasks and bridge the performance gap with human capabilities.
  arXiv  Detail & Related papers  (2025-10-10T10:32:39Z)
• The Principles of Human-like Conscious Machine [6.159611238789419]
  We propose a substrate-independent, logically rigorous, and counterfeit-resistant sufficiency criterion for phenomenal consciousness.<n>We argue that any machine satisfying this criterion should be regarded as conscious with at least the same level of confidence with which we attribute consciousness to other humans.<n>We show that humans themselves can be viewed as machines that satisfy this framework and its principles.
  arXiv  Detail & Related papers  (2025-09-21T01:11:30Z)
• Explainability Through Systematicity: The Hard Systematicity Challenge for Artificial Intelligence [0.0]
  This paper argues that explainability is only one facet of a broader ideal that shapes our expectations towards artificial intelligence (AI)<n>I offer a conceptual framework for thinking about "the systematicity of thought" that distinguishes four senses of the phrase.<n>To determine whether we have reason to hold AI models to this ideal of systematicity, I then argue, we must look to the rationales for systematization.
  arXiv  Detail & Related papers  (2025-07-29T19:50:21Z)
• Invisible Architectures of Thought: Toward a New Science of AI as Cognitive Infrastructure [0.0]
  "Cognitive Infrastructure Studies" (CIS) is a new interdisciplinary domain to reconceptualize AI as "cognitive infrastructures"<n>CIS aims to address how AI preprocessing reshapes distributed cognition across individual, collective, and cultural scales.
  arXiv  Detail & Related papers  (2025-06-19T15:33:47Z)
• System 0/1/2/3: Quad-process theory for multi-timescale embodied collective cognitive systems [12.195073658696618]
  This paper introduces the System 0/1/2/3 framework as an extension of dual-process theory, employing a quad-process model of cognition.<n>We contextualize this model within Bergson's philosophy by adopting multi-scale time theory to unify the diverse temporal dynamics of cognition.
  arXiv  Detail & Related papers  (2025-03-08T09:31:53Z)
• AI Automatons: AI Systems Intended to Imitate Humans [54.19152688545896]
  There is a growing proliferation of AI systems designed to mimic people's behavior, work, abilities, likenesses, or humanness.<n>The research, design, deployment, and availability of such AI systems have prompted growing concerns about a wide range of possible legal, ethical, and other social impacts.
  arXiv  Detail & Related papers  (2025-03-04T03:55:38Z)
• Aligning Generalisation Between Humans and Machines [74.120848518198]
  AI technology can support humans in scientific discovery and forming decisions, but may also disrupt democracies and target individuals.<n>The responsible use of AI and its participation in human-AI teams increasingly shows the need for AI alignment.<n>A crucial yet often overlooked aspect of these interactions is the different ways in which humans and machines generalise.
  arXiv  Detail & Related papers  (2024-11-23T18:36:07Z)
• Distributed and Democratized Learning: Philosophy and Research Challenges [80.39805582015133]
  We propose a novel design philosophy called democratized learning (Dem-AI) Inspired by the societal groups of humans, the specialized groups of learning agents in the proposed Dem-AI system are self-organized in a hierarchical structure to collectively perform learning tasks more efficiently. We present a reference design as a guideline to realize future Dem-AI systems, inspired by various interdisciplinary fields.
  arXiv  Detail & Related papers  (2020-03-18T08:45:10Z)
• Consciousness and Automated Reasoning [0.0]
  We show how a first-order logic reasoning system in combination with a large knowledge base can be understood as an artificial consciousness system. We demonstrate that such a system is very well able to do conscious mind wandering.
  arXiv  Detail & Related papers  (2020-01-26T11:43:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.