A Navigable Manifold of Hypothesized Consciousness-Spectrum States in Language Model Representations

• URL: http://arxiv.org/abs/2606.09894v1
• Date: Thu, 04 Jun 2026 04:33:17 GMT
• Title: A Navigable Manifold of Hypothesized Consciousness-Spectrum States in Language Model Representations
• Abstract summary: We study the geometric structure and dynamics of patterns along this spectrum in transformer embedding spaces.<n>We show that embeddings exhibit a globally organized geometry aligned with this spectrum.<n>Results suggest that embedding spaces encode structured and navigable geometry aligned with a hypothesized consciousness-spectrum taxonomy.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Across contemplative, philosophical, and psychological accounts, human consciousness is often described along a similar spectrum, ranging from reactive and self-focused patterns to more integrative and coherent ones. Understanding whether language models encode such a structured, human-interpretable consciousness spectrum in representation space is important for model guidance, evaluation and alignment. In this work, we study the geometric structure and dynamics of patterns along this spectrum in transformer embedding spaces. We show that embeddings exhibit a globally organized geometry aligned with this spectrum: sentences associated with similar states cluster into locally coherent regions, forming a structured manifold. In particular, higher-level and lower-level regions exhibit convexity-like stability, while intermediate regions form a transition corridor. Dynamically, both utility-guided and geometry-only greedy trajectories consistently traverse from lower- to higher-level regions, passing through intermediate tiers, indicating that navigability is an intrinsic property of the representation space, guided but not dictated by a global directional signal. These results suggest that embedding spaces encode structured and navigable geometry aligned with a hypothesized consciousness-spectrum taxonomy, broadly inspired by recurring structural descriptions of human consciousness across contemplative traditions, philosophy, and modern psychology, providing a representation-level perspective for analyzing and guiding model behavior.

Related papers

• Aristotelian Manifolds: Leveraging Platonic Perceptual Features for Backpropagation Free Rapid Concept Learning [4.941630596191806]
  This paper formalizes and systematically characterizes Aristotelian Manifolds.<n>Our characterization reveals that semantic maturation does not follow a singular, monotonic path.<n>Ultimately, this systematic characterization demonstrates that mapping the internal geometry of frozen representations provides a robust, backpropagation-free, and interpretable framework.
  arXiv  Detail & Related papers  (2026-08-21T02:38:12Z)
• Warp-free Cross-view Geo-localization via Feature-space Consensus Mining [49.843311525678565]
  Cross-view geo-localization is challenging due to drastic viewpoint changes and large appearance discrepancies between street-level and satellite imagery.<n>We propose a novel joint-view consensus-guided learning framework that entirely bypasses explicit geometric warping.
  arXiv  Detail & Related papers  (2026-08-10T09:02:06Z)
• Transformer Geometry Observatory TGO-III: Semantic Geometry Observatory [2.4900509453584156]
  This work investigates semantic geometry and class separability as representations evolve across layers of ViT-Small/16 through TGO-III: Semantic Geometry Observatory.<n>It is a framework designed to analyze the emergence of semantic organization, feature evolution, and class-wise representation geometry throughout training.
  arXiv  Detail & Related papers  (2026-08-03T08:21:16Z)
• Abstract representational geometry supports inference in large language models [9.40587716832914]
  Internal mechanisms of large language models remain largely opaque, making it unclear whether they form comparable abstract representations or rely on task-specific statistical regularities when performing comparable reasoning tasks.<n>We report that although LLMs exhibit generalizable reasoning less frequently than humans, when such inference occurs, their internal states exhibit abstract geometric structures that resemble those reported in the hippocampus.
  arXiv  Detail & Related papers  (2026-06-22T13:50:34Z)
• AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customization [79.26935895370191]
  AnchorWorld is a framework that advances egocentric simulation through enhanced interaction integrity.<n> auxiliary training supervision incorporates viewpoints decoupled from the agent's first-person sensorium.<n>We propose a simple yet effective mechanism for customizing self-evolving worlds.
  arXiv  Detail & Related papers  (2026-06-05T14:43:13Z)
• Geometry of Human Perceptual Domains Emerges Transiently in LLM Representations [1.503974529275767]
  We study the emergence of intrinsic geometrical structure corresponding to perceptual modalities within the residual streams of open-weight transformer architectures.<n>We observe the emergence of layer-wise geometric structure across multiple perceptual domains, despite the absence of any direct perceptual supervision during training.<n>This provides new insight into how and where human-like perceptual geometry arises in large language models.
  arXiv  Detail & Related papers  (2026-05-27T05:04:29Z)
• LAST: Bridging Vision-Language and Action Manifolds via Gromov-Wasserstein Alignment [71.3712075841632]
  LAST reconstructs the action space to establish local metric compatibility with the Vision-Language-Action modality.<n> LAST enables VLA models with superior convergence and generalizability.
  arXiv  Detail & Related papers  (2026-05-27T03:48:10Z)
• Beyond Point-Wise Matching: Structural Representation Alignment for Accelerating Diffusion Transformers [93.3976834364707]
  We propose sREPA, a structural REPresentation Alignment framework to enforce consistency in the relational geometry of feature maps.<n>By encouraging the model to internalize holistic spatial layouts and structural correlations from pre-trained features, sREPA achieves faster and more stable convergence.
  arXiv  Detail & Related papers  (2026-05-16T12:01:04Z)
• SpatialText: A Pure-Text Cognitive Benchmark for Spatial Understanding in Large Language Models [12.26174714418171]
  Genuine spatial reasoning relies on the capacity to construct and manipulate coherent internal spatial representations.<n>Existing benchmarks fail to isolate this intrinsic spatial cognition from statistical languages.<n>We introduce SpatialText, a theory-driven diagnostic framework.
  arXiv  Detail & Related papers  (2026-03-03T13:52:40Z)
• Barycentric alignment for instance-level comparison of neural representations [2.1920579994942164]
  We introduce a barycentric alignment framework that quotients out nuisance symmetries to construct a universal embedding space across many models.<n>We identify systematic input properties that predict representational convergence versus divergence across vision and language model families.<n>We also apply the same barycentric alignment framework to purely unimodal vision and language models and find that post-hoc alignment into a shared space yields image text similarity scores.
  arXiv  Detail & Related papers  (2026-02-09T21:49:44Z)
• Beyond Global Alignment: Fine-Grained Motion-Language Retrieval via Pyramidal Shapley-Taylor Learning [56.6025512458557]
  Motion-language retrieval aims to bridge the semantic gap between natural language and human motion.<n>Existing approaches predominantly focus on aligning entire motion sequences with global textual representations.<n>We propose a novel Pyramidal Shapley-Taylor (PST) learning framework for fine-grained motion-language retrieval.
  arXiv  Detail & Related papers  (2026-01-29T16:00:12Z)
• Interpretation as Linear Transformation: A Cognitive-Geometric Model of Belief and Meaning [0.0]
  I show how belief distortion, motivational drift, counterfactual evaluation, and the limits of mutual understanding arise from purely algebraic constraints.<n>I argue that this cognitive-geometric perspective clarifies the boundaries of influence in both human and artificial systems.
  arXiv  Detail & Related papers  (2025-12-10T17:13:01Z)
• GeoGNN: Quantifying and Mitigating Semantic Drift in Text-Attributed Graphs [59.61242815508687]
  Graph neural networks (GNNs) on text--attributed graphs (TAGs) encode node texts using pretrained language models (PLMs) and propagate these embeddings through linear neighborhood aggregation.<n>This work introduces a local PCA-based metric that measures the degree of semantic drift and provides the first quantitative framework to analyze how different aggregation mechanisms affect manifold structure.
  arXiv  Detail & Related papers  (2025-11-12T06:48:43Z)
• SPHERE: Unveiling Spatial Blind Spots in Vision-Language Models Through Hierarchical Evaluation [7.659514491338669]
  Current vision-language models may grasp basic spatial cues but struggle with the multi-dimensional spatial reasoning necessary for human-like understanding and real-world applications.<n>We develop SPHERE, a hierarchical evaluation framework supported by a new human-annotated dataset.<n> Benchmark evaluation of state-of-the-art models reveals significant deficiencies, especially in reasoning about distance and proximity.
  arXiv  Detail & Related papers  (2024-12-17T09:10:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.