From Human Cognition to Neural Activations: Probing the Computational Primitives of Spatial Reasoning in LLMs

• URL: http://arxiv.org/abs/2603.26323v1
• Date: Fri, 27 Mar 2026 11:42:36 GMT
• Title: From Human Cognition to Neural Activations: Probing the Computational Primitives of Spatial Reasoning in LLMs
• Abstract summary: spatial intelligence becomes an increasingly important capability for foundation models.<n>It remains unclear whether foundation models' performance on spatial reasoning benchmarks reflects structured internal spatial representations or reliance on language models.
• Score: 2.3268065525165316
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: As spatial intelligence becomes an increasingly important capability for foundation models, it remains unclear whether large language models' (LLMs) performance on spatial reasoning benchmarks reflects structured internal spatial representations or reliance on linguistic heuristics. We address this question from a mechanistic perspective by examining how spatial information is internally represented and used. Drawing on computational theories of human spatial cognition, we decompose spatial reasoning into three primitives, relational composition, representational transformation, and stateful spatial updating, and design controlled task families for each. We evaluate multilingual LLMs in English, Chinese, and Arabic under single pass inference, and analyze internal representations using linear probing, sparse autoencoder based feature analysis, and causal interventions. We find that task relevant spatial information is encoded in intermediate layers and can causally influence behavior, but these representations are transient, fragmented across task families, and weakly integrated into final predictions. Cross linguistic analysis further reveals mechanistic degeneracy, where similar behavioral performance arises from distinct internal pathways. Overall, our results suggest that current LLMs exhibit limited and context dependent spatial representations rather than robust, general purpose spatial reasoning, highlighting the need for mechanistic evaluation beyond benchmark accuracy.

Related papers

• SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video [88.79625979053873]
  We propose a novel framework, SpaceEra, for pre-trained vision-language models (VLMs)<n>We extend the original framework into a comprehensive system, termed SpaceEra++, which spans data construction, model design, training optimization, and prompting inference.<n>In addition, to enhance spatial reasoning, we develop SpaceAlign, which enforces pairwise object constraints by jointly exploiting absolute coordinates and relative spatial relations.
  arXiv  Detail & Related papers  (2026-07-02T06:56:29Z)
• Reasoning emerges from constrained inference manifolds in large language models [98.6966322378456]
  We study reasoning as an intrinsic dynamical process by examining the evolution of internal representations during inference.<n>We find that such geometric compression, although pervasive, is not sufficient for stable or reliable reasoning.
  arXiv  Detail & Related papers  (2026-05-02T10:41:20Z)
• SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoning [67.67774742200626]
  spatial intelligence, which refers to the ability to reason about geometric and physical structure from visual observations, is a core challenge for large language models.<n>We propose a unified multimodal generation framework that integrates textual reasoning with visual imagination.<n>Our framework adopts a divide-and-conquer strategy, using text chain-of-thought for high-level semantic planning and the visual imagination for geometry-sensitive state transformation and consistency preservation.
  arXiv  Detail & Related papers  (2026-04-19T11:21:59Z)
• EgoMind: Activating Spatial Cognition through Linguistic Reasoning in MLLMs [36.84953281346447]
  EgoMind is a Chainof-Thought framework that enables geometry-free spatial reasoning through RolePlay Caption.<n>With only 5K samples and 20K RL samples, EgoMind achieves effectiveness in MLLMBenchs, SITEBench, and SPBench.
  arXiv  Detail & Related papers  (2026-04-01T15:28:13Z)
• SpatialText: A Pure-Text Cognitive Benchmark for Spatial Understanding in Large Language Models [12.26174714418171]
  Genuine spatial reasoning relies on the capacity to construct and manipulate coherent internal spatial representations.<n>Existing benchmarks fail to isolate this intrinsic spatial cognition from statistical languages.<n>We introduce SpatialText, a theory-driven diagnostic framework.
  arXiv  Detail & Related papers  (2026-03-03T13:52:40Z)
• Emergent Structured Representations Support Flexible In-Context Inference in Large Language Models [77.98801218316505]
  Large language models (LLMs) exhibit emergent behaviors suggestive of human-like reasoning.<n>We investigate the internal processing of LLMs during in-context concept inference.
  arXiv  Detail & Related papers  (2026-02-08T03:14:39Z)
• From Indoor to Open World: Revealing the Spatial Reasoning Gap in MLLMs [65.04549036809557]
  We introduce a benchmark built from pedestrian-perspective videos captured with synchronized stereo cameras, LiDAR, and IMU/GPS sensors.<n>This dataset provides metrically precise 3D information, enabling the automatic generation of spatial reasoning questions.<n> Evaluations reveal that the performance gains observed in structured indoor benchmarks vanish in open-world settings.
  arXiv  Detail & Related papers  (2025-12-22T18:58:12Z)
• Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models [14.442394137843923]
  We present a detailed analysis that first delineates the core elements of spatial reasoning.<n>We then assesses the performance of these models in both synthetic and real-world images.
  arXiv  Detail & Related papers  (2025-03-25T14:34:06Z)
• Beyond Semantics: Rediscovering Spatial Awareness in Vision-Language Models [13.768090541138571]
  Vision Language Models (VLMs) excel at identifying and describing objects but often fail at spatial reasoning.<n>Our analysis reveals a key imbalance: vision token embeddings have much larger norms than text tokens.<n>Tools uncover that vision tokens and system prompts dominate attention.
  arXiv  Detail & Related papers  (2025-03-21T17:51:14Z)
• SpaRC and SpaRP: Spatial Reasoning Characterization and Path Generation for Understanding Spatial Reasoning Capability of Large Language Models [70.01883340129204]
  spatial reasoning is a crucial component of both biological and artificial intelligence. We present a comprehensive study of the capability of current state-of-the-art large language models (LLMs) on spatial reasoning.
  arXiv  Detail & Related papers  (2024-06-07T01:06:34Z)
• Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoning [4.422649561583363]
  We present a novel benchmark for assessing spatial reasoning in language models (LMs) It is grounded in realistic 3D simulation data, offering a series of diverse room layouts with various objects and their spatial relationships. A key contribution is our logic-based consistency-checking tool, which enables the assessment of multiple plausible solutions.
  arXiv  Detail & Related papers  (2024-05-23T21:22:00Z)
• More than Correlation: Do Large Language Models Learn Causal Representations of Space? [6.293100288400849]
  This study focused on uncovering the causality of the spatial representations in large language models. Experiments showed that the spatial representations influenced the model's performance on next word prediction and a downstream task that relies on geospatial information.
  arXiv  Detail & Related papers  (2023-12-26T01:27:29Z)
• Unveiling A Core Linguistic Region in Large Language Models [49.860260050718516]
  This paper conducts an analogical research using brain localization as a prototype. We have discovered a core region in large language models that corresponds to linguistic competence. We observe that an improvement in linguistic competence does not necessarily accompany an elevation in the model's knowledge level.
  arXiv  Detail & Related papers  (2023-10-23T13:31:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.