Disentangling 3D Modeling from Spatial Reasoning

• URL: http://arxiv.org/abs/2608.05242v2
• Date: Fri, 07 Aug 2026 00:33:45 GMT
• Title: Disentangling 3D Modeling from Spatial Reasoning
• Abstract summary: We explore an alternative paradigm for spatial reasoning by explicitly disentangling 3D perception from reasoning.<n>Our key observation is that modern perception models excel at estimating continuous 3D geometry, whereas large language models (LLMs) are particularly effective at compositional and symbolic reasoning.<n>Motivated by these complementary strengths, we propose the Disentangled Spatial Reasoner (DiSR)<n>DiSR reconstructs the physical world into structured 3D evidence using off-the-shelf expert perception models and fine-tunes an LLM with LoRA to perform reasoning solely over this explicit geometric evidence.
• Score: 56.3819096070689
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this work, we explore an alternative paradigm for spatial reasoning by explicitly disentangling 3D perception from reasoning, rather than jointly acquiring implicit 3D perception and reasoning through large-scale training. Our key observation is that modern perception models excel at estimating continuous 3D geometry, whereas large language models (LLMs) are particularly effective at compositional and symbolic reasoning. Motivated by these complementary strengths, we propose the Disentangled Spatial Reasoner (DiSR), a simple yet effective framework that reconstructs the physical world into structured 3D evidence using off-the-shelf expert perception models and fine-tunes an LLM with LoRA to perform reasoning solely over this explicit geometric evidence. Without large-scale 3D VQA training or complex tool-use policies, DiSR achieves competitive performance on popular spatial reasoning benchmarks. Beyond its strong performance, DiSR offers improved interpretability, modularity, and computational efficiency, demonstrating that explicit separation of perception and reasoning is a scalable and effective alternative paradigm to end-to-end modeling for spatial intelligence.

Related papers

• Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning [63.07529952817935]
  We argue that while Vision-Language Models (VLMs) are trained to interpret 2D projections, true spatial reasoning demands the recovery of latent 3D geometry and temporal continuity.<n>We present FactoSR, a factorized reinforcement learning framework that explicitly interpret the dimensions collapsed by visual projection.
  arXiv  Detail & Related papers  (2026-09-03T12:01:02Z)
• SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environments [75.60795462502949]
  SpatialEvo is a self-evolving framework for 3D spatial reasoning.<n>It formalizes 16 spatial reasoning task categories under explicit geometric validation rules.<n>It converts unannotated 3D scenes into zero-noise interactive oracles, replacing model consensus with objective physical feedback.
  arXiv  Detail & Related papers  (2026-04-15T17:59:12Z)
• World2Mind: Cognition Toolkit for Allocentric Spatial Reasoning in Foundation Models [25.135316296678187]
  Existing methods either overfit statistical shortcuts via 3D grounding data or remain confined to 2D visual perception.<n>We propose World2Mind, a training-free spatial intelligence toolkit.<n>We show that World2Mind boosts the performance of frontier models, such as GPT-5.2, by 5%18%.
  arXiv  Detail & Related papers  (2026-03-10T15:12:14Z)
• CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning [40.654048754955404]
  CamReasoner is a framework that reformulates camera movement understanding as a structured inference process.<n>We are the first to employ RL for logical alignment in this domain, ensuring motion inferences are grounded in physical geometry.
  arXiv  Detail & Related papers  (2026-01-30T04:45:43Z)
• CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligence [6.2150701899678635]
  CoRe3D introduces a unified 3D understanding and generation reasoning framework that jointly operates over semantic and spatial abstractions.<n>By tightly coupling semantic chain-of-thought inference with structured spatial reasoning, CoRe3D produces 3D outputs that exhibit strong local consistency and faithful alignment with linguistic descriptions.
  arXiv  Detail & Related papers  (2025-12-14T17:05:11Z)
• Video Spatial Reasoning with Object-Centric 3D Rollout [58.12446467377404]
  We propose Object-Centric 3D Rollout (OCR) to enable robust video spatial reasoning.<n>OCR introduces structured perturbations to the 3D geometry of selected objects during training.<n>OCR compels the model to reason holistically across the entire scene.
  arXiv  Detail & Related papers  (2025-11-17T09:53:41Z)
• MoRE: 3D Visual Geometry Reconstruction Meets Mixture-of-Experts [50.37005070020306]
  MoRE is a dense 3D visual foundation model based on a Mixture-of-Experts (MoE) architecture.<n>MoRE incorporates a confidence-based depth refinement module that stabilizes and refines geometric estimation.<n>It integrates dense semantic features with globally aligned 3D backbone representations for high-fidelity surface normal prediction.
  arXiv  Detail & Related papers  (2025-10-31T06:54:27Z)
• Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing [62.447497430479174]
  Drawing to reason in space is a novel paradigm that enables LVLMs to reason through elementary drawing operations in the visual space.<n>Our model, named VILASR, consistently outperforms existing methods across diverse spatial reasoning benchmarks.
  arXiv  Detail & Related papers  (2025-06-11T17:41:50Z)
• SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning [23.6011224506759]
  We introduce a novel large vision-language model (LVLM) that addresses 3D spatial reasoning.<n>Explicit 3D representations provide a coherent interface that supports advanced 3D spatial reasoning.<n>Results show that our SpatialReasoner achieves improved performance on a variety of spatial reasoning benchmarks.
  arXiv  Detail & Related papers  (2025-04-28T17:48:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.