SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding
- URL: http://arxiv.org/abs/2606.22694v1
- Date: Sun, 21 Jun 2026 22:15:48 GMT
- Title: SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding
- Abstract summary: We propose SATURN, a neuro-symbolic framework for perspective-aware compositional spatial reasoning.<n> SATURN reconstructs an approximate 3D scene, derives soft perspective-aware spatial predicates, and composes them with a training-free Pythonic symbolic executor.<n>On the real-world MindCube benchmark, SATURN achieves 78.57% overall accuracy, outperforming the strongest baseline by 14 pp.
- Score: 24.60984483500893
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Vision-Language Models (VLMs) remain unreliable when spatial reasoning requires composing relations whose meanings depend on frames of reference. Existing neuro-symbolic methods make reasoning more explicit, but often depend on brittle geometric procedures and hard decisions over noisy perception. We propose SATURN, a neuro-symbolic framework for perspective-aware compositional spatial reasoning. SATURN reconstructs an approximate 3D scene, derives soft perspective-aware spatial predicates, and composes them with a training-free Pythonic symbolic executor, separating perception from reasoning while preserving uncertainty through multi-hop inference. We also introduce 3D FORCE, a diagnostic benchmark that controls reasoning depth, view, and perspective composition across spatial arrangement grounding (SAG) and referring expression grounding (REF). On 3D FORCE, VLMs and spatially trained models degrade sharply as depth and perspective complexity increase, whereas SATURN remains stable and outperforms strong baselines. On the real-world MindCube benchmark, SATURN achieves 78.57% overall accuracy, outperforming the strongest baseline by 14 pp.
Related papers
- Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning [63.07529952817935]
We argue that while Vision-Language Models (VLMs) are trained to interpret 2D projections, true spatial reasoning demands the recovery of latent 3D geometry and temporal continuity.<n>We present FactoSR, a factorized reinforcement learning framework that explicitly interpret the dimensions collapsed by visual projection.
arXiv Detail & Related papers (2026-09-03T12:01:02Z) - Disentangling 3D Modeling from Spatial Reasoning [56.3819096070689]
We explore an alternative paradigm for spatial reasoning by explicitly disentangling 3D perception from reasoning.<n>Our key observation is that modern perception models excel at estimating continuous 3D geometry, whereas large language models (LLMs) are particularly effective at compositional and symbolic reasoning.<n>Motivated by these complementary strengths, we propose the Disentangled Spatial Reasoner (DiSR)<n>DiSR reconstructs the physical world into structured 3D evidence using off-the-shelf expert perception models and fine-tunes an LLM with LoRA to perform reasoning solely over this explicit geometric evidence.
arXiv Detail & Related papers (2026-08-05T14:32:48Z) - S-Agent: Spatial Tool-Use Elicits Reasoning for Spatial Intelligence [77.5121349100339]
textscS-Agent reshapes spatial perception into scene-centric understanding beyond frame-centric recognition.<n>textscS-Agent casts the VLM as a semantic planner that decides what evidence is needed.<n>textscS-Agent consistently improves both open-source and closed-source VLMs in a training-free manner.
arXiv Detail & Related papers (2026-06-18T17:34:55Z) - SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes [15.076506371158876]
Humans can effortlessly perceive spatial layouts, form cognitive representations, and translate such reasoning into actions in everyday 3D environments.<n>Recent vision-language models (VLMs) have shown promising performance on observation-conditioned spatial perception and reasoning tasks.<n>We introduce textbfSpatialAct, a simulator-grounded benchmark for probing textitaction-conditioned spatial reasoning in 3D scenes.
arXiv Detail & Related papers (2026-05-29T10:59:26Z) - SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoning [67.67774742200626]
spatial intelligence, which refers to the ability to reason about geometric and physical structure from visual observations, is a core challenge for large language models.<n>We propose a unified multimodal generation framework that integrates textual reasoning with visual imagination.<n>Our framework adopts a divide-and-conquer strategy, using text chain-of-thought for high-level semantic planning and the visual imagination for geometry-sensitive state transformation and consistency preservation.
arXiv Detail & Related papers (2026-04-19T11:21:59Z) - SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environments [75.60795462502949]
SpatialEvo is a self-evolving framework for 3D spatial reasoning.<n>It formalizes 16 spatial reasoning task categories under explicit geometric validation rules.<n>It converts unannotated 3D scenes into zero-noise interactive oracles, replacing model consensus with objective physical feedback.
arXiv Detail & Related papers (2026-04-15T17:59:12Z) - SpatialFly: Geometry-Guided Representation Alignment for UAV Vision-and-Language Navigation in Urban Environments [49.966170814478915]
We propose a geometry-guided spatial representation framework for UAV VLN.<n>Running on RGB observations without explicit 3D reconstruction, SpatialFly introduces a geometry-guided 2D representation alignment mechanism.<n> Experimental results show that SpatialFly consistently outperforms state-of-the-art UAV VLN baselines across both seen and unseen environments.
arXiv Detail & Related papers (2026-03-22T03:56:58Z) - 3ViewSense: Spatial and Mental Perspective Reasoning from Orthographic Views in Vision-Language Models [16.924616915709123]
Vision-Language Models fail to construct coherent 3D mental representations from 2D observations.<n>We introduce textbf3ViewSense', a framework that grounds spatial reasoning in Orthographic Views.<n> Empirical results on spatial reasoning benchmarks demonstrate that our method significantly outperforms existing baselines.
arXiv Detail & Related papers (2026-03-08T17:57:56Z) - RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoning [61.84363374647606]
Remote Sensing Visual Grounding (RSVG) aims to localize target objects in large-scale aerial imagery based on natural language descriptions.<n>These descriptions often rely heavily on positional cues, posing unique challenges for Multimodal Large Language Models (MLLMs) in spatial reasoning.<n>We propose a reasoning-guided, position-aware post-training framework, dubbed textbfRSGround-R1, to progressively enhance spatial understanding.
arXiv Detail & Related papers (2026-01-29T12:35:57Z) - SpatialDreamer: Incentivizing Spatial Reasoning via Active Mental Imagery [64.67498968405327]
SpatialDreamer is a reinforcement learning framework that enables spatial reasoning through a closedloop process of active exploration.<n>GeoPO introduces tree-structured sampling and step-level reward estimation with consistency geometric constraints.
arXiv Detail & Related papers (2025-12-08T17:20:50Z) - REM: Evaluating LLM Embodied Spatial Reasoning through Multi-Frame Trajectories [19.741468026765062]
We introduce REM (Reasoning over Embodied Multi-Frame Trajectories), a benchmark using controllable 3D environments for embodied spatial reasoning.<n> REM systematically evaluates key aspects like object permanence/distinction, spatial relationships, and numerical tracking across dynamic embodied viewpoints.<n>Our evaluation shows that the best-performing current models exhibit promising overall performance, but become increasingly unreliable at even moderate complexity levels easily handled by humans.
arXiv Detail & Related papers (2025-11-30T05:20:22Z) - Video Spatial Reasoning with Object-Centric 3D Rollout [58.12446467377404]
We propose Object-Centric 3D Rollout (OCR) to enable robust video spatial reasoning.<n>OCR introduces structured perturbations to the 3D geometry of selected objects during training.<n>OCR compels the model to reason holistically across the entire scene.
arXiv Detail & Related papers (2025-11-17T09:53:41Z) - Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models [14.442394137843923]
We present a detailed analysis that first delineates the core elements of spatial reasoning.<n>We then assesses the performance of these models in both synthetic and real-world images.
arXiv Detail & Related papers (2025-03-25T14:34:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.