RoBoSR: Structured Scene Representations for Embodied Robotic Reasoning

• URL: http://arxiv.org/abs/2606.24338v1
• Date: Tue, 23 Jun 2026 09:24:52 GMT
• Title: RoBoSR: Structured Scene Representations for Embodied Robotic Reasoning
• Abstract summary: We introduce RoBoSR, an intermediate structural representation that formulates manipulation as step-wise state transitions.<n>By modeling object states and their spatial relations at the perception-action interface, RoBoSR disentangles high-level task reasoning from raw inputs.<n>We construct Manip-Cognition-1.6M, an open-world dataset that jointly supervises scene understanding, instruction interpretation, and subtask planning.
• Score: 14.955041656490849
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite rapid progress, embodied reasoning under real-world variability remains challenging. Existing approaches rely on demonstration-driven sequential biases, limiting flexibility in open-ended and long-horizon tasks that require structured reasoning over evolving states. We introduce RoBoSR, an intermediate structural representation that formulates manipulation as step-wise state transitions over semantically grounded, object-centric scene graphs. By modeling object states and their spatial relations at the perception-action interface, RoBoSR disentangles high-level task reasoning from raw inputs and enables structured reasoning over preconditions, effects, and goal states. This representation endows the agent with causal reasoning capability, enforcing subtask dependencies and supporting coherent long-horizon task planning. To learn such structure-aware reasoning, we construct Manip-Cognition-1.6M, an open-world dataset that jointly supervises scene understanding, instruction interpretation, and subtask planning across diverse tasks. Across several benchmarks and real-world demonstrations, our method consistently outperforms prompting-based methods and classical TAMP baselines in zero-shot generalization and long-horizon tasks. The results underscore structured intermediate representations as a critical inductive bias for scalable embodied reasoning.

Related papers

• ThinkingVLA: Interleaved Vision and Language Reasoning for Robotic Manipulation [71.69632267962993]
  We argue that manipulation planning naturally decomposes into prediction, anticipating the next visual state, and inverse dynamics.<n>We propose textbfThinkingVLA, a generative model that realizes this decomposition within a unified Mixture-of-Transformers architecture.<n>Experiments on simulation and real-world benchmarks demonstrate that ThinkingVLA consistently outperforms state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-06-16T13:45:17Z)
• Steered Generation via Gradient-Based Optimization on Sparse Query Features [1.587869707099313]
  Prototype-Based Sparse Steering is a framework that applies Sparse Autoencoders specifically to query activations.<n>We demonstrate that sparse query representations provide the necessary disentanglement for unified, interpretable control over both logical planning and stylistic nuance.
  arXiv  Detail & Related papers  (2026-05-21T21:13:14Z)
• Deep Reasoning in General Purpose Agents via Structured Meta-Cognition [58.185853639335896]
  We introduce an inference-time approach for constructing task-specific scaffolds through structured meta-reasoning.<n>We instantiate this approach in a general-purpose agent that distributes complex tasks across more controlled reasoning threads.
  arXiv  Detail & Related papers  (2026-05-12T01:21:37Z)
• Dynamics Within Latent Chain-of-Thought: An Empirical Study of Causal Structure [58.89643769707751]
  We study latent chain-of-thought as a manipulable causal process in representation space.<n>We find that latent-step budgets behave less like homogeneous extra depth and more like staged functionality with non-local routing.<n>These results motivate mode-conditional and stability-aware analyses as more reliable tools for interpreting and improving latent reasoning systems.
  arXiv  Detail & Related papers  (2026-02-09T15:25:12Z)
• Emergent Structured Representations Support Flexible In-Context Inference in Large Language Models [77.98801218316505]
  Large language models (LLMs) exhibit emergent behaviors suggestive of human-like reasoning.<n>We investigate the internal processing of LLMs during in-context concept inference.
  arXiv  Detail & Related papers  (2026-02-08T03:14:39Z)
• Differentiate-and-Inject: Enhancing VLAs via Functional Differentiation Induced by In-Parameter Structural Reasoning [9.966857651301515]
  iSTAR is a framework for enhancing vision-language-action models.<n>It embeds task-level semantic structure directly into model parameters.<n>It achieves more reliable task decompositions and higher success rates than both in-context and end-to-end VLA baselines.
  arXiv  Detail & Related papers  (2026-02-07T13:31:11Z)
• GSR: Learning Structured Reasoning for Embodied Manipulation [10.756456261056867]
  Grounded Scene-graph Reasoning (GSR) is a structured reasoning paradigm that explicitly models world-state evolution as transitions over semantically grounded scene graphs.<n>GSR enables explicit reasoning about action preconditions, consequences, and goal satisfaction in a physically grounded space.
  arXiv  Detail & Related papers  (2026-02-02T06:07:42Z)
• Implicit Reasoning in Large Language Models: A Comprehensive Survey [67.53966514728383]
  Large Language Models (LLMs) have demonstrated strong generalization across a wide range of tasks.<n>Recent studies have shifted attention from explicit chain-of-thought prompting toward implicit reasoning.<n>This survey introduces a taxonomy centered on execution paradigms, shifting the focus from representational forms to computational strategies.
  arXiv  Detail & Related papers  (2025-09-02T14:16:02Z)
• Explainable Chain-of-Thought Reasoning: An Empirical Analysis on State-Aware Reasoning Dynamics [69.00587226225232]
  We introduce a state-aware transition framework that abstracts CoT trajectories into structured latent dynamics.<n>To characterize the global structure of reasoning, we model their progression as a Markov chain.<n>This abstraction supports a range of analyses, including semantic role identification, temporal pattern visualization, and consistency evaluation.
  arXiv  Detail & Related papers  (2025-08-29T18:53:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.