State-Centric Decision Process
- URL: http://arxiv.org/abs/2605.12755v1
- Date: Tue, 12 May 2026 21:09:43 GMT
- Title: State-Centric Decision Process
- Abstract summary: We introduce the State-Centric Decision Process (SDP), a runtime framework that constructs missing inputs by having the agent build them, predicate by predicate, as it acts.<n>SDP achieves the best training-free results on five benchmarks spanning planning, scientific exploration, web reasoning, and multi-hop question answering.
- Score: 12.213427126535104
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Language environments such as web browsers, code terminals, and interactive simulations emit raw text rather than states, and provide none of the runtime structure that MDP analysis requires. No explicit state space, no observation-to-state mapping, no certified transitions, and no termination criterion. We introduce the State-Centric Decision Process (SDP), a runtime framework that constructs these missing inputs by having the agent build them, predicate by predicate, as it acts. At each step the agent commits to a natural-language predicate describing how the world should look, takes an action to make it true, and checks the observation against it. Predicates that pass become certified states, and the resulting trajectory carries the four objects language environments do not provide, namely a task-induced state space, an observation-to-state mapping, certified transitions, and a termination criterion. We evaluate SDP on five benchmarks spanning planning, scientific exploration, web reasoning, and multi-hop question answering. SDP achieves the best training-free results on all five, with the advantage widening as the horizon grows. The certified trajectories additionally support analyses unavailable to reactive agents, including per-predicate credit assignment, failure localization, partial-progress measurement, and modular operator replacement.
Related papers
- Lift, Associate, and Fuse: A Decision-Centric Framework for 2D-to-3D Foundation Model Transfer [18.616107275409764]
Methods that transfer predictions from two-dimensional foundation models into three-dimensional segmentation are commonly grouped by task or representation.<n>We introduce textbfLift, Associate, and Fuse (LAF), a decision-centric framework that represents a transfer system as five operators.<n>LAF defines an explicit contract for the persistent carrier and identifies the first stage at which discarded evidence becomes unrecoverable.
arXiv Detail & Related papers (2026-08-21T01:33:23Z) - ScrambleToolBench: Agents Search Exhaustively Even When Their Own Map Points to the Next Step [74.83535434786145]
We introduce ScrambleToolBench, an interactive terminal benchmark designed to isolate behavioral reasoning.<n>The benchmark requires agents to uncover hidden tool behaviors entirely through trial-and-error interaction.<n>Our evaluation of state-of-the-art language models reveals that successful initial discovery does not translate into robust adaptation.
arXiv Detail & Related papers (2026-08-03T15:07:46Z) - PULSE: An Executable Contract Language for Spatiotemporal Knowledge Graph Engineering [2.2262915480980063]
We present PULSE, an Object-Process-Methodology-inspired language that localizes four operational roles and their write effects in one typed runtime.<n>The implemented contract fixes evidence non-overwrite, branch isolation, grounded multisubject timers, guarded state change, and declaration-ranked event ordering over time and space.<n>GeoSPARQL, SOSA, and SHACL remain generated views; Lean 4 checks kernel analogues for positions, evidence, clocks, monitors, atomicity, and branch source retention.
arXiv Detail & Related papers (2026-07-26T17:44:05Z) - PhyAgentOS: A Self-Evolving Operating System for Embodied Agents with Decoupled Cognitive Planning and Physical Execution [49.776611937968]
We present PhyAgentOS, a foundation delivering scheduling, verification, memory, benchmarking, and safety as system-level services.<n>Its Session-Centered treats a session, not an action, as the minimum unit of scheduling, compatibility, supervised execution, evidence collection, and acceptance.<n>SessionVerifier distinguishes execution termination from semantic task completion via evidence-grounded verdicts of success, failure, or replan.<n> Benchmarking reuses the deployment session and verification path, so results trace to real execution.
arXiv Detail & Related papers (2026-07-18T04:46:53Z) - Agent-BRACE: Decoupling Beliefs from Actions in Long-Horizon Tasks via Verbalized State Uncertainty [70.43119366710778]
We introduce Agent-BRACE: Agent Belief state Representation via Abstraction and Confidence Estimation.<n>It is a method that decouples an LLM agent into a belief state model and a policy model, jointly optimized via reinforcement learning.<n>It achieves an average absolute improvement of +14.5% across long-horizon, partially observable language environments.
arXiv Detail & Related papers (2026-05-12T02:37:04Z) - The Context Gathering Decision Process: A POMDP Framework for Agentic Search [38.92972416925679]
Large Language Model (LLM) agents are deployed in complex environments.<n>Without explicit infrastructure, an agent's working memory can degrade into lossy representations of the search state.<n>We formalize this challenge as the Context Gathering Decision Process (CGDP)<n>We derive two plug-and-play interventions for iterative LLM agents.
arXiv Detail & Related papers (2026-05-07T23:45:07Z) - POSTCONDBENCH: Benchmarking Correctness and Completeness in Formal Postcondition Inference [10.01438318022033]
We introduce POSTCONDBENCH, a benchmark for evaluating method-level postcondition generation from real-world software.<n>To enable automatic evaluation, POSTCONDBENCH provides a runnable execution environment and operationalizes completeness via defect discrimination.<n>Our results reveal a substantial gap between correctness and completeness, and show that repository-level dependencies and method complexity exacerbate this gap.
arXiv Detail & Related papers (2026-05-05T04:29:38Z) - RunAgent: Interpreting Natural-Language Plans with Constraint-Guided Execution [36.644786364066796]
RunAgent is a multi-agent plan execution platform that interprets natural-language plans and enforces stepwise execution through constraints and rubrics.<n>We show that RunAgent outperforms baseline LLMs and state-of-the-art PlanGEN methods.
arXiv Detail & Related papers (2026-05-01T17:29:45Z) - Context: Proactive Goal-Directed Intelligence via Composable Sandboxed Programs, Declarative Wiring, and Structured Interaction [0.0]
We present Context, the intelligence layer of the Magarshak Architecture.<n>It replaces reactive query-response chatbots with proactive goal-directed agents that advance shared tasks without waiting for user prompts.<n>We prove six formal results: the Context Stability Theorem, bounding per-turn LM cost as a function of semantic change rate; a Program Composition Correctness Theorem; a Declarative Wiring Soundness Theorem; the Proactive Dominance Theorem.
arXiv Detail & Related papers (2026-04-21T14:39:40Z) - VIRO: Robust and Efficient Neuro-Symbolic Reasoning with Verification for Referring Expression Comprehension [51.76841625486355]
Referring Expression (REC) aims to localize the image region corresponding to a natural-language query.<n>Recent neuro-symbolic REC approaches leverage large language models (LLMs) and vision-language models (VLMs) to perform compositional reasoning.<n>We introduce VIRO, a neuro-symbolic framework that embeds lightweight operator-level verifiers within reasoning steps.
arXiv Detail & Related papers (2026-01-19T07:21:19Z) - Do What? Teaching Vision-Language-Action Models to Reject the Impossible [53.40183895299108]
Vision-Language-Action (VLA) models have demonstrated strong performance on a range of robotic tasks.<n>We propose Instruct-Verify-and-Act (IVA), a framework that detects when an instruction cannot be executed due to a false premise.<n>Our experiments show that IVA improves false premise detection accuracy by 97.56% over baselines.
arXiv Detail & Related papers (2025-08-22T10:54:33Z) - ThinkGeo: Evaluating Tool-Augmented Agents for Remote Sensing Tasks [64.86209459039313]
ThinkGeo is an agentic benchmark designed to evaluate tool-augmented agents on remote sensing tasks via structured tool use and multi-step planning.<n>We implement a ReAct-style interaction loop and evaluate both open and closed-source LLMs on 486 structured agentic tasks with 1,773 expert-verified reasoning steps.<n>Our analysis reveals notable disparities in tool accuracy and planning consistency across models.
arXiv Detail & Related papers (2025-05-29T17:59:38Z) - Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models [31.509994889286183]
We introduce Language Agent Tree Search (LATS) -- the first general framework that synergizes the capabilities of language models (LMs) in reasoning, acting, and planning.
A key feature of our approach is the incorporation of an environment for external feedback, which offers a more deliberate and adaptive problem-solving mechanism.
LATS achieves state-of-the-art pass@1 accuracy (92.7%) for programming on HumanEval with GPT-4 and demonstrates gradient-free performance (average score of 75.9) comparable to gradient-based fine-tuning for web navigation on WebShop with GPT
arXiv Detail & Related papers (2023-10-06T17:55:11Z) - ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning [63.77667876176978]
Large language models show improved downstream task interpretability when prompted to generate step-by-step reasoning to justify their final answers.
These reasoning steps greatly improve model interpretability and verification, but objectively studying their correctness is difficult.
We present ROS, a suite of interpretable, unsupervised automatic scores that improve and extend previous text generation evaluation metrics.
arXiv Detail & Related papers (2022-12-15T15:52:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.