World-Coherent Decoding: Self-Verifying Test-Time Planning for World Action Models

• URL: http://arxiv.org/abs/2609.02159v1
• Date: Wed, 02 Sep 2026 06:21:36 GMT
• Title: World-Coherent Decoding: Self-Verifying Test-Time Planning for World Action Models
• Abstract summary: World-Coherent-Decoding (WCD) is a self-verifying test-time planning framework for WAMs.<n>WCD trains a lightweight online predictor for future candidate selection.<n>On RoboTwin 2.0, WCD improves Hard success under limited randomized-scene supervision from $55.80%$ to $60.90%$, with a $+16.43$ gains on Horizon-3 tasks.<n>These results highlight a simple principle: test-time scaling for WAMs depends less on sampling more futures than on selecting reliable ones.
• Score: 20.97725301919032
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: World Action Models (WAMs) aim to control robots by stochastically generating visual futures and then decoding actions, but empirical observations indicate that the results can strongly depend on which future is selected. We propose World-Coherent-Decoding (WCD), a self-verifying test-time planning framework that treats WAM rollouts as falsifiable future--action hypotheses. At each decision step, WCD samples multiple candidates from a frozen WAM and ranks them using internal generative signals: flow-based video surprisal for visual plausibility and action path effort for action-generation stability. After execution, the realized observation audits the selected imagination, yielding an imagination--reality mismatch that trains a lightweight online predictor for future candidate selection. Thus, WCD converts delayed self-verification into pre-execution reliability estimation without updating the backbone model. On RoboTwin 2.0, WCD improves Hard success under limited randomized-scene supervision from $55.80\%$ to $60.90\%$, with a $+16.43$ gains on Horizon-3 tasks, and shows qualitative robustness on real Franka visual-shift tests. These results highlight a simple principle: test-time scaling for WAMs depends less on sampling more futures than on selecting reliable ones.

Related papers

• WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models [7.861070986808876]
  Post-training VLA policies typically rely on supervised fine-tuning with expensive and potentially unstable real-world exploration.<n>We introduce WISE (World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models), a unified framework that coordinates when and how world-model imagination is used during policy refinement.
  arXiv  Detail & Related papers  (2026-09-03T11:17:57Z)
• Discriminative World Models for Web Agents [52.31107486410659]
  Recent web agents use world models for test-time action selection by sampling candidate actions, predicting the resulting web states, and ranking them with a ranker model or a Process Reward Model (PRM)<n>We introduce predicted-state matching, a training objective where the predicted representation must distinguish the true resulting state from those reached by alternative actions.<n>Our approach improves PRM-style action ranking on WebPRMBench compared with action-only PRMs and PRMs augmented with supervised-next-state world models.
  arXiv  Detail & Related papers  (2026-09-02T17:59:40Z)
• TrAct: Bridging Robot Control and Visual Prediction with Visual Tracks [22.702826122425268]
  We propose TrAct, a world-model-based robot decision-making framework that uses visual tracks as an intermediate interface between control and prediction.<n>TrAct consists of three components: a Vision-Language-Action-and-Track model (VLAT) that jointly predicts candidate actions and corresponding visual tracks from the current observation and language instruction; a track-conditioned world model (TWM) that predicts future visual outcomes conditioned on the proposed tracks; and a vision-language reward model (VLAC) that scores the predicted outcomes.
  arXiv  Detail & Related papers  (2026-08-25T06:00:01Z)
• MoP-JEPA: Hard-Assigned Predictor Mixtures for Stochastic JEPA World Models [14.76812870029721]
  MoP-JEPA produces a finite candidate set in one pass.<n>On held-out OGBench transitions, graph search with single-output predictors succeeds on $0.02$--$0.09$ of queries, whereas MoP-JEPA reaches $0.85$.
  arXiv  Detail & Related papers  (2026-07-06T15:47:37Z)
• Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Models [54.097381112138]
  Current self-evolving LMMs struggle on vision-language understanding tasks such as image captioning and visual question answering.<n>We propose VISE, a purely unsupervised self-evolving framework that directly regularizes the model's visual conditioning policy.<n>VISE operates within a single model without specialist roles, external reward models, or annotations.
  arXiv  Detail & Related papers  (2026-06-25T17:59:55Z)
• DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners? [57.585275546688116]
  Vision-Language Models (VLMs) are increasingly deployed as high-level planners for embodied agents.<n>We argue that choosing when and where to spend test-time compute is central to bringing frontier performance to the real world.<n>We introduce DIRECT, a routing framework that uses multimodal scene context to allocate compute per prompt.
  arXiv  Detail & Related papers  (2026-06-10T17:58:49Z)
• PRISM: PRior-guided Imagination Sampling in world Models [7.304186330343712]
  We introduce PRISM, a task-agnostic framework that extracts both from a single dataset.<n>PRISM improves success rates by 35 percentage points over vanilla world-model-based MPC on Cube and 32 percentage points on PushT.
  arXiv  Detail & Related papers  (2026-06-06T04:18:10Z)
• World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoning [67.93052893044603]
  We study how a model learns to invoke, verify, and integrate visual future simulation alongside abstract reasoning.<n>PF-OPSD uses ground-truth future videos and answers only as teacher-side privileged context to evaluate on-policy concrete-reasoning trajectories.
  arXiv  Detail & Related papers  (2026-06-02T13:07:49Z)
• When to Trust Imagination: Adaptive Action Execution for World Action Models [42.51856318901667]
  World Action Models (WAMs) have recently emerged as a promising paradigm for robotic manipulation by jointly predicting future visual observations and future actions.<n>Current WAMs execute a fixed number of predicted actions after each model inference, leaving the robot blind to whether the imagined future remains consistent with the actual physical rollout.<n>We formulate adaptive WAM execution as a future-reality verification problem: the robot should execute longer when the WAM-predicted future remains reliable, and replan earlier when reality deviates from imagination.
  arXiv  Detail & Related papers  (2026-05-07T13:18:28Z)
• World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry [82.93104394404781]
  General-purpose world models promise scalable policy evaluation, optimization, and planning.<n>We propose World Action Verifier (WAV), a framework that enables world models to identify their own prediction errors and self-improve.
  arXiv  Detail & Related papers  (2026-04-02T12:48:36Z)
• Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokens [53.99177152562075]
  Scaling up autoregressive models in vision has not proven as beneficial as in large language models. We focus on two critical factors: whether models use discrete or continuous tokens, and whether tokens are generated in a random or fixed order using BERT- or GPT-like transformer architectures. Our results show that while all models scale effectively in terms of validation loss, their evaluation performance -- measured by FID, GenEval score, and visual quality -- follows different trends.
  arXiv  Detail & Related papers  (2024-10-17T17:59:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.